-- Logs begin at Mon 2022-04-11 22:51:05 UTC, end at Tue 2022-04-12 00:24:44 UTC. -- Apr 11 23:41:39.708007 dv-cinder-837432-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Apr 11 23:41:39.716091 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Apr 11 23:41:39.718114 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Apr 11 23:41:39 2022] *** Apr 11 23:41:39.718114 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 11 23:41:39.718114 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 11 23:41:39.718114 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: nodename: dv-cinder-837432-2-iscsi Apr 11 23:41:39.718114 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: machine: x86_64 Apr 11 23:41:39.718114 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: clock source: unix Apr 11 23:41:39.718114 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: pcre jit disabled Apr 11 23:41:39.718569 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: detected number of CPU cores: 4 Apr 11 23:41:39.718569 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: current working directory: / Apr 11 23:41:39.718569 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: detected binary path: /usr/bin/uwsgi-core Apr 11 23:41:39.718569 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: your processes number limit is 47680 Apr 11 23:41:39.718569 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: your memory page size is 4096 bytes Apr 11 23:41:39.718569 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: detected max file descriptor number: 2048 Apr 11 23:41:39.718569 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: lock engine: pthread robust mutexes Apr 11 23:41:39.718569 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: thunder lock: enabled Apr 11 23:41:39.718569 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Apr 11 23:41:39.718569 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 11 23:41:39.765986 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: Python main interpreter initialized at 0x5575150ca9c0 Apr 11 23:41:39.765986 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: python threads support enabled Apr 11 23:41:39.765986 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: your server socket listen backlog is limited to 100 connections Apr 11 23:41:39.765986 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: your mercy for graceful operations on workers is 90 seconds Apr 11 23:41:39.766372 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: mapped 403077 bytes (393 KB) for 2 cores Apr 11 23:41:39.766447 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: *** Operational MODE: preforking *** Apr 11 23:41:39.766729 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: *** uWSGI is running in multiple interpreter mode *** Apr 11 23:41:39.766729 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: spawned uWSGI master process (pid: 86486) Apr 11 23:41:39.766955 dv-cinder-837432-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Apr 11 23:41:39.767553 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: spawned uWSGI worker 1 (pid: 86500, cores: 1) Apr 11 23:41:39.767896 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: spawned uWSGI worker 2 (pid: 86501, cores: 1) Apr 11 23:41:39.768153 dv-cinder-837432-2-iscsi devstack@keystone.service[86486]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 11 23:41:45.587045 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 23:41:45.587045 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: from cryptography.utils import int_from_bytes Apr 11 23:41:45.587842 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 23:41:45.587842 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: from cryptography.utils import int_from_bytes Apr 11 23:41:45.588246 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 23:41:45.588246 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: from cryptography.utils import int_from_bytes Apr 11 23:41:45.588361 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 11 23:41:45.588361 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: from cryptography.utils import int_from_bytes Apr 11 23:41:45.633279 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 11 23:41:45.633429 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 11 23:41:45.633508 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 11 23:41:45.633592 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 11 23:41:45.633671 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] command line args: [] {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 11 23:41:45.633747 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] command line args: [] {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 11 23:41:45.633890 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 11 23:41:45.633995 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 11 23:41:45.634078 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ================================================================================ {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 11 23:41:45.634160 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ================================================================================ {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 11 23:41:45.634299 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] admin_token = **** {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.634404 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] admin_token = **** {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.634542 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] config_dir = [] {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.634648 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] config_dir = [] {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.634725 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.634854 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.634944 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] config_source = [] {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.635022 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] config_source = [] {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.635103 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] debug = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.635181 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] debug = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.635258 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.635495 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.635638 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.635755 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.635755 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.635943 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.636061 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.636165 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.636262 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.636364 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.636458 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] list_limit = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.636563 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] list_limit = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.636659 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] log_config_append = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.636766 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] log_config_append = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.636861 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.636954 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.637060 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] log_dir = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.637177 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] log_dir = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.637279 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] log_file = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.637375 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] log_file = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.637468 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.637552 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.637623 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.637700 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.637770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.637837 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.637998 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.638100 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.638173 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.638248 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.638324 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.638400 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.638556 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.638646 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.638785 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.638880 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.639040 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.639175 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.639251 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.639365 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.639482 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.639560 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.639711 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.639802 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.639954 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.640039 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.640195 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.640314 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.640462 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.640537 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.640945 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.24/identity {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.641038 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.24/identity {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.641111 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] publish_errors = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.641226 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] publish_errors = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.641336 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.641413 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.641561 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.641642 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.641733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.641807 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.641972 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.642130 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.642204 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.642271 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.642418 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] standard_threads = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.642500 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] standard_threads = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.642644 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.642720 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.642904 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.642983 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.643065 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.643140 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.643238 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] use_journal = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.643320 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] use_journal = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.643396 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] use_json = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.643464 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] use_json = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.643565 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] use_stderr = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.643648 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] use_stderr = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.643722 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] use_syslog = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.643790 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] use_syslog = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.643950 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.644031 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 11 23:41:45.644201 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.644276 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.644433 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.644507 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.644683 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.644763 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.644918 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.645000 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.645161 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.645236 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.645395 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.645477 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.645651 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.645787 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.646436 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.646512 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.646680 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.646762 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.646947 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.647025 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.647195 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.647280 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.647426 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.647501 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.647671 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.647756 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.647903 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.647988 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.648145 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.648220 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.648387 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.648469 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.648622 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.648698 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.648871 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.648956 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.649117 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.649192 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.649356 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.649440 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.649586 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.649669 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.649835 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.649912 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.650092 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.650173 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.650339 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.650424 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.650583 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.650659 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.650807 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.650964 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.651046 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.651124 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.651270 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.651348 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.651501 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.651575 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.651742 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.651824 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.651982 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.652087 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.652206 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.652306 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.652430 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.652539 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.652670 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.652772 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.652913 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.653036 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.653144 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.653286 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.653392 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.653474 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.653600 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.653677 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.653829 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.653917 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.654057 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.654132 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.654280 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.654357 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.654504 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.654588 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.654728 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.654806 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.654974 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.655061 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.655206 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.655294 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.655448 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.655532 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.655675 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.655752 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.655905 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.655980 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.656129 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.656206 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.656359 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.656434 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.656589 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.656665 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.656830 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.656914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.657053 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.657128 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.657285 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.657367 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.657515 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.657592 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.657746 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.657821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.657974 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.658050 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.658203 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.658280 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.658430 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.658508 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.658671 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.658747 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.658924 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.659006 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.659157 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.659233 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.659383 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.659470 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.659624 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.659704 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.659856 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.659933 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.660081 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.660164 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.660313 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.660396 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.660542 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.660618 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.660801 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.660876 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.661032 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.661109 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.661287 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.661363 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.661535 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.661610 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.661770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.661847 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.662000 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.662075 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.662229 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.662304 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.662469 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.662554 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.662700 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.662786 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.662954 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.663033 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.663192 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.663278 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.663422 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.663498 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.663653 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.663728 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.663882 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.663966 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.664111 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.664193 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.664338 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.664414 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.664591 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.664675 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.664824 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.664899 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.665055 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.665136 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.665287 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.665371 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.665526 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.665603 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.665756 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.665831 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.665985 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.666068 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.666214 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.666290 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.666437 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.666512 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.666660 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.666747 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.666904 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.666984 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.667136 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.667212 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.667361 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.667453 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.667591 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.667667 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.667822 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.667897 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.668063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.668146 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.668296 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.668374 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.668545 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.668621 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.668796 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.668879 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.669029 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.669104 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.669253 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] auth.external = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.669329 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] auth.external = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.669478 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.669562 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.669766 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.669869 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.669993 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.670072 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.670215 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] auth.password = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.670290 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] auth.password = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.670439 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] auth.token = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.670524 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] auth.token = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.670670 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.670747 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.670919 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.671000 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.671161 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.671249 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.671386 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.671462 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.671626 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.671703 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.671869 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.671955 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.672093 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.672170 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.672322 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] credential.caching = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.672399 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] credential.caching = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.672563 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.672715 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.672789 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.672859 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.673035 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.673114 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.673268 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.673357 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.673503 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.673592 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.673733 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.673810 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.673991 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.674075 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.674237 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.674316 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.674468 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.674545 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.674715 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.674801 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.675015 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.675103 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.675258 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.675342 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.675519 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.675607 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.675758 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.675841 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.676008 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.676085 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.676236 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] federation.caching = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.676320 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] federation.caching = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.676469 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.676548 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.676709 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.676788 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.677460 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.677546 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.677686 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.677762 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.677926 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.678005 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.678160 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.678245 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.678407 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.678490 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.678636 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.678713 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.678907 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.678991 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.679141 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.679228 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.679381 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.679457 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.679611 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] identity.caching = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.679689 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] identity.caching = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.679852 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.679929 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.680093 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.680170 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.680324 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.680402 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.680553 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.680629 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.680791 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.680867 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.681015 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.681093 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.681245 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.681322 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.681485 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.681562 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.681729 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.681807 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.681955 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.682030 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.682177 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.682254 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.682401 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.682479 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.682637 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.682713 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.682897 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.682976 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.683139 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.683217 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.683385 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.683462 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.683623 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.683699 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.683883 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.683960 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.684114 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.684190 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.684344 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.684420 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.684568 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.684645 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.684798 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.684874 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.685021 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.685097 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.685251 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.685328 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.685486 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.685566 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.685719 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.685810 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.685962 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.686040 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.686188 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.686265 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.686431 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.686517 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.686672 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.686749 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.686929 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.687013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.687171 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.687260 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.687411 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.687488 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.687633 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.687709 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.687865 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.687952 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.688091 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.688168 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.688321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.688397 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.688552 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.688637 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.688788 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.688865 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.689019 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.689104 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.689250 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.689335 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.689492 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.689569 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.689739 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.689816 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.689964 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.690048 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.690186 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.690263 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.690426 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.690503 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.690667 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.690751 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.690917 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.690997 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.691153 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.691231 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.691385 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.691475 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.691611 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.user = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.691689 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.user = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.691846 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.691924 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.692098 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.692184 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.692325 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.692403 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.692606 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.693178 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.693360 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.693445 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.693601 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.693679 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.693832 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.693908 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.694055 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.694140 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.694287 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.694365 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.694517 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.694593 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.694747 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.694880 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.695005 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.695078 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.695227 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.695305 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.695466 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.695555 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.695708 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.695793 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.695945 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.696022 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.696183 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.696341 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.696416 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.696486 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.696632 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.696710 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.696861 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.696947 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.697088 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.697165 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.697316 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.697393 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.697544 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.697629 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.697796 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.697932 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.698016 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.698090 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.698243 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.698348 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.698488 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.698576 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.698710 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.698796 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.698971 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.699073 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.699203 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.699297 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.699431 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.699508 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.699663 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.699753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.699904 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.699982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.700139 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.700216 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.700367 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.700453 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.700598 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.700736 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.700833 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] resource.caching = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.700896 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] resource.caching = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.701062 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.701157 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.701302 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.701379 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.701530 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.701607 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.701772 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.701851 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.702013 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.702090 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.702243 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.702319 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.702481 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.702559 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.702712 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.702789 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.702964 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.703044 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.703195 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] role.caching = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.703275 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] role.caching = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.703434 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] role.driver = sql {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.703510 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] role.driver = sql {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.703656 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.703733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.703898 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.703975 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.704145 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.704223 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.704387 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.704464 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.704627 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.704706 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.704864 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.704940 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.705104 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.705181 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.705342 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.705420 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.705583 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.705660 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.705809 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.705886 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.706049 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.706127 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.706290 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.706367 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.706531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.706609 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.706769 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.706876 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.707178 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.707257 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.707408 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.707485 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.707650 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.707729 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.707892 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.707969 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.708135 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.708222 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.708398 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.708476 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.708626 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.708703 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.708873 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.708958 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.709116 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.709229 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.709350 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.709428 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.709574 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.709660 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.709800 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.709877 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.710021 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.710098 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.710265 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.710350 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.710511 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.710588 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.710751 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.710828 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.711006 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.711096 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.711237 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.711314 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.711460 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.711537 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.711690 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] token.caching = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.712022 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] token.caching = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.712175 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.712251 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.712416 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.712493 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.712645 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.712731 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.712892 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.712969 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.713133 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.713209 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.713364 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.713449 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.713601 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.713712 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.713837 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.713914 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.714084 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.714171 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.714305 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.714382 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.714535 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.714613 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.714764 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.714877 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.715029 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.715106 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.715270 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.715346 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.715496 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.715586 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.715731 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.715809 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.716014 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.716091 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.716265 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] database.connection = **** {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.716356 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] database.connection = **** {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.716510 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.716592 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.716733 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.716813 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.716964 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.717041 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.717199 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.717275 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.717429 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.717507 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.717659 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.717736 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.717887 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.717964 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.718118 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.718197 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.718356 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.718432 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.718583 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.718660 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.718818 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.718939 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.719071 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.719149 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.719310 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.719389 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.719539 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.719618 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.719778 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.719856 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.720002 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.720078 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.720234 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.720313 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.720464 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.720542 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 11 23:41:45.720614 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86500) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 11 23:41:45.720683 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86501) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 11 23:41:45.751138 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.751282 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.751359 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.751430 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.751778 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.751879 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.760949 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.761090 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.789257 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.789410 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.789498 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.789636 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.843913 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.844037 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.893341 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.893566 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.893977 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.894209 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.958678 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.958921 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.959048 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.959132 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.959277 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.959359 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.959500 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.959597 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.959716 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.959799 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.959930 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.960141 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.995997 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.996196 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.996316 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.996427 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.996526 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.996644 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.996727 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.996859 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.996942 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.997087 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.997219 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.997351 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.997434 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:45.997509 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:46.009193 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:46.009407 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:46.022048 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:46.022231 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:46.022315 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:46.022460 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:46.022542 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:46.022681 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:46.022764 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:46.022914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:46.022996 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:46.023126 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:46.023208 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:46.023332 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:46.023415 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86500) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:46.023541 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86501) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Apr 11 23:41:46.041032 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.041139 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.041220 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 11 23:41:46.041297 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 11 23:41:46.041556 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.041638 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.041753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 11 23:41:46.041844 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Apr 11 23:41:46.042018 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.042100 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.042272 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.042353 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.042525 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.042614 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.042775 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.042878 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.053877 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.054036 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.054135 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.054307 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.054390 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.054569 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.054652 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.054859 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.062870 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.063017 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.066069 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.066211 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.066340 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.066487 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.066614 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.066762 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.066922 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.067059 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.067176 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.067330 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.067431 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.068138 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.068230 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.068404 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.068494 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.068669 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.068750 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.068930 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.069010 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.069194 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.069277 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.069454 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.095401 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.095657 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.096919 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.097194 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.097276 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.097551 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.102907 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.103245 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.103349 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.103549 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.103632 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.103893 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.110650 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.110952 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.111037 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.111292 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.115898 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.116181 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.116368 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.116454 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.116692 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.116774 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.116984 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.117068 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.117255 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.117338 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.117521 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.117603 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.117786 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.117875 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.118067 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.118328 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.136203 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.136472 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.136874 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.137147 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.140943 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.141609 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.144498 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.144886 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.145173 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.145560 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.149834 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.150496 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.153394 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.154072 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.156982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.157274 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.157558 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.157639 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.157836 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.157919 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.158108 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.158197 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.158389 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.158472 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.158706 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.159013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.178390 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.178674 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.178968 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.179130 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.179213 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.179424 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.179686 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.179943 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.186917 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.187648 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.188579 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.188847 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.189313 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.189584 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.191975 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.192255 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.192551 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.192843 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.193071 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.193154 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.193348 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.193619 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.193904 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.194175 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.206146 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.206419 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.206690 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.206984 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.207287 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.207562 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.207836 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.208127 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.208492 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.208793 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.209080 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.209601 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.209887 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.210170 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.227472 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.228752 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.230646 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.231966 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.233891 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.235306 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.339204 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.339625 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.340864 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.341139 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.341291 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.341422 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.341570 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.341850 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.348673 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.349589 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.350749 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.351175 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.354100 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.354386 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.354504 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.354723 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.354884 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.355062 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.355146 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.355349 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.364022 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.364306 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.364387 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.365134 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.365217 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.365411 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.372867 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86500) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.373140 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86501) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Apr 11 23:41:46.373224 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.373417 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.373512 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.373778 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.373860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.374044 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.374127 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.374310 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.374400 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.374578 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.374659 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.374871 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.374955 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.375147 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.375229 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.375413 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.375494 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.375674 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.375763 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.375932 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.376012 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.376192 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.376272 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.376444 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86500) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.376535 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.376697 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86501) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Apr 11 23:41:46.414216 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5575150ca9c0 pid: 86500 (default app) Apr 11 23:41:46.414363 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5575150ca9c0 pid: 86501 (default app) Apr 11 23:41:46.417719 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981a4d1-2d75-4940-9f1a-b91fc99ca50e None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:41:46.418008 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981a4d1-2d75-4940-9f1a-b91fc99ca50e None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:41:46.418281 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981a4d1-2d75-4940-9f1a-b91fc99ca50e None None] PATH_INFO: `/v3` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:41:46.422431 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 791 bytes} [Mon Apr 11 23:41:46 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:41:55.607108 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa1d62-220a-4207-930e-7cd9e767d324 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:41:55.607706 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa1d62-220a-4207-930e-7cd9e767d324 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:41:55.607706 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa1d62-220a-4207-930e-7cd9e767d324 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:41:55.612673 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1/2] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:41:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:41:55.618287 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d47e9-579b-4689-88eb-d6361d77967b None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:41:55.618662 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d47e9-579b-4689-88eb-d6361d77967b None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:41:55.618848 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d47e9-579b-4689-88eb-d6361d77967b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:41:55.648830 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG oslo_db.sqlalchemy.engines [None req-3f0d47e9-579b-4689-88eb-d6361d77967b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86500) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 23:41:55.831772 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG passlib.handlers.bcrypt [None req-3f0d47e9-579b-4689-88eb-d6361d77967b None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86500) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 11 23:41:55.832190 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG passlib.handlers.bcrypt [None req-3f0d47e9-579b-4689-88eb-d6361d77967b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86500) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 11 23:41:55.887298 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-3f0d47e9-579b-4689-88eb-d6361d77967b None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:41:55.888815 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-3f0d47e9-579b-4689-88eb-d6361d77967b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:41:56.009281 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 2/3] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:41:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 11 23:41:56.165331 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa1d62-220a-4207-930e-7cd9e767d324 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:41:56.198904 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG oslo_db.sqlalchemy.engines [None req-eefa1d62-220a-4207-930e-7cd9e767d324 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86501) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 11 23:41:56.325631 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa1d62-220a-4207-930e-7cd9e767d324 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:41:56.329905 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9c36e8-18bd-415e-b165-43e441213d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:41:56.330556 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c36e8-18bd-415e-b165-43e441213d83 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:41:56.330856 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c36e8-18bd-415e-b165-43e441213d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:41:56.331135 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9c36e8-18bd-415e-b165-43e441213d83 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:41:56.340221 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c36e8-18bd-415e-b165-43e441213d83 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:41:56.390033 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8a9c36e8-18bd-415e-b165-43e441213d83 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 11 23:41:56.390364 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9c36e8-18bd-415e-b165-43e441213d83 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:41:56.400326 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 2/4] 10.222.0.24 () {58 vars in 1324 bytes} [Mon Apr 11 23:41:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 23:41:56.406300 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d47e9-579b-4689-88eb-d6361d77967b None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:41:56.421035 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d47e9-579b-4689-88eb-d6361d77967b None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:41:56.425350 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cc1332-023d-4ef6-9abe-0dc3bbc2edf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:41:56.426449 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc1332-023d-4ef6-9abe-0dc3bbc2edf4 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:41:56.426741 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc1332-023d-4ef6-9abe-0dc3bbc2edf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:41:56.427041 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cc1332-023d-4ef6-9abe-0dc3bbc2edf4 admin admin] PATH_INFO: `/v3/projects/1da535e2d1e54da3b958d1c813082f2d` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:41:56.428532 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc1332-023d-4ef6-9abe-0dc3bbc2edf4 admin admin] RBAC: Authorizing `identity:get_project(project_id=1da535e2d1e54da3b958d1c813082f2d)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:41:56.480669 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.common.rbac_enforcer.enforcer [None req-65cc1332-023d-4ef6-9abe-0dc3bbc2edf4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Apr 11 23:41:56.481008 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cc1332-023d-4ef6-9abe-0dc3bbc2edf4 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:41:56.485544 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 3/5] 10.222.0.24 () {56 vars in 1207 bytes} [Mon Apr 11 23:41:56 2022] GET /identity/v3/projects/1da535e2d1e54da3b958d1c813082f2d => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:41:58.720316 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d127131-4f31-4b7b-b88f-9a3b675145c8 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:41:58.720850 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d127131-4f31-4b7b-b88f-9a3b675145c8 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:41:58.720850 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d127131-4f31-4b7b-b88f-9a3b675145c8 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:41:58.726048 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 3/6] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:41:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:41:58.731444 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4738d-60f3-4cb5-a29d-7b71d49ad71a None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:41:58.731933 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4738d-60f3-4cb5-a29d-7b71d49ad71a None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:41:58.732029 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4738d-60f3-4cb5-a29d-7b71d49ad71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:41:58.750308 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-9cd4738d-60f3-4cb5-a29d-7b71d49ad71a None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:41:58.751857 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-9cd4738d-60f3-4cb5-a29d-7b71d49ad71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:41:58.759815 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 4/7] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:41:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Apr 11 23:41:58.782208 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d127131-4f31-4b7b-b88f-9a3b675145c8 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:41:58.794974 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d127131-4f31-4b7b-b88f-9a3b675145c8 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:41:58.799116 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd7be9f-5db2-410c-82f7-59e809af9dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:41:58.799741 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7be9f-5db2-410c-82f7-59e809af9dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:41:58.800018 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7be9f-5db2-410c-82f7-59e809af9dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:41:58.800289 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd7be9f-5db2-410c-82f7-59e809af9dd7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:41:58.807823 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7be9f-5db2-410c-82f7-59e809af9dd7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:41:58.809561 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd7be9f-5db2-410c-82f7-59e809af9dd7 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:41:58.818719 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 4/8] 10.222.0.24 () {58 vars in 1324 bytes} [Mon Apr 11 23:41:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 23:41:58.823979 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4738d-60f3-4cb5-a29d-7b71d49ad71a None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:41:58.832776 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4738d-60f3-4cb5-a29d-7b71d49ad71a None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:41:58.837966 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5781a314-4dd2-4667-9d16-49eee7000682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:41:58.838807 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781a314-4dd2-4667-9d16-49eee7000682 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:41:58.839123 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781a314-4dd2-4667-9d16-49eee7000682 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:41:58.839397 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5781a314-4dd2-4667-9d16-49eee7000682 admin admin] PATH_INFO: `/v3/users/abec147e21ba4a90ada48328d76ea483` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:41:58.840780 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781a314-4dd2-4667-9d16-49eee7000682 admin admin] RBAC: Authorizing `identity:get_user(user_id=abec147e21ba4a90ada48328d76ea483)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:41:58.842584 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5781a314-4dd2-4667-9d16-49eee7000682 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:41:58.844165 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 5/9] 10.222.0.24 () {56 vars in 1198 bytes} [Mon Apr 11 23:41:58 2022] GET /identity/v3/users/abec147e21ba4a90ada48328d76ea483 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:01.211635 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19262d55-00f0-4317-bfd5-8989ef5828c5 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:01.212412 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19262d55-00f0-4317-bfd5-8989ef5828c5 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:01.212412 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19262d55-00f0-4317-bfd5-8989ef5828c5 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:01.214191 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 5/10] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:01.219378 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4ff1e-35c5-45f4-b40b-93e18d9087b8 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:01.219796 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4ff1e-35c5-45f4-b40b-93e18d9087b8 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:01.220040 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4ff1e-35c5-45f4-b40b-93e18d9087b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:01.224990 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59b0c4-9115-4b4b-b9f6-6a213d774ca7 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:01.225277 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59b0c4-9115-4b4b-b9f6-6a213d774ca7 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:01.225563 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f59b0c4-9115-4b4b-b9f6-6a213d774ca7 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:01.227247 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 6/11] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:42:01.232288 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5d1dd-57dd-4536-826e-9a4eead1498f None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:01.232575 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5d1dd-57dd-4536-826e-9a4eead1498f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:01.232856 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5d1dd-57dd-4536-826e-9a4eead1498f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:01.237120 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-ccc4ff1e-35c5-45f4-b40b-93e18d9087b8 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:01.238290 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ccc4ff1e-35c5-45f4-b40b-93e18d9087b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:01.273158 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG passlib.handlers.bcrypt [None req-e3e5d1dd-57dd-4536-826e-9a4eead1498f None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=86501) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Apr 11 23:42:01.273586 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG passlib.handlers.bcrypt [None req-e3e5d1dd-57dd-4536-826e-9a4eead1498f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86501) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Apr 11 23:42:01.313795 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 6/12] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:01.320495 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-e3e5d1dd-57dd-4536-826e-9a4eead1498f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:01.322066 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-e3e5d1dd-57dd-4536-826e-9a4eead1498f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:01.335573 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4ff1e-35c5-45f4-b40b-93e18d9087b8 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:01.416297 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 7/13] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:42:01.428783 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4ff1e-35c5-45f4-b40b-93e18d9087b8 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:01.439641 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5d1dd-57dd-4536-826e-9a4eead1498f None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:01.460647 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7bf11-4b94-4161-9283-388887ff41b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:01.461288 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7bf11-4b94-4161-9283-388887ff41b5 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:01.461568 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7bf11-4b94-4161-9283-388887ff41b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:01.461892 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7bf11-4b94-4161-9283-388887ff41b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:01.523959 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7bf11-4b94-4161-9283-388887ff41b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:01.525421 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c7bf11-4b94-4161-9283-388887ff41b5 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:01.533312 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5d1dd-57dd-4536-826e-9a4eead1498f None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:01.565078 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb07ce-a763-44b1-bda8-d67849a7ded0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:01.566100 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb07ce-a763-44b1-bda8-d67849a7ded0 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:01.566382 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb07ce-a763-44b1-bda8-d67849a7ded0 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:01.566655 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb07ce-a763-44b1-bda8-d67849a7ded0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:01.579558 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb07ce-a763-44b1-bda8-d67849a7ded0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:01.587321 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-54fb07ce-a763-44b1-bda8-d67849a7ded0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:42:01.588502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 8/14] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:42:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:42:01.594102 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb07ce-a763-44b1-bda8-d67849a7ded0 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:01.619312 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 7/15] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 23:42:01.624824 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7bf11-4b94-4161-9283-388887ff41b5 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:01.685697 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb07ce-a763-44b1-bda8-d67849a7ded0 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:01.716515 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7bf11-4b94-4161-9283-388887ff41b5 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:01.717319 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbd191-cfec-442e-baf4-ec034c5d44f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:01.717985 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbd191-cfec-442e-baf4-ec034c5d44f9 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:01.718265 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbd191-cfec-442e-baf4-ec034c5d44f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:01.718539 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbd191-cfec-442e-baf4-ec034c5d44f9 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:01.719325 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbd191-cfec-442e-baf4-ec034c5d44f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:01.719630 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbd191-cfec-442e-baf4-ec034c5d44f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:01.721078 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbd191-cfec-442e-baf4-ec034c5d44f9 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:01.733010 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 9/16] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:01.738358 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbd191-cfec-442e-baf4-ec034c5d44f9 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:01.748376 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9385b-251c-4163-b95b-48ccf1608261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:01.749158 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9385b-251c-4163-b95b-48ccf1608261 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:01.749438 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9385b-251c-4163-b95b-48ccf1608261 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:01.749711 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a9385b-251c-4163-b95b-48ccf1608261 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:01.759419 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9385b-251c-4163-b95b-48ccf1608261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:01.760869 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a9385b-251c-4163-b95b-48ccf1608261 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:01.777726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-62a9385b-251c-4163-b95b-48ccf1608261 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:42:01.778946 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 8/17] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:42:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:42:01.784549 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9385b-251c-4163-b95b-48ccf1608261 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:01.833604 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbd191-cfec-442e-baf4-ec034c5d44f9 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:01.864632 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a134e7a-f7c4-435d-becc-08cfcc62dae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:01.865487 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a134e7a-f7c4-435d-becc-08cfcc62dae0 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:01.865766 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a134e7a-f7c4-435d-becc-08cfcc62dae0 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:01.866036 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a134e7a-f7c4-435d-becc-08cfcc62dae0 None admin] PATH_INFO: `/v3/users/abec147e21ba4a90ada48328d76ea483` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:01.867576 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a134e7a-f7c4-435d-becc-08cfcc62dae0 None admin] RBAC: Authorizing `identity:get_user(user_id=abec147e21ba4a90ada48328d76ea483)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:01.869021 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a134e7a-f7c4-435d-becc-08cfcc62dae0 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:01.870603 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 10/18] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:01 2022] GET /identity/v3/users/abec147e21ba4a90ada48328d76ea483 => generated 247 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:01.875787 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a134e7a-f7c4-435d-becc-08cfcc62dae0 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:01.876361 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a9385b-251c-4163-b95b-48ccf1608261 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:01.908696 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ec188-1d99-470e-b7f9-ba31bae0991a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:01.909345 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ec188-1d99-470e-b7f9-ba31bae0991a None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:01.909630 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ec188-1d99-470e-b7f9-ba31bae0991a None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:01.909911 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ec188-1d99-470e-b7f9-ba31bae0991a None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:01.910634 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ec188-1d99-470e-b7f9-ba31bae0991a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:01.910975 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ec188-1d99-470e-b7f9-ba31bae0991a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:01.912357 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ec188-1d99-470e-b7f9-ba31bae0991a None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:01.928707 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 9/19] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:42:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:01.971783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a134e7a-f7c4-435d-becc-08cfcc62dae0 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:02.007056 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1ef28-f16e-4fb1-9b84-56d06635890a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:02.007866 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1ef28-f16e-4fb1-9b84-56d06635890a None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:02.008142 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1ef28-f16e-4fb1-9b84-56d06635890a None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:02.008409 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1ef28-f16e-4fb1-9b84-56d06635890a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:02.009642 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1ef28-f16e-4fb1-9b84-56d06635890a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:02.011173 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1ef28-f16e-4fb1-9b84-56d06635890a None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:02.012809 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 11/20] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:42:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:02.018707 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ec188-1d99-470e-b7f9-ba31bae0991a None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:02.121617 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ec188-1d99-470e-b7f9-ba31bae0991a None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:02.153406 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbeae6-dc27-462c-9b0e-bc9b7ba8e130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:02.154059 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbeae6-dc27-462c-9b0e-bc9b7ba8e130 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:02.154344 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbeae6-dc27-462c-9b0e-bc9b7ba8e130 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:02.154616 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbeae6-dc27-462c-9b0e-bc9b7ba8e130 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:02.155468 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbeae6-dc27-462c-9b0e-bc9b7ba8e130 None admin] RBAC: Adding query filter params (role.id=c8affbefb4c5462a921650b24b13c80f, scope.domain.id=default, user.id=abec147e21ba4a90ada48328d76ea483) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:02.155776 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbeae6-dc27-462c-9b0e-bc9b7ba8e130 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:02.157211 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbeae6-dc27-462c-9b0e-bc9b7ba8e130 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:02.164331 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 10/21] 10.222.0.24 () {56 vars in 1322 bytes} [Mon Apr 11 23:42:02 2022] GET /identity/v3/role_assignments?user.id=abec147e21ba4a90ada48328d76ea483&scope.domain.id=default&role.id=c8affbefb4c5462a921650b24b13c80f => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:04.816612 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db9178-aa2d-4412-99db-280bee45b711 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:04.817131 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db9178-aa2d-4412-99db-280bee45b711 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:04.817739 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db9178-aa2d-4412-99db-280bee45b711 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:04.819518 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 12/22] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:04.830987 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e1195-7364-4e71-aaaa-e4bfd26cf3b3 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:04.831875 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e1195-7364-4e71-aaaa-e4bfd26cf3b3 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:04.832357 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e1195-7364-4e71-aaaa-e4bfd26cf3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:04.855834 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-9c8e1195-7364-4e71-aaaa-e4bfd26cf3b3 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:04.857382 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-9c8e1195-7364-4e71-aaaa-e4bfd26cf3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:04.927933 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b407f-4f72-4ba0-9606-cdeac0f013f6 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:04.928224 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b407f-4f72-4ba0-9606-cdeac0f013f6 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:04.928660 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091b407f-4f72-4ba0-9606-cdeac0f013f6 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:04.930795 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 13/23] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:04.936545 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 11/24] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:42:04.937099 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe44dc-bfd8-482e-8be8-cfb8a8f057ab None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:04.937590 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe44dc-bfd8-482e-8be8-cfb8a8f057ab None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:04.938014 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fe44dc-bfd8-482e-8be8-cfb8a8f057ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:04.971887 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-85fe44dc-bfd8-482e-8be8-cfb8a8f057ab None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:04.972183 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e1195-7364-4e71-aaaa-e4bfd26cf3b3 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:04.973329 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-85fe44dc-bfd8-482e-8be8-cfb8a8f057ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:05.073163 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 14/25] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:42:05.116450 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe44dc-bfd8-482e-8be8-cfb8a8f057ab None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:05.213262 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e1195-7364-4e71-aaaa-e4bfd26cf3b3 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:05.251226 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fe44dc-bfd8-482e-8be8-cfb8a8f057ab None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:05.292649 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9875fb-a6f2-43d5-b85c-9fb4fd160ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:05.293471 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9875fb-a6f2-43d5-b85c-9fb4fd160ea0 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:05.293757 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9875fb-a6f2-43d5-b85c-9fb4fd160ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:05.294020 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9875fb-a6f2-43d5-b85c-9fb4fd160ea0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:05.303865 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba68eb-f26a-4178-92d2-6126da919768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:05.304559 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba68eb-f26a-4178-92d2-6126da919768 None admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:05.304833 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba68eb-f26a-4178-92d2-6126da919768 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:05.305101 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba68eb-f26a-4178-92d2-6126da919768 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:05.305887 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba68eb-f26a-4178-92d2-6126da919768 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:05.315633 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba68eb-f26a-4178-92d2-6126da919768 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:05.338038 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9875fb-a6f2-43d5-b85c-9fb4fd160ea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:05.338307 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9875fb-a6f2-43d5-b85c-9fb4fd160ea0 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:05.365777 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-8f9875fb-a6f2-43d5-b85c-9fb4fd160ea0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:42:05.367471 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 15/26] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:42:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:42:05.373168 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9875fb-a6f2-43d5-b85c-9fb4fd160ea0 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:05.581723 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9875fb-a6f2-43d5-b85c-9fb4fd160ea0 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:05.585879 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 12/27] 10.222.0.24 () {60 vars in 1131 bytes} [Mon Apr 11 23:42:04 2022] POST /identity/v3/roles => generated 219 bytes in 614 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 23:42:05.650529 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b70457-692a-483a-bc74-fcaa3c22d231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:05.651242 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b70457-692a-483a-bc74-fcaa3c22d231 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:05.651522 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b70457-692a-483a-bc74-fcaa3c22d231 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:05.651804 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b70457-692a-483a-bc74-fcaa3c22d231 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:05.652537 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b70457-692a-483a-bc74-fcaa3c22d231 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:05.652845 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b70457-692a-483a-bc74-fcaa3c22d231 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:05.654236 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b70457-692a-483a-bc74-fcaa3c22d231 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:05.687127 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c1149-a60a-4320-9f41-d4f2c1f0c548 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:05.687668 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c1149-a60a-4320-9f41-d4f2c1f0c548 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:05.688082 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c1149-a60a-4320-9f41-d4f2c1f0c548 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:05.688444 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 16/28] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:05.691169 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 13/29] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:42:05.695652 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b70457-692a-483a-bc74-fcaa3c22d231 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:05.705123 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40e9d0-3d2d-4939-b8ba-029e82b74480 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:05.705696 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40e9d0-3d2d-4939-b8ba-029e82b74480 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:05.706182 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40e9d0-3d2d-4939-b8ba-029e82b74480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:05.740603 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-ab40e9d0-3d2d-4939-b8ba-029e82b74480 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:05.742546 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ab40e9d0-3d2d-4939-b8ba-029e82b74480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:05.866959 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 14/30] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:42:05.869092 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec20385-d357-4b24-a89e-738b92196216 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:05.869589 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec20385-d357-4b24-a89e-738b92196216 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:05.870064 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec20385-d357-4b24-a89e-738b92196216 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:05.872362 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 15/31] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:05.882255 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135edd25-bb17-4f43-85f9-5fe200bdbc37 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:05.882890 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135edd25-bb17-4f43-85f9-5fe200bdbc37 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:05.883386 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135edd25-bb17-4f43-85f9-5fe200bdbc37 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:05.885727 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 16/32] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:42:05.887056 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e09bea-1592-441e-b2c3-9585de20c053 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:05.887573 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e09bea-1592-441e-b2c3-9585de20c053 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:05.888049 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e09bea-1592-441e-b2c3-9585de20c053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:05.894806 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b70457-692a-483a-bc74-fcaa3c22d231 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:05.908827 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-39e09bea-1592-441e-b2c3-9585de20c053 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:05.909956 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-39e09bea-1592-441e-b2c3-9585de20c053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:05.948089 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc97f5c-7553-44d5-a4cf-003e50e5fb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:05.948775 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc97f5c-7553-44d5-a4cf-003e50e5fb1a None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:05.949055 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc97f5c-7553-44d5-a4cf-003e50e5fb1a None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:05.949326 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc97f5c-7553-44d5-a4cf-003e50e5fb1a None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:05.950061 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc97f5c-7553-44d5-a4cf-003e50e5fb1a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:05.951618 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc97f5c-7553-44d5-a4cf-003e50e5fb1a None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:05.987260 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 17/33] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:05.988459 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e09bea-1592-441e-b2c3-9585de20c053 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:06.088799 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e09bea-1592-441e-b2c3-9585de20c053 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:06.121042 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea06f2-213b-4f97-b92f-b754d62aa057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:06.121703 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea06f2-213b-4f97-b92f-b754d62aa057 None admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:06.121990 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea06f2-213b-4f97-b92f-b754d62aa057 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:06.122270 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea06f2-213b-4f97-b92f-b754d62aa057 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:06.123049 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea06f2-213b-4f97-b92f-b754d62aa057 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:06.124623 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eea06f2-213b-4f97-b92f-b754d62aa057 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:06.199423 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 18/34] 10.222.0.24 () {60 vars in 1131 bytes} [Mon Apr 11 23:42:05 2022] POST /identity/v3/roles => generated 223 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:42:06.200617 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0526e0-6a18-4a5f-9730-ca247a97bd82 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:06.200906 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0526e0-6a18-4a5f-9730-ca247a97bd82 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:06.201186 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0526e0-6a18-4a5f-9730-ca247a97bd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:06.220438 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-dc0526e0-6a18-4a5f-9730-ca247a97bd82 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:06.221685 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-dc0526e0-6a18-4a5f-9730-ca247a97bd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:06.238073 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 17/35] 10.222.0.24 () {60 vars in 1141 bytes} [Mon Apr 11 23:42:05 2022] POST /identity/v3/projects => generated 301 bytes in 543 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 23:42:06.246538 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d6098-0cdd-4c01-8948-5d5f55fdc861 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:06.246538 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d6098-0cdd-4c01-8948-5d5f55fdc861 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:06.246538 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16d6098-0cdd-4c01-8948-5d5f55fdc861 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:06.246538 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 18/36] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:06.246538 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d6098-0cdd-4c01-8948-5d5f55fdc861 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:06.335667 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 19/37] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:06.338493 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5467cfe-f03d-4a2b-baab-ac1d3249f827 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:06.338922 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5467cfe-f03d-4a2b-baab-ac1d3249f827 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:06.339652 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5467cfe-f03d-4a2b-baab-ac1d3249f827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:06.360424 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-a5467cfe-f03d-4a2b-baab-ac1d3249f827 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:06.361873 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-a5467cfe-f03d-4a2b-baab-ac1d3249f827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:06.368410 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16d6098-0cdd-4c01-8948-5d5f55fdc861 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:06.415020 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7376ee-f861-43ef-a239-1bef97fa7ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:06.415718 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7376ee-f861-43ef-a239-1bef97fa7ea0 None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:06.416000 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7376ee-f861-43ef-a239-1bef97fa7ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:06.416274 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7376ee-f861-43ef-a239-1bef97fa7ea0 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:06.417557 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7376ee-f861-43ef-a239-1bef97fa7ea0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:06.419837 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7376ee-f861-43ef-a239-1bef97fa7ea0 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:06.443953 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 20/38] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:06.444827 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5467cfe-f03d-4a2b-baab-ac1d3249f827 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:06.495063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 19/39] 10.222.0.24 () {60 vars in 1131 bytes} [Mon Apr 11 23:42:06 2022] POST /identity/v3/roles => generated 225 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:42:06.497749 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7376ee-f861-43ef-a239-1bef97fa7ea0 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:06.570510 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5467cfe-f03d-4a2b-baab-ac1d3249f827 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:06.607670 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9acfc5-34d9-49da-babd-b51dfd0c4eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:06.608510 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9acfc5-34d9-49da-babd-b51dfd0c4eb9 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:06.608787 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9acfc5-34d9-49da-babd-b51dfd0c4eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:06.609059 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9acfc5-34d9-49da-babd-b51dfd0c4eb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:06.621347 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9acfc5-34d9-49da-babd-b51dfd0c4eb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:06.626857 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7376ee-f861-43ef-a239-1bef97fa7ea0 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:06.628390 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-bc9acfc5-34d9-49da-babd-b51dfd0c4eb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:42:06.630810 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 21/40] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:42:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:06.636449 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9acfc5-34d9-49da-babd-b51dfd0c4eb9 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:06.668539 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e989d04-e3d8-47e0-8016-7b96c5794675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:06.669616 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e989d04-e3d8-47e0-8016-7b96c5794675 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:06.669900 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e989d04-e3d8-47e0-8016-7b96c5794675 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:06.670176 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e989d04-e3d8-47e0-8016-7b96c5794675 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:06.672483 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e989d04-e3d8-47e0-8016-7b96c5794675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:06.673990 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e989d04-e3d8-47e0-8016-7b96c5794675 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:06.680761 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 20/41] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:42:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:06.682480 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e989d04-e3d8-47e0-8016-7b96c5794675 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:06.742595 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9acfc5-34d9-49da-babd-b51dfd0c4eb9 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:06.776221 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33608482-64a7-48f1-a239-04025a6de433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:06.776887 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33608482-64a7-48f1-a239-04025a6de433 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:06.777169 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33608482-64a7-48f1-a239-04025a6de433 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:06.777444 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33608482-64a7-48f1-a239-04025a6de433 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:06.778190 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33608482-64a7-48f1-a239-04025a6de433 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:06.778495 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33608482-64a7-48f1-a239-04025a6de433 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:06.779897 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33608482-64a7-48f1-a239-04025a6de433 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:06.786790 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e989d04-e3d8-47e0-8016-7b96c5794675 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:06.791282 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 22/42] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:06.796765 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33608482-64a7-48f1-a239-04025a6de433 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:06.819469 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25bef9-f5a5-4e0c-8652-0ae7b1f5058b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:06.820127 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25bef9-f5a5-4e0c-8652-0ae7b1f5058b None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:06.820409 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25bef9-f5a5-4e0c-8652-0ae7b1f5058b None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:06.820687 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25bef9-f5a5-4e0c-8652-0ae7b1f5058b None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:06.821389 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f25bef9-f5a5-4e0c-8652-0ae7b1f5058b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:06.822852 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f25bef9-f5a5-4e0c-8652-0ae7b1f5058b None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:06.888920 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33608482-64a7-48f1-a239-04025a6de433 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:06.899273 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 21/43] 10.222.0.24 () {60 vars in 1141 bytes} [Mon Apr 11 23:42:06 2022] POST /identity/v3/projects => generated 312 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 23:42:06.921748 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3e5dc-f9d9-4477-b232-afb61142ac71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:06.922630 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3e5dc-f9d9-4477-b232-afb61142ac71 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:06.922937 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3e5dc-f9d9-4477-b232-afb61142ac71 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:06.923211 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3e5dc-f9d9-4477-b232-afb61142ac71 None admin] PATH_INFO: `/v3/users/abec147e21ba4a90ada48328d76ea483` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:06.924495 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3e5dc-f9d9-4477-b232-afb61142ac71 None admin] RBAC: Authorizing `identity:get_user(user_id=abec147e21ba4a90ada48328d76ea483)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:06.925994 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3e5dc-f9d9-4477-b232-afb61142ac71 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:06.928261 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 23/44] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:06 2022] GET /identity/v3/users/abec147e21ba4a90ada48328d76ea483 => generated 247 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:06.933877 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25bef9-f5a5-4e0c-8652-0ae7b1f5058b None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:07.034256 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25bef9-f5a5-4e0c-8652-0ae7b1f5058b None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:07.069862 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c88ba0-9726-411a-b55b-2dc708f92850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:07.070660 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c88ba0-9726-411a-b55b-2dc708f92850 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:07.070972 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c88ba0-9726-411a-b55b-2dc708f92850 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:07.071242 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c88ba0-9726-411a-b55b-2dc708f92850 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:07.072467 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c88ba0-9726-411a-b55b-2dc708f92850 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:07.073898 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c88ba0-9726-411a-b55b-2dc708f92850 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:07.075535 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 22/45] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:42:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:07.081068 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3e5dc-f9d9-4477-b232-afb61142ac71 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:07.178093 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3e5dc-f9d9-4477-b232-afb61142ac71 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:07.210281 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f0698b-659b-4213-9ff4-9f9d78a06f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:07.211178 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0698b-659b-4213-9ff4-9f9d78a06f00 None admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:07.211461 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0698b-659b-4213-9ff4-9f9d78a06f00 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:07.211744 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f0698b-659b-4213-9ff4-9f9d78a06f00 None admin] PATH_INFO: `/v3/domains/default/users/abec147e21ba4a90ada48328d76ea483/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:07.214007 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0698b-659b-4213-9ff4-9f9d78a06f00 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=abec147e21ba4a90ada48328d76ea483, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:07.215485 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f0698b-659b-4213-9ff4-9f9d78a06f00 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:07.309731 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 24/46] 10.222.0.24 () {58 vars in 1361 bytes} [Mon Apr 11 23:42:07 2022] PUT /identity/v3/domains/default/users/abec147e21ba4a90ada48328d76ea483/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:42:09.179212 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b726009-238b-4175-add1-511d43660a98 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:09.179785 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b726009-238b-4175-add1-511d43660a98 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:09.179785 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b726009-238b-4175-add1-511d43660a98 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:09.181672 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 23/47] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:09.187582 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67433f35-fcaf-4503-915f-25ee575b632c None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:09.188096 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67433f35-fcaf-4503-915f-25ee575b632c None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:09.188202 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67433f35-fcaf-4503-915f-25ee575b632c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:09.205630 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-67433f35-fcaf-4503-915f-25ee575b632c None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:09.206819 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-67433f35-fcaf-4503-915f-25ee575b632c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:09.269438 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 25/48] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:09.292504 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b726009-238b-4175-add1-511d43660a98 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:09.389443 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b726009-238b-4175-add1-511d43660a98 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:09.421482 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e38158-1661-4289-a2e9-5604ab6242ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:09.422268 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e38158-1661-4289-a2e9-5604ab6242ce None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:09.422549 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e38158-1661-4289-a2e9-5604ab6242ce None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:09.422822 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e38158-1661-4289-a2e9-5604ab6242ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:09.424013 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e38158-1661-4289-a2e9-5604ab6242ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:09.425454 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e38158-1661-4289-a2e9-5604ab6242ce None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:09.427810 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 24/49] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:42:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:09.433191 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67433f35-fcaf-4503-915f-25ee575b632c None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:09.524626 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67433f35-fcaf-4503-915f-25ee575b632c None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:09.533087 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89d4e6-3a65-4014-b1c3-34b211a7fcab None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:09.533381 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89d4e6-3a65-4014-b1c3-34b211a7fcab None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:09.533654 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89d4e6-3a65-4014-b1c3-34b211a7fcab None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:09.535452 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 25/50] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:42:09.540742 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cf6c6-4ba3-4c26-9a8f-fd932b0d8864 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:09.541029 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cf6c6-4ba3-4c26-9a8f-fd932b0d8864 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:09.541306 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cf6c6-4ba3-4c26-9a8f-fd932b0d8864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:09.557740 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea15a2d-ccbf-4474-95e8-0a3635bf8dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:09.558038 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-c42cf6c6-4ba3-4c26-9a8f-fd932b0d8864 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:09.558851 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea15a2d-ccbf-4474-95e8-0a3635bf8dee None admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:09.559323 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea15a2d-ccbf-4474-95e8-0a3635bf8dee None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:09.559576 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-c42cf6c6-4ba3-4c26-9a8f-fd932b0d8864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:09.559671 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea15a2d-ccbf-4474-95e8-0a3635bf8dee None admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:09.560313 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea15a2d-ccbf-4474-95e8-0a3635bf8dee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:09.561746 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea15a2d-ccbf-4474-95e8-0a3635bf8dee None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:09.623575 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 26/51] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:42:09.647126 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cf6c6-4ba3-4c26-9a8f-fd932b0d8864 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:09.688965 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 26/52] 10.222.0.24 () {60 vars in 1140 bytes} [Mon Apr 11 23:42:09 2022] POST /identity/v3/projects => generated 298 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:42:09.747689 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cf6c6-4ba3-4c26-9a8f-fd932b0d8864 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:09.783449 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0c096-3785-421a-9c55-a0bd777afc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:09.784265 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0c096-3785-421a-9c55-a0bd777afc2e None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:09.784549 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0c096-3785-421a-9c55-a0bd777afc2e None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:09.784826 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0c096-3785-421a-9c55-a0bd777afc2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:09.796182 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0c096-3785-421a-9c55-a0bd777afc2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:09.803346 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-80c0c096-3785-421a-9c55-a0bd777afc2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:42:09.804610 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 27/53] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:42:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:42:09.810675 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea15a2d-ccbf-4474-95e8-0a3635bf8dee None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:09.908821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea15a2d-ccbf-4474-95e8-0a3635bf8dee None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:09.940479 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d9751-d037-432b-8842-ca441f6ba1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:09.941075 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d9751-d037-432b-8842-ca441f6ba1c7 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:09.941358 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d9751-d037-432b-8842-ca441f6ba1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:09.941637 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d9751-d037-432b-8842-ca441f6ba1c7 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:09.942390 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d9751-d037-432b-8842-ca441f6ba1c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:09.942698 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d9751-d037-432b-8842-ca441f6ba1c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:09.944106 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852d9751-d037-432b-8842-ca441f6ba1c7 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:09.951763 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 27/54] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:09.957168 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0c096-3785-421a-9c55-a0bd777afc2e None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:10.053367 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0c096-3785-421a-9c55-a0bd777afc2e None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:10.086166 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11c104-f2c0-4d8b-9c31-2e80f9fe9e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:10.087081 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11c104-f2c0-4d8b-9c31-2e80f9fe9e95 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:10.087621 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11c104-f2c0-4d8b-9c31-2e80f9fe9e95 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:10.087895 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11c104-f2c0-4d8b-9c31-2e80f9fe9e95 None admin] PATH_INFO: `/v3/users/abec147e21ba4a90ada48328d76ea483` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:10.089079 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b11c104-f2c0-4d8b-9c31-2e80f9fe9e95 None admin] RBAC: Authorizing `identity:get_user(user_id=abec147e21ba4a90ada48328d76ea483)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:10.090671 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b11c104-f2c0-4d8b-9c31-2e80f9fe9e95 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:10.092474 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 28/55] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:09 2022] GET /identity/v3/users/abec147e21ba4a90ada48328d76ea483 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:10.097664 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d9751-d037-432b-8842-ca441f6ba1c7 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:10.192624 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d9751-d037-432b-8842-ca441f6ba1c7 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:10.224653 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2238b-cfbf-4748-b7c4-08ecc366f81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:10.225444 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2238b-cfbf-4748-b7c4-08ecc366f81d None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:10.225728 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2238b-cfbf-4748-b7c4-08ecc366f81d None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:10.226003 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2238b-cfbf-4748-b7c4-08ecc366f81d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:10.227246 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b2238b-cfbf-4748-b7c4-08ecc366f81d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:10.228698 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b2238b-cfbf-4748-b7c4-08ecc366f81d None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:10.230302 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 28/56] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:42:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:10.235976 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11c104-f2c0-4d8b-9c31-2e80f9fe9e95 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:10.329808 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11c104-f2c0-4d8b-9c31-2e80f9fe9e95 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:10.362777 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbb8c8-f7e7-45ee-8ae3-621258670da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:10.363492 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbb8c8-f7e7-45ee-8ae3-621258670da5 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:10.363740 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbb8c8-f7e7-45ee-8ae3-621258670da5 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:10.364026 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbb8c8-f7e7-45ee-8ae3-621258670da5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:10.364944 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbb8c8-f7e7-45ee-8ae3-621258670da5 None admin] RBAC: Adding query filter params (role.id=c8affbefb4c5462a921650b24b13c80f, scope.domain.id=default, user.id=abec147e21ba4a90ada48328d76ea483) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:10.365252 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbb8c8-f7e7-45ee-8ae3-621258670da5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:10.366694 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbb8c8-f7e7-45ee-8ae3-621258670da5 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:10.375384 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 29/57] 10.222.0.24 () {56 vars in 1322 bytes} [Mon Apr 11 23:42:10 2022] GET /identity/v3/role_assignments?user.id=abec147e21ba4a90ada48328d76ea483&scope.domain.id=default&role.id=c8affbefb4c5462a921650b24b13c80f => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:11.957042 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5a61b-84ba-461b-84ad-7aa903896824 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:11.957535 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5a61b-84ba-461b-84ad-7aa903896824 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:11.957606 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5a61b-84ba-461b-84ad-7aa903896824 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:11.959501 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 29/58] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:11.965135 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35369a-57ee-44e3-9175-9416dee1446a None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:11.965559 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35369a-57ee-44e3-9175-9416dee1446a None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:11.965700 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35369a-57ee-44e3-9175-9416dee1446a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:11.982150 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-9a35369a-57ee-44e3-9175-9416dee1446a None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:11.983372 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-9a35369a-57ee-44e3-9175-9416dee1446a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:12.045885 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 30/59] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:12.070683 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5a61b-84ba-461b-84ad-7aa903896824 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:12.167380 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5a61b-84ba-461b-84ad-7aa903896824 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:12.198567 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d510f3e-048d-4e2e-b63a-1509b7f77635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:12.199371 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d510f3e-048d-4e2e-b63a-1509b7f77635 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:12.199654 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d510f3e-048d-4e2e-b63a-1509b7f77635 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:12.199927 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d510f3e-048d-4e2e-b63a-1509b7f77635 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:12.201093 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d510f3e-048d-4e2e-b63a-1509b7f77635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:12.202537 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d510f3e-048d-4e2e-b63a-1509b7f77635 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:12.204147 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 30/60] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:42:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:12.210027 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35369a-57ee-44e3-9175-9416dee1446a None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:12.311951 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35369a-57ee-44e3-9175-9416dee1446a None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:12.344804 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acf0007-ed4f-4b51-9d79-f2bd7ff7c8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:12.345474 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf0007-ed4f-4b51-9d79-f2bd7ff7c8f6 None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:12.345751 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf0007-ed4f-4b51-9d79-f2bd7ff7c8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:12.346022 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acf0007-ed4f-4b51-9d79-f2bd7ff7c8f6 None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:12.346733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf0007-ed4f-4b51-9d79-f2bd7ff7c8f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:12.348197 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acf0007-ed4f-4b51-9d79-f2bd7ff7c8f6 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:12.474311 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 31/61] 10.222.0.24 () {60 vars in 1132 bytes} [Mon Apr 11 23:42:12 2022] POST /identity/v3/users => generated 275 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:42:15.974901 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30c34-3a7b-4e85-a0bf-459b62c44846 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:15.975401 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30c34-3a7b-4e85-a0bf-459b62c44846 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:15.975509 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30c34-3a7b-4e85-a0bf-459b62c44846 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:15.977558 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 31/62] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:15.982424 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a5c85-8cd7-4994-806e-e42cc5c17513 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:15.982910 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a5c85-8cd7-4994-806e-e42cc5c17513 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:15.983063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a5c85-8cd7-4994-806e-e42cc5c17513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:16.004205 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-8b3a5c85-8cd7-4994-806e-e42cc5c17513 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:16.006010 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-8b3a5c85-8cd7-4994-806e-e42cc5c17513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:16.026435 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc9540-be2f-4e7a-91fa-146c233bc05c None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:16.027120 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc9540-be2f-4e7a-91fa-146c233bc05c None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:16.027618 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbc9540-be2f-4e7a-91fa-146c233bc05c None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:16.029724 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 32/63] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:42:16.035385 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88df8d-0d14-491d-8af0-51007e6b18b4 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:16.035984 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88df8d-0d14-491d-8af0-51007e6b18b4 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:16.036499 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88df8d-0d14-491d-8af0-51007e6b18b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:16.064011 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-ee88df8d-0d14-491d-8af0-51007e6b18b4 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:16.066464 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ee88df8d-0d14-491d-8af0-51007e6b18b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:16.107144 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 32/64] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:16.130288 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a5c85-8cd7-4994-806e-e42cc5c17513 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:16.213363 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 33/65] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:42:16.233067 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a5c85-8cd7-4994-806e-e42cc5c17513 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:16.233253 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55894e50-3ee4-4070-a2b2-cec1c408bc05 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:16.233505 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55894e50-3ee4-4070-a2b2-cec1c408bc05 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:16.234016 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55894e50-3ee4-4070-a2b2-cec1c408bc05 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:16.236456 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 34/66] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:16.241589 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2fa9d-931c-4759-8e61-9d431f4cda7a None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:16.242121 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2fa9d-931c-4759-8e61-9d431f4cda7a None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:16.242609 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2fa9d-931c-4759-8e61-9d431f4cda7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:16.261219 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-7fd2fa9d-931c-4759-8e61-9d431f4cda7a None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:16.263687 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-7fd2fa9d-931c-4759-8e61-9d431f4cda7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:16.269956 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700542c-4e3c-4d27-8a38-e94b35fa19a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:16.271538 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700542c-4e3c-4d27-8a38-e94b35fa19a3 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:16.271981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700542c-4e3c-4d27-8a38-e94b35fa19a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:16.272390 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700542c-4e3c-4d27-8a38-e94b35fa19a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:16.282864 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700542c-4e3c-4d27-8a38-e94b35fa19a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:16.290526 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-8700542c-4e3c-4d27-8a38-e94b35fa19a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:42:16.292227 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 33/67] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:42:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:42:16.293151 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700542c-4e3c-4d27-8a38-e94b35fa19a3 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:16.350923 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 35/68] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:42:16.352004 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2fa9d-931c-4759-8e61-9d431f4cda7a None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:16.421952 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700542c-4e3c-4d27-8a38-e94b35fa19a3 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:16.457352 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e9561-7d09-44f1-8f3b-940fbd84f40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:16.458714 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e9561-7d09-44f1-8f3b-940fbd84f40d None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:16.459100 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e9561-7d09-44f1-8f3b-940fbd84f40d None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:16.459382 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616e9561-7d09-44f1-8f3b-940fbd84f40d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:16.469545 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616e9561-7d09-44f1-8f3b-940fbd84f40d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:16.472610 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd2fa9d-931c-4759-8e61-9d431f4cda7a None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:16.477077 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-616e9561-7d09-44f1-8f3b-940fbd84f40d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 23:42:16.478632 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 34/69] 10.222.0.24 () {56 vars in 1114 bytes} [Mon Apr 11 23:42:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:16.480193 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e9561-7d09-44f1-8f3b-940fbd84f40d None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:16.513930 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5cc274-d4af-43ea-8311-e26b02cb56e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:16.515114 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cc274-d4af-43ea-8311-e26b02cb56e9 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:16.515627 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cc274-d4af-43ea-8311-e26b02cb56e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:16.516115 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5cc274-d4af-43ea-8311-e26b02cb56e9 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:16.517553 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5cc274-d4af-43ea-8311-e26b02cb56e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:16.518106 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5cc274-d4af-43ea-8311-e26b02cb56e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:16.521320 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5cc274-d4af-43ea-8311-e26b02cb56e9 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:16.531646 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 36/70] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:16.532975 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbab90-838e-4f05-bbba-8598b2860c25 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:16.533199 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbab90-838e-4f05-bbba-8598b2860c25 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:16.533476 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbab90-838e-4f05-bbba-8598b2860c25 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:16.535412 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 37/71] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:16.536129 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbab90-838e-4f05-bbba-8598b2860c25 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:16.580185 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616e9561-7d09-44f1-8f3b-940fbd84f40d None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:16.611996 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56efc83-c211-4bef-988a-1f28e842c3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:16.612784 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56efc83-c211-4bef-988a-1f28e842c3ce None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:16.613065 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56efc83-c211-4bef-988a-1f28e842c3ce None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:16.613340 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56efc83-c211-4bef-988a-1f28e842c3ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:16.623077 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56efc83-c211-4bef-988a-1f28e842c3ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:16.629434 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbab90-838e-4f05-bbba-8598b2860c25 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:16.630475 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-e56efc83-c211-4bef-988a-1f28e842c3ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 23:42:16.631690 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 35/72] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:16.632874 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c561b1-7f09-4710-99f6-b600e618b0a5 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:16.633160 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c561b1-7f09-4710-99f6-b600e618b0a5 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:16.633435 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c561b1-7f09-4710-99f6-b600e618b0a5 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:16.635135 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 36/73] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:16.636148 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c561b1-7f09-4710-99f6-b600e618b0a5 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:16.666757 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b926e4c-bc6d-42ef-b57c-e9177c9d9e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:16.667469 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b926e4c-bc6d-42ef-b57c-e9177c9d9e81 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:16.667746 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b926e4c-bc6d-42ef-b57c-e9177c9d9e81 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:16.668015 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b926e4c-bc6d-42ef-b57c-e9177c9d9e81 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:16.668793 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b926e4c-bc6d-42ef-b57c-e9177c9d9e81 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:16.669092 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b926e4c-bc6d-42ef-b57c-e9177c9d9e81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:16.670446 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b926e4c-bc6d-42ef-b57c-e9177c9d9e81 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:16.677938 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 38/74] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:42:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:16.677938 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16feb8c4-b9cc-40e8-867c-57e5b00ff231 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:16.677938 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16feb8c4-b9cc-40e8-867c-57e5b00ff231 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:16.677938 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16feb8c4-b9cc-40e8-867c-57e5b00ff231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:16.696779 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-16feb8c4-b9cc-40e8-867c-57e5b00ff231 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:16.697941 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-16feb8c4-b9cc-40e8-867c-57e5b00ff231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:16.732068 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c561b1-7f09-4710-99f6-b600e618b0a5 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:16.760601 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 39/75] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:16.761440 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16feb8c4-b9cc-40e8-867c-57e5b00ff231 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:16.777994 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8687a-8860-4d25-b783-46c76bcfa028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:16.778911 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8687a-8860-4d25-b783-46c76bcfa028 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:16.779202 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8687a-8860-4d25-b783-46c76bcfa028 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:16.779479 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8687a-8860-4d25-b783-46c76bcfa028 None admin] PATH_INFO: `/v3/users/abec147e21ba4a90ada48328d76ea483` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:16.780696 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8687a-8860-4d25-b783-46c76bcfa028 None admin] RBAC: Authorizing `identity:get_user(user_id=abec147e21ba4a90ada48328d76ea483)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:16.782163 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8687a-8860-4d25-b783-46c76bcfa028 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:16.783945 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 37/76] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:16 2022] GET /identity/v3/users/abec147e21ba4a90ada48328d76ea483 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:16.785035 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f6d63-82cc-4f41-996a-4f3fff691eb1 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:16.785345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f6d63-82cc-4f41-996a-4f3fff691eb1 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:16.785607 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f6d63-82cc-4f41-996a-4f3fff691eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:16.801507 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-cb3f6d63-82cc-4f41-996a-4f3fff691eb1 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:16.803218 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-cb3f6d63-82cc-4f41-996a-4f3fff691eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:16.853229 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16feb8c4-b9cc-40e8-867c-57e5b00ff231 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:16.865123 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 38/77] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:16.865932 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f6d63-82cc-4f41-996a-4f3fff691eb1 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:16.886179 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bda189-91fc-4856-8be2-4d3d72fab757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:16.886885 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bda189-91fc-4856-8be2-4d3d72fab757 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:16.887169 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bda189-91fc-4856-8be2-4d3d72fab757 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:16.887445 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bda189-91fc-4856-8be2-4d3d72fab757 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:16.888238 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bda189-91fc-4856-8be2-4d3d72fab757 None admin] RBAC: Adding query filter params (name=member) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:16.888553 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bda189-91fc-4856-8be2-4d3d72fab757 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:16.890202 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bda189-91fc-4856-8be2-4d3d72fab757 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:16.898064 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 40/78] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:16.898867 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bda189-91fc-4856-8be2-4d3d72fab757 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:16.960241 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f6d63-82cc-4f41-996a-4f3fff691eb1 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:16.992268 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bda189-91fc-4856-8be2-4d3d72fab757 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:16.992751 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1fc87-5682-44df-bde1-832ce9069cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:16.993203 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1fc87-5682-44df-bde1-832ce9069cb9 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:16.993478 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1fc87-5682-44df-bde1-832ce9069cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:16.993747 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b1fc87-5682-44df-bde1-832ce9069cb9 None admin] PATH_INFO: `/v3/users/417f9e3fafbd4d549108c326f06391c6` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:17.007900 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1fc87-5682-44df-bde1-832ce9069cb9 None admin] RBAC: Authorizing `identity:get_user(user_id=417f9e3fafbd4d549108c326f06391c6)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:17.009334 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b1fc87-5682-44df-bde1-832ce9069cb9 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:17.010993 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 39/79] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:16 2022] GET /identity/v3/users/417f9e3fafbd4d549108c326f06391c6 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:17.011748 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1fc87-5682-44df-bde1-832ce9069cb9 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:17.024120 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d1338-08aa-4106-ba16-cbcfae69edcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:17.024904 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d1338-08aa-4106-ba16-cbcfae69edcb None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:17.025185 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d1338-08aa-4106-ba16-cbcfae69edcb None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:17.025462 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d1338-08aa-4106-ba16-cbcfae69edcb None admin] PATH_INFO: `/v3/roles/member` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:17.035278 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d1338-08aa-4106-ba16-cbcfae69edcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:17.042712 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-460d1338-08aa-4106-ba16-cbcfae69edcb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 23:42:17.043895 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 41/80] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:17.044658 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d1338-08aa-4106-ba16-cbcfae69edcb None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:17.108756 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b1fc87-5682-44df-bde1-832ce9069cb9 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:17.136082 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d1338-08aa-4106-ba16-cbcfae69edcb None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:17.139523 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfaa9d-7218-47f5-9c8a-57c0672aee45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:17.140160 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfaa9d-7218-47f5-9c8a-57c0672aee45 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:17.140561 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfaa9d-7218-47f5-9c8a-57c0672aee45 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:17.140842 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfaa9d-7218-47f5-9c8a-57c0672aee45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:17.167720 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cdab9-f1a0-48e7-a75e-36938b48a250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:17.168481 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cdab9-f1a0-48e7-a75e-36938b48a250 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:17.168764 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cdab9-f1a0-48e7-a75e-36938b48a250 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:17.169041 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87cdab9-f1a0-48e7-a75e-36938b48a250 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:17.170251 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cdab9-f1a0-48e7-a75e-36938b48a250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:17.171738 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87cdab9-f1a0-48e7-a75e-36938b48a250 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:17.177236 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 42/81] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:42:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:17.177236 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cdab9-f1a0-48e7-a75e-36938b48a250 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:17.204354 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfaa9d-7218-47f5-9c8a-57c0672aee45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:17.205807 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dfaa9d-7218-47f5-9c8a-57c0672aee45 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:17.267808 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87cdab9-f1a0-48e7-a75e-36938b48a250 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:17.298340 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 40/82] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:42:17.299193 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfaa9d-7218-47f5-9c8a-57c0672aee45 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:17.303481 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622a528-5555-4631-a340-c2d6161e8bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:17.304356 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622a528-5555-4631-a340-c2d6161e8bba None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:17.304637 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622a528-5555-4631-a340-c2d6161e8bba None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:17.304910 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622a528-5555-4631-a340-c2d6161e8bba None admin] PATH_INFO: `/v3/users/417f9e3fafbd4d549108c326f06391c6` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:17.306121 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622a528-5555-4631-a340-c2d6161e8bba None admin] RBAC: Authorizing `identity:get_user(user_id=417f9e3fafbd4d549108c326f06391c6)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:17.307624 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622a528-5555-4631-a340-c2d6161e8bba None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:17.309226 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 43/83] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:17 2022] GET /identity/v3/users/417f9e3fafbd4d549108c326f06391c6 => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:17.309978 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622a528-5555-4631-a340-c2d6161e8bba None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:17.392545 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dfaa9d-7218-47f5-9c8a-57c0672aee45 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:17.403374 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622a528-5555-4631-a340-c2d6161e8bba None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:17.424251 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd2110-7b49-47d2-ad1f-564378d101dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:17.424904 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd2110-7b49-47d2-ad1f-564378d101dc None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:17.425188 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd2110-7b49-47d2-ad1f-564378d101dc None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:17.425468 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd2110-7b49-47d2-ad1f-564378d101dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:17.434331 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5b30a-7a26-4648-9bbc-b86564f0dcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:17.435027 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5b30a-7a26-4648-9bbc-b86564f0dcbc None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:17.435311 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5b30a-7a26-4648-9bbc-b86564f0dcbc None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:17.435585 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5b30a-7a26-4648-9bbc-b86564f0dcbc None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:17.436323 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5b30a-7a26-4648-9bbc-b86564f0dcbc None admin] RBAC: Adding query filter params (name=member) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:17.436632 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5b30a-7a26-4648-9bbc-b86564f0dcbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:17.437977 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de5b30a-7a26-4648-9bbc-b86564f0dcbc None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:17.446114 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 44/84] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:17.446902 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5b30a-7a26-4648-9bbc-b86564f0dcbc None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:17.488859 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd2110-7b49-47d2-ad1f-564378d101dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:17.490324 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd2110-7b49-47d2-ad1f-564378d101dc None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:17.539891 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5b30a-7a26-4648-9bbc-b86564f0dcbc None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:17.573279 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9a39d-275e-49ef-9ee6-3307484a95e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:17.573997 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9a39d-275e-49ef-9ee6-3307484a95e0 None admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:17.574282 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9a39d-275e-49ef-9ee6-3307484a95e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:17.574554 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9a39d-275e-49ef-9ee6-3307484a95e0 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:17.575292 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9a39d-275e-49ef-9ee6-3307484a95e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:17.576727 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9a39d-275e-49ef-9ee6-3307484a95e0 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:17.583022 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 41/85] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:42:17.583863 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd2110-7b49-47d2-ad1f-564378d101dc None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:17.674800 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd2110-7b49-47d2-ad1f-564378d101dc None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:17.706974 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ccdb7-59d9-40f5-b697-52dc4ba9bff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:17.707823 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ccdb7-59d9-40f5-b697-52dc4ba9bff7 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:17.708130 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ccdb7-59d9-40f5-b697-52dc4ba9bff7 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:17.708411 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ccdb7-59d9-40f5-b697-52dc4ba9bff7 None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:17.709599 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ccdb7-59d9-40f5-b697-52dc4ba9bff7 None admin] RBAC: Authorizing `identity:get_project(project_id=5563d83687534242a56eaa5054d6ed92)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:17.711050 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ccdb7-59d9-40f5-b697-52dc4ba9bff7 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:17.713844 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 42/86] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:17 2022] GET /identity/v3/projects/5563d83687534242a56eaa5054d6ed92 => generated 298 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:17.713844 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ccdb7-59d9-40f5-b697-52dc4ba9bff7 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:17.719168 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 45/87] 10.222.0.24 () {60 vars in 1132 bytes} [Mon Apr 11 23:42:17 2022] POST /identity/v3/users => generated 289 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:42:17.720195 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9a39d-275e-49ef-9ee6-3307484a95e0 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:17.820976 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ccdb7-59d9-40f5-b697-52dc4ba9bff7 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:17.830706 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9a39d-275e-49ef-9ee6-3307484a95e0 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:17.856837 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc0371-08bc-4bf7-b7a2-8c0b63dcc8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:17.857799 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc0371-08bc-4bf7-b7a2-8c0b63dcc8d8 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:17.857799 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc0371-08bc-4bf7-b7a2-8c0b63dcc8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:17.858076 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc0371-08bc-4bf7-b7a2-8c0b63dcc8d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:17.865851 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585c59b-879a-4631-b7e9-3963b5fd297d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:17.866745 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585c59b-879a-4631-b7e9-3963b5fd297d None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:17.867492 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585c59b-879a-4631-b7e9-3963b5fd297d None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:17.867492 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585c59b-879a-4631-b7e9-3963b5fd297d None admin] PATH_INFO: `/v3/users/417f9e3fafbd4d549108c326f06391c6` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:17.868654 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585c59b-879a-4631-b7e9-3963b5fd297d None admin] RBAC: Authorizing `identity:get_user(user_id=417f9e3fafbd4d549108c326f06391c6)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:17.870147 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d585c59b-879a-4631-b7e9-3963b5fd297d None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:17.871936 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 46/88] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:17 2022] GET /identity/v3/users/417f9e3fafbd4d549108c326f06391c6 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:17.872666 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585c59b-879a-4631-b7e9-3963b5fd297d None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:17.933386 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc0371-08bc-4bf7-b7a2-8c0b63dcc8d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:17.934884 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc0371-08bc-4bf7-b7a2-8c0b63dcc8d8 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:17.974348 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585c59b-879a-4631-b7e9-3963b5fd297d None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:18.010578 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d51eeb-97bb-40dc-8375-6f4f7b726f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:18.011473 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d51eeb-97bb-40dc-8375-6f4f7b726f7a None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:18.011759 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d51eeb-97bb-40dc-8375-6f4f7b726f7a None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:18.012039 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d51eeb-97bb-40dc-8375-6f4f7b726f7a None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:18.013251 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d51eeb-97bb-40dc-8375-6f4f7b726f7a None admin] RBAC: Authorizing `identity:get_project(project_id=5563d83687534242a56eaa5054d6ed92)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:18.014718 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d51eeb-97bb-40dc-8375-6f4f7b726f7a None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:18.016765 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 47/89] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:17 2022] GET /identity/v3/projects/5563d83687534242a56eaa5054d6ed92 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:18.017553 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d51eeb-97bb-40dc-8375-6f4f7b726f7a None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:18.075979 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 43/90] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:42:18.076850 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc0371-08bc-4bf7-b7a2-8c0b63dcc8d8 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:18.141939 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d51eeb-97bb-40dc-8375-6f4f7b726f7a None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:18.175890 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc0371-08bc-4bf7-b7a2-8c0b63dcc8d8 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:18.177777 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b2112-fc46-4919-bc7a-21d1863331ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:18.178672 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b2112-fc46-4919-bc7a-21d1863331ee None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:18.179156 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b2112-fc46-4919-bc7a-21d1863331ee None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:18.179562 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0b2112-fc46-4919-bc7a-21d1863331ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:18.180546 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b2112-fc46-4919-bc7a-21d1863331ee None admin] RBAC: Adding query filter params (role.id=c8affbefb4c5462a921650b24b13c80f, scope.project.id=5563d83687534242a56eaa5054d6ed92, user.id=abec147e21ba4a90ada48328d76ea483) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:18.180992 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b2112-fc46-4919-bc7a-21d1863331ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:18.182580 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0b2112-fc46-4919-bc7a-21d1863331ee None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:18.188977 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 48/91] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:42:18 2022] GET /identity/v3/role_assignments?user.id=abec147e21ba4a90ada48328d76ea483&scope.project.id=5563d83687534242a56eaa5054d6ed92&role.id=c8affbefb4c5462a921650b24b13c80f => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:18.190072 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b2112-fc46-4919-bc7a-21d1863331ee None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:18.212845 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aff320-61ed-4c73-8a7d-2f77764ca5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:18.213737 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aff320-61ed-4c73-8a7d-2f77764ca5ad None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:18.213866 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aff320-61ed-4c73-8a7d-2f77764ca5ad None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:18.214046 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aff320-61ed-4c73-8a7d-2f77764ca5ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:18.285271 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aff320-61ed-4c73-8a7d-2f77764ca5ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:18.287352 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aff320-61ed-4c73-8a7d-2f77764ca5ad None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:18.297417 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0b2112-fc46-4919-bc7a-21d1863331ee None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:18.333851 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02689cf-319e-494e-bcb9-072ca4447cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:18.334962 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02689cf-319e-494e-bcb9-072ca4447cc9 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:18.335462 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02689cf-319e-494e-bcb9-072ca4447cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:18.335946 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02689cf-319e-494e-bcb9-072ca4447cc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:18.337005 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02689cf-319e-494e-bcb9-072ca4447cc9 None admin] RBAC: Adding query filter params (role.id=f7b5f822a48e4e269ab53ce00a04194e, scope.project.id=5563d83687534242a56eaa5054d6ed92, user.id=417f9e3fafbd4d549108c326f06391c6) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:18.337804 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02689cf-319e-494e-bcb9-072ca4447cc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:18.339517 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02689cf-319e-494e-bcb9-072ca4447cc9 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:18.350990 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 49/92] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:42:18 2022] GET /identity/v3/role_assignments?user.id=417f9e3fafbd4d549108c326f06391c6&scope.project.id=5563d83687534242a56eaa5054d6ed92&role.id=f7b5f822a48e4e269ab53ce00a04194e => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:18.352343 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02689cf-319e-494e-bcb9-072ca4447cc9 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:18.392283 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 44/93] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:42:18.398251 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aff320-61ed-4c73-8a7d-2f77764ca5ad None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:18.505749 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aff320-61ed-4c73-8a7d-2f77764ca5ad None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:18.543347 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd985b73-45dd-48de-b837-f614569b3c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:18.544252 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd985b73-45dd-48de-b837-f614569b3c09 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:18.544532 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd985b73-45dd-48de-b837-f614569b3c09 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:18.544806 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd985b73-45dd-48de-b837-f614569b3c09 None admin] PATH_INFO: `/v3/projects/3288719b5d804b02bc71c8f45b9917c4` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:18.546133 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd985b73-45dd-48de-b837-f614569b3c09 None admin] RBAC: Authorizing `identity:get_project(project_id=3288719b5d804b02bc71c8f45b9917c4)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:18.547648 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd985b73-45dd-48de-b837-f614569b3c09 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:18.549443 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 45/94] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:18 2022] GET /identity/v3/projects/3288719b5d804b02bc71c8f45b9917c4 => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:18.555416 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd985b73-45dd-48de-b837-f614569b3c09 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:18.564953 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02689cf-319e-494e-bcb9-072ca4447cc9 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:18.643634 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b21a3-575e-4de3-a243-3dbece30c473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:18.644849 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b21a3-575e-4de3-a243-3dbece30c473 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:18.645324 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b21a3-575e-4de3-a243-3dbece30c473 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:18.646450 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062b21a3-575e-4de3-a243-3dbece30c473 None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:18.647967 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b21a3-575e-4de3-a243-3dbece30c473 None admin] RBAC: Authorizing `identity:get_project(project_id=5563d83687534242a56eaa5054d6ed92)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:18.649601 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062b21a3-575e-4de3-a243-3dbece30c473 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:18.651539 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 50/95] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:18 2022] GET /identity/v3/projects/5563d83687534242a56eaa5054d6ed92 => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:18.660103 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b21a3-575e-4de3-a243-3dbece30c473 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:18.668181 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd985b73-45dd-48de-b837-f614569b3c09 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:18.714064 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfae774-c1f8-4dde-970d-6d5c7940c297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:18.714744 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfae774-c1f8-4dde-970d-6d5c7940c297 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:18.715048 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfae774-c1f8-4dde-970d-6d5c7940c297 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:18.715329 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfae774-c1f8-4dde-970d-6d5c7940c297 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:18.716176 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfae774-c1f8-4dde-970d-6d5c7940c297 None admin] RBAC: Adding query filter params (role.id=d0f74491c28e4d1094a60391d71c2246, scope.project.id=3288719b5d804b02bc71c8f45b9917c4, user.id=417f9e3fafbd4d549108c326f06391c6) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:18.716491 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfae774-c1f8-4dde-970d-6d5c7940c297 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:18.717941 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfae774-c1f8-4dde-970d-6d5c7940c297 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:18.723946 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 46/96] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:42:18 2022] GET /identity/v3/role_assignments?user.id=417f9e3fafbd4d549108c326f06391c6&scope.project.id=3288719b5d804b02bc71c8f45b9917c4&role.id=d0f74491c28e4d1094a60391d71c2246 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:18.831504 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062b21a3-575e-4de3-a243-3dbece30c473 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:18.871759 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a071a1-d9ea-4fc2-a80a-84d15bd6e90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:18.872511 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a071a1-d9ea-4fc2-a80a-84d15bd6e90a None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:18.872797 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a071a1-d9ea-4fc2-a80a-84d15bd6e90a None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:18.873070 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a071a1-d9ea-4fc2-a80a-84d15bd6e90a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:18.873941 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a071a1-d9ea-4fc2-a80a-84d15bd6e90a None admin] RBAC: Adding query filter params (role.id=d0f74491c28e4d1094a60391d71c2246, scope.project.id=5563d83687534242a56eaa5054d6ed92, user.id=417f9e3fafbd4d549108c326f06391c6) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:18.874255 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a071a1-d9ea-4fc2-a80a-84d15bd6e90a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:18.875788 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a071a1-d9ea-4fc2-a80a-84d15bd6e90a None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:18.886693 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 51/97] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:42:18 2022] GET /identity/v3/role_assignments?user.id=417f9e3fafbd4d549108c326f06391c6&scope.project.id=5563d83687534242a56eaa5054d6ed92&role.id=d0f74491c28e4d1094a60391d71c2246 => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:20.845472 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9573b-6ca4-4edc-93ca-d7303966576c None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:20.846195 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9573b-6ca4-4edc-93ca-d7303966576c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:20.846195 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a9573b-6ca4-4edc-93ca-d7303966576c None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:20.847859 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 47/98] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:20.853682 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daed22a-28b2-49a5-a2c1-f263af3b5a89 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:20.854086 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daed22a-28b2-49a5-a2c1-f263af3b5a89 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:20.854334 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daed22a-28b2-49a5-a2c1-f263af3b5a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:20.879942 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-6daed22a-28b2-49a5-a2c1-f263af3b5a89 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:20.881169 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-6daed22a-28b2-49a5-a2c1-f263af3b5a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:20.917205 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb97a9-ca17-4f29-8911-fcb1a0a2f43c None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:20.917581 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb97a9-ca17-4f29-8911-fcb1a0a2f43c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:20.917939 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb97a9-ca17-4f29-8911-fcb1a0a2f43c None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:20.919848 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 48/99] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:20.926331 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bab750-2339-44f1-9073-9a908e2b9288 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:20.926612 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bab750-2339-44f1-9073-9a908e2b9288 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:20.926952 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bab750-2339-44f1-9073-9a908e2b9288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:20.958898 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-37bab750-2339-44f1-9073-9a908e2b9288 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:20.960115 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-37bab750-2339-44f1-9073-9a908e2b9288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:20.982629 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 52/100] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:21.006195 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daed22a-28b2-49a5-a2c1-f263af3b5a89 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:21.180612 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 49/101] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:42:21.219260 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daed22a-28b2-49a5-a2c1-f263af3b5a89 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:21.220635 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bab750-2339-44f1-9073-9a908e2b9288 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:21.288718 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bcdea-15cd-47ff-83d5-5e8e5928a8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:21.289526 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bcdea-15cd-47ff-83d5-5e8e5928a8cc None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:21.289812 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bcdea-15cd-47ff-83d5-5e8e5928a8cc None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:21.290087 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134bcdea-15cd-47ff-83d5-5e8e5928a8cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:21.291352 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134bcdea-15cd-47ff-83d5-5e8e5928a8cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:21.293010 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134bcdea-15cd-47ff-83d5-5e8e5928a8cc None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:21.294655 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 53/102] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:42:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:21.300171 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bcdea-15cd-47ff-83d5-5e8e5928a8cc None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:21.417638 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bab750-2339-44f1-9073-9a908e2b9288 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:21.461001 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134bcdea-15cd-47ff-83d5-5e8e5928a8cc None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:21.488722 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64088eb2-1072-4a89-991d-20b19a37f3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:21.489572 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64088eb2-1072-4a89-991d-20b19a37f3cc None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:21.489857 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64088eb2-1072-4a89-991d-20b19a37f3cc None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:21.490137 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64088eb2-1072-4a89-991d-20b19a37f3cc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:21.512161 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64088eb2-1072-4a89-991d-20b19a37f3cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:21.512552 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962e0da-4b72-4174-8418-6a6006dc7871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:21.513250 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962e0da-4b72-4174-8418-6a6006dc7871 None admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:21.513539 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962e0da-4b72-4174-8418-6a6006dc7871 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:21.513813 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962e0da-4b72-4174-8418-6a6006dc7871 None admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:21.514542 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962e0da-4b72-4174-8418-6a6006dc7871 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:21.516039 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962e0da-4b72-4174-8418-6a6006dc7871 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:21.534118 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-64088eb2-1072-4a89-991d-20b19a37f3cc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 23:42:21.536578 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 50/103] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:21.543302 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64088eb2-1072-4a89-991d-20b19a37f3cc None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:21.636629 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 54/104] 10.222.0.24 () {60 vars in 1141 bytes} [Mon Apr 11 23:42:21 2022] POST /identity/v3/projects => generated 302 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 23:42:21.707593 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64088eb2-1072-4a89-991d-20b19a37f3cc None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:21.776199 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed66f6-fbf7-4c17-8103-57d636c835f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:21.777250 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed66f6-fbf7-4c17-8103-57d636c835f7 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:21.777744 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed66f6-fbf7-4c17-8103-57d636c835f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:21.778232 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed66f6-fbf7-4c17-8103-57d636c835f7 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:21.779243 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed66f6-fbf7-4c17-8103-57d636c835f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:21.779768 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed66f6-fbf7-4c17-8103-57d636c835f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:21.781392 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ed66f6-fbf7-4c17-8103-57d636c835f7 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:21.794416 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 51/105] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:21.800561 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962e0da-4b72-4174-8418-6a6006dc7871 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:21.835687 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c04b7-49cc-4f39-b2dc-9f781c8c0f8d None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:21.836336 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c04b7-49cc-4f39-b2dc-9f781c8c0f8d None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:21.836835 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c04b7-49cc-4f39-b2dc-9f781c8c0f8d None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:21.839154 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 52/106] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:21.845205 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942f2ed-e774-4d3c-85c8-02739c019995 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:21.845825 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942f2ed-e774-4d3c-85c8-02739c019995 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:21.846755 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942f2ed-e774-4d3c-85c8-02739c019995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:21.880153 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-e942f2ed-e774-4d3c-85c8-02739c019995 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:21.881805 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-e942f2ed-e774-4d3c-85c8-02739c019995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:21.969989 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962e0da-4b72-4174-8418-6a6006dc7871 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:21.975882 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 53/107] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:22.009255 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e546cbe-1f10-42e3-828a-914bfa67bbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:22.010565 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e546cbe-1f10-42e3-828a-914bfa67bbb9 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:22.011112 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e546cbe-1f10-42e3-828a-914bfa67bbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:22.012799 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942f2ed-e774-4d3c-85c8-02739c019995 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:22.023604 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e546cbe-1f10-42e3-828a-914bfa67bbb9 None admin] PATH_INFO: `/v3/users/8cab219006a74de0a7569808bd60bee0` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:22.053245 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e546cbe-1f10-42e3-828a-914bfa67bbb9 None admin] RBAC: Authorizing `identity:get_user(user_id=8cab219006a74de0a7569808bd60bee0)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:22.055115 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e546cbe-1f10-42e3-828a-914bfa67bbb9 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:22.058205 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 55/108] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:21 2022] GET /identity/v3/users/8cab219006a74de0a7569808bd60bee0 => generated 289 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:22.064062 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e546cbe-1f10-42e3-828a-914bfa67bbb9 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:22.163895 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942f2ed-e774-4d3c-85c8-02739c019995 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:22.185353 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e546cbe-1f10-42e3-828a-914bfa67bbb9 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:22.207770 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf74f9-60d9-44fd-8a5f-c65c8475c3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:22.209829 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf74f9-60d9-44fd-8a5f-c65c8475c3ec None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:22.210560 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf74f9-60d9-44fd-8a5f-c65c8475c3ec None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:22.211042 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf74f9-60d9-44fd-8a5f-c65c8475c3ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:22.220020 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19097eea-0c19-4b50-b2aa-a1f4a08b146b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:22.220972 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19097eea-0c19-4b50-b2aa-a1f4a08b146b None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:22.221088 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19097eea-0c19-4b50-b2aa-a1f4a08b146b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:22.221386 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19097eea-0c19-4b50-b2aa-a1f4a08b146b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:22.224944 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf74f9-60d9-44fd-8a5f-c65c8475c3ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:22.233854 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-77cf74f9-60d9-44fd-8a5f-c65c8475c3ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:42:22.236300 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 54/109] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:42:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:22.238308 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfc0e9-337f-4eaa-9b37-08d8dc694869 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:22.238784 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfc0e9-337f-4eaa-9b37-08d8dc694869 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:22.239527 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdfc0e9-337f-4eaa-9b37-08d8dc694869 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:22.243572 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 55/110] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:22.244974 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfc0e9-337f-4eaa-9b37-08d8dc694869 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:22.301911 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19097eea-0c19-4b50-b2aa-a1f4a08b146b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:22.304450 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19097eea-0c19-4b50-b2aa-a1f4a08b146b None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:22.362130 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdfc0e9-337f-4eaa-9b37-08d8dc694869 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:22.406653 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea1624b-cd80-4d3f-a310-370e0aeab13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:22.407984 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1624b-cd80-4d3f-a310-370e0aeab13d None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:22.408482 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1624b-cd80-4d3f-a310-370e0aeab13d None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:22.408957 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea1624b-cd80-4d3f-a310-370e0aeab13d None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:22.410324 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1624b-cd80-4d3f-a310-370e0aeab13d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:22.410861 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1624b-cd80-4d3f-a310-370e0aeab13d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:22.413379 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea1624b-cd80-4d3f-a310-370e0aeab13d None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:22.422904 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 56/111] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:42:22.424269 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb6b6f-d7c1-4686-9f8e-16f4581d6983 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:22.424565 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb6b6f-d7c1-4686-9f8e-16f4581d6983 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:22.424843 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb6b6f-d7c1-4686-9f8e-16f4581d6983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:22.425412 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 56/112] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:22.427083 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9233c-0085-41f1-ab45-a39f01113065 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:22.427576 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9233c-0085-41f1-ab45-a39f01113065 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:22.428057 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de9233c-0085-41f1-ab45-a39f01113065 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:22.430180 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 57/113] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:22.439584 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9233c-0085-41f1-ab45-a39f01113065 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:22.447197 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-4cbb6b6f-d7c1-4686-9f8e-16f4581d6983 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:22.448562 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-4cbb6b6f-d7c1-4686-9f8e-16f4581d6983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:22.516269 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 57/114] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:22.519005 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb6b6f-d7c1-4686-9f8e-16f4581d6983 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:22.571060 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de9233c-0085-41f1-ab45-a39f01113065 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:22.623519 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3888e5-46b2-48c6-9bda-2d401dfbed7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:22.624502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3888e5-46b2-48c6-9bda-2d401dfbed7f None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:22.624850 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3888e5-46b2-48c6-9bda-2d401dfbed7f None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:22.625210 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3888e5-46b2-48c6-9bda-2d401dfbed7f None admin] PATH_INFO: `/v3/users/abec147e21ba4a90ada48328d76ea483` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:22.626211 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb6b6f-d7c1-4686-9f8e-16f4581d6983 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:22.626574 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3888e5-46b2-48c6-9bda-2d401dfbed7f None admin] RBAC: Authorizing `identity:get_user(user_id=abec147e21ba4a90ada48328d76ea483)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:22.628279 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3888e5-46b2-48c6-9bda-2d401dfbed7f None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:22.631546 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 58/115] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:22 2022] GET /identity/v3/users/abec147e21ba4a90ada48328d76ea483 => generated 247 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:22.632757 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183cf94-7847-4314-8e93-08ad2d392c21 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:22.633109 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183cf94-7847-4314-8e93-08ad2d392c21 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:22.633450 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183cf94-7847-4314-8e93-08ad2d392c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:22.656444 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-8183cf94-7847-4314-8e93-08ad2d392c21 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:22.657938 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-8183cf94-7847-4314-8e93-08ad2d392c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:22.664383 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f8c2a-8e59-4e7b-abf7-af1ed4f66ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:22.665571 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f8c2a-8e59-4e7b-abf7-af1ed4f66ea8 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:22.666046 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f8c2a-8e59-4e7b-abf7-af1ed4f66ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:22.666569 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8f8c2a-8e59-4e7b-abf7-af1ed4f66ea8 None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:22.668084 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f8c2a-8e59-4e7b-abf7-af1ed4f66ea8 None admin] RBAC: Authorizing `identity:get_project(project_id=5563d83687534242a56eaa5054d6ed92)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:22.669901 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8f8c2a-8e59-4e7b-abf7-af1ed4f66ea8 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:22.671989 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 58/116] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:22 2022] GET /identity/v3/projects/5563d83687534242a56eaa5054d6ed92 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:22.673038 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f8c2a-8e59-4e7b-abf7-af1ed4f66ea8 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:22.732194 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 59/117] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:22.735773 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183cf94-7847-4314-8e93-08ad2d392c21 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:22.788403 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8f8c2a-8e59-4e7b-abf7-af1ed4f66ea8 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:22.829194 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c87293-dd6e-44d8-9a57-041706280894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:22.829969 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c87293-dd6e-44d8-9a57-041706280894 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:22.830256 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c87293-dd6e-44d8-9a57-041706280894 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:22.830536 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c87293-dd6e-44d8-9a57-041706280894 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:22.839457 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183cf94-7847-4314-8e93-08ad2d392c21 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:22.841204 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c87293-dd6e-44d8-9a57-041706280894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:22.851281 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-c8c87293-dd6e-44d8-9a57-041706280894 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 23:42:22.852653 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 59/118] 10.222.0.24 () {56 vars in 1114 bytes} [Mon Apr 11 23:42:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:22.855726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c87293-dd6e-44d8-9a57-041706280894 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:22.872733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f27fce-8888-4b7b-b4b1-da7690aed035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:22.873599 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f27fce-8888-4b7b-b4b1-da7690aed035 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:22.873876 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f27fce-8888-4b7b-b4b1-da7690aed035 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:22.874147 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f27fce-8888-4b7b-b4b1-da7690aed035 None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:22.875356 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f27fce-8888-4b7b-b4b1-da7690aed035 None admin] RBAC: Authorizing `identity:get_project(project_id=5563d83687534242a56eaa5054d6ed92)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:22.876797 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f27fce-8888-4b7b-b4b1-da7690aed035 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:22.878626 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 60/119] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:22 2022] GET /identity/v3/projects/5563d83687534242a56eaa5054d6ed92 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:22.879796 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e73674-b022-42e3-ba54-173cfc7f00de None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:22.880657 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e73674-b022-42e3-ba54-173cfc7f00de None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:22.880930 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e73674-b022-42e3-ba54-173cfc7f00de None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:22.886896 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 61/120] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:22.886896 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e73674-b022-42e3-ba54-173cfc7f00de None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:22.958296 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c87293-dd6e-44d8-9a57-041706280894 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:22.986870 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e73674-b022-42e3-ba54-173cfc7f00de None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:22.990890 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0fb65-ed53-4ffa-a0cb-e872fffe855e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:22.991552 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0fb65-ed53-4ffa-a0cb-e872fffe855e None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:22.991835 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0fb65-ed53-4ffa-a0cb-e872fffe855e None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:22.992107 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d0fb65-ed53-4ffa-a0cb-e872fffe855e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:22.992939 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0fb65-ed53-4ffa-a0cb-e872fffe855e None admin] RBAC: Adding query filter params (role.id=d970ab64b060491c919ed8a7cf36313c, scope.project.id=5563d83687534242a56eaa5054d6ed92, user.id=8cab219006a74de0a7569808bd60bee0) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:22.993247 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0fb65-ed53-4ffa-a0cb-e872fffe855e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:22.994690 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d0fb65-ed53-4ffa-a0cb-e872fffe855e None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:23.000353 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 60/121] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:42:22 2022] GET /identity/v3/role_assignments?user.id=8cab219006a74de0a7569808bd60bee0&scope.project.id=5563d83687534242a56eaa5054d6ed92&role.id=d970ab64b060491c919ed8a7cf36313c => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:23.001075 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0fb65-ed53-4ffa-a0cb-e872fffe855e None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:23.044630 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b1a0c-5d88-4378-a5ff-eafe1aa5524d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:23.045864 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b1a0c-5d88-4378-a5ff-eafe1aa5524d None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:23.046343 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b1a0c-5d88-4378-a5ff-eafe1aa5524d None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:23.046793 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b1a0c-5d88-4378-a5ff-eafe1aa5524d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:23.062634 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b1a0c-5d88-4378-a5ff-eafe1aa5524d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:23.072933 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-f80b1a0c-5d88-4378-a5ff-eafe1aa5524d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 23:42:23.075192 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 62/122] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:23.076469 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b1a0c-5d88-4378-a5ff-eafe1aa5524d None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:23.124319 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d0fb65-ed53-4ffa-a0cb-e872fffe855e None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:23.160331 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd66c989-0473-4c7e-b45c-2b33e343e46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:23.161028 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66c989-0473-4c7e-b45c-2b33e343e46c None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:23.161350 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66c989-0473-4c7e-b45c-2b33e343e46c None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:23.161630 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd66c989-0473-4c7e-b45c-2b33e343e46c None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:23.162411 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66c989-0473-4c7e-b45c-2b33e343e46c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:23.162719 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66c989-0473-4c7e-b45c-2b33e343e46c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:23.164204 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd66c989-0473-4c7e-b45c-2b33e343e46c None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:23.178177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 61/123] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:42:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:23.178177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ef4bb-d335-4933-8e5a-f9a75cb7e6f7 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:23.178177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ef4bb-d335-4933-8e5a-f9a75cb7e6f7 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:23.178177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ef4bb-d335-4933-8e5a-f9a75cb7e6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:23.197670 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-e88ef4bb-d335-4933-8e5a-f9a75cb7e6f7 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:23.199213 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-e88ef4bb-d335-4933-8e5a-f9a75cb7e6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:23.215863 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b1a0c-5d88-4378-a5ff-eafe1aa5524d None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:23.251306 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fdca2-b6d0-4d68-8dbf-1499af974f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:23.252273 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fdca2-b6d0-4d68-8dbf-1499af974f79 None admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:23.252562 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fdca2-b6d0-4d68-8dbf-1499af974f79 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:23.252838 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fdca2-b6d0-4d68-8dbf-1499af974f79 None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92/users/abec147e21ba4a90ada48328d76ea483/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:23.255080 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fdca2-b6d0-4d68-8dbf-1499af974f79 None admin] RBAC: Authorizing `identity:create_grant(project_id=5563d83687534242a56eaa5054d6ed92, user_id=abec147e21ba4a90ada48328d76ea483, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:23.256656 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fdca2-b6d0-4d68-8dbf-1499af974f79 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:23.273324 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 62/124] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:23.278071 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ef4bb-d335-4933-8e5a-f9a75cb7e6f7 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:23.344614 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 63/125] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:42:23 2022] PUT /identity/v3/projects/5563d83687534242a56eaa5054d6ed92/users/abec147e21ba4a90ada48328d76ea483/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:42:23.346690 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fdca2-b6d0-4d68-8dbf-1499af974f79 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:23.408878 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ef4bb-d335-4933-8e5a-f9a75cb7e6f7 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:23.470787 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b05f29-819c-43e0-84a2-044e4f122e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:23.471837 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b05f29-819c-43e0-84a2-044e4f122e24 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:23.472300 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b05f29-819c-43e0-84a2-044e4f122e24 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:23.472744 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b05f29-819c-43e0-84a2-044e4f122e24 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:23.474262 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b05f29-819c-43e0-84a2-044e4f122e24 None admin] RBAC: Adding query filter params (name=member) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:23.476186 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b05f29-819c-43e0-84a2-044e4f122e24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:23.478367 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b05f29-819c-43e0-84a2-044e4f122e24 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:23.494126 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 63/126] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:23.496000 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b05f29-819c-43e0-84a2-044e4f122e24 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:23.543332 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fdca2-b6d0-4d68-8dbf-1499af974f79 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:23.582676 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4159a6-7680-40fa-9b06-b7210736dc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:23.584139 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4159a6-7680-40fa-9b06-b7210736dc08 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:23.584424 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4159a6-7680-40fa-9b06-b7210736dc08 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:23.584702 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4159a6-7680-40fa-9b06-b7210736dc08 None admin] PATH_INFO: `/v3/users/417f9e3fafbd4d549108c326f06391c6` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:23.586345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4159a6-7680-40fa-9b06-b7210736dc08 None admin] RBAC: Authorizing `identity:get_user(user_id=417f9e3fafbd4d549108c326f06391c6)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:23.588098 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4159a6-7680-40fa-9b06-b7210736dc08 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:23.590035 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 64/127] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:23 2022] GET /identity/v3/users/417f9e3fafbd4d549108c326f06391c6 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:23.590817 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4159a6-7680-40fa-9b06-b7210736dc08 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:23.692168 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b05f29-819c-43e0-84a2-044e4f122e24 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:23.726557 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4159a6-7680-40fa-9b06-b7210736dc08 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:23.744303 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43157ff4-3097-4d12-bd18-162918d531b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:23.745119 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43157ff4-3097-4d12-bd18-162918d531b2 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:23.745414 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43157ff4-3097-4d12-bd18-162918d531b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:23.745693 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43157ff4-3097-4d12-bd18-162918d531b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:23.768735 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f3f71-e6d2-468c-9f34-732efcb9f6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:23.771043 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f3f71-e6d2-468c-9f34-732efcb9f6a3 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:23.771171 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f3f71-e6d2-468c-9f34-732efcb9f6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:23.774857 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831f3f71-e6d2-468c-9f34-732efcb9f6a3 None admin] PATH_INFO: `/v3/users/417f9e3fafbd4d549108c326f06391c6` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:23.774857 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f3f71-e6d2-468c-9f34-732efcb9f6a3 None admin] RBAC: Authorizing `identity:get_user(user_id=417f9e3fafbd4d549108c326f06391c6)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:23.774857 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831f3f71-e6d2-468c-9f34-732efcb9f6a3 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:23.776245 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 65/128] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:23 2022] GET /identity/v3/users/417f9e3fafbd4d549108c326f06391c6 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:23.776841 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f3f71-e6d2-468c-9f34-732efcb9f6a3 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:23.779614 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43157ff4-3097-4d12-bd18-162918d531b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:23.799629 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-43157ff4-3097-4d12-bd18-162918d531b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 23:42:23.800901 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 64/129] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:23.801679 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43157ff4-3097-4d12-bd18-162918d531b2 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:23.887257 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831f3f71-e6d2-468c-9f34-732efcb9f6a3 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:23.921130 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb94ce-212d-4fc7-8a9a-fbce427d2f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:23.921952 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb94ce-212d-4fc7-8a9a-fbce427d2f56 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:23.922247 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb94ce-212d-4fc7-8a9a-fbce427d2f56 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:23.922528 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb94ce-212d-4fc7-8a9a-fbce427d2f56 None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:23.923791 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb94ce-212d-4fc7-8a9a-fbce427d2f56 None admin] RBAC: Authorizing `identity:get_project(project_id=5563d83687534242a56eaa5054d6ed92)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:23.925320 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eb94ce-212d-4fc7-8a9a-fbce427d2f56 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:23.927281 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 66/130] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:23 2022] GET /identity/v3/projects/5563d83687534242a56eaa5054d6ed92 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:23.928071 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb94ce-212d-4fc7-8a9a-fbce427d2f56 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:23.965297 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43157ff4-3097-4d12-bd18-162918d531b2 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:23.998714 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b04c12-dddc-4735-80d3-8d8de79fa70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:24.000392 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b04c12-dddc-4735-80d3-8d8de79fa70c None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:24.000891 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b04c12-dddc-4735-80d3-8d8de79fa70c None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:24.001362 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b04c12-dddc-4735-80d3-8d8de79fa70c None admin] PATH_INFO: `/v3/projects/3288719b5d804b02bc71c8f45b9917c4` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:24.002801 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b04c12-dddc-4735-80d3-8d8de79fa70c None admin] RBAC: Authorizing `identity:get_project(project_id=3288719b5d804b02bc71c8f45b9917c4)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:24.004474 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b04c12-dddc-4735-80d3-8d8de79fa70c None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:24.006966 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 65/131] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:23 2022] GET /identity/v3/projects/3288719b5d804b02bc71c8f45b9917c4 => generated 312 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:24.007906 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b04c12-dddc-4735-80d3-8d8de79fa70c None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:24.106595 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b04c12-dddc-4735-80d3-8d8de79fa70c None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:24.108772 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb94ce-212d-4fc7-8a9a-fbce427d2f56 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:24.140880 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daac26d-134c-4f79-a93b-8f5331419c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:24.142107 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daac26d-134c-4f79-a93b-8f5331419c44 None admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:24.142588 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daac26d-134c-4f79-a93b-8f5331419c44 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:24.143103 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daac26d-134c-4f79-a93b-8f5331419c44 None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92/users/417f9e3fafbd4d549108c326f06391c6/roles/f7b5f822a48e4e269ab53ce00a04194e` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:24.143314 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66124070-0945-44ac-9bd4-aa163ef4acba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:24.143994 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66124070-0945-44ac-9bd4-aa163ef4acba None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:24.144376 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66124070-0945-44ac-9bd4-aa163ef4acba None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:24.144661 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66124070-0945-44ac-9bd4-aa163ef4acba None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:24.145561 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66124070-0945-44ac-9bd4-aa163ef4acba None admin] RBAC: Adding query filter params (name=member) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:24.146087 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66124070-0945-44ac-9bd4-aa163ef4acba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:24.146865 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daac26d-134c-4f79-a93b-8f5331419c44 None admin] RBAC: Authorizing `identity:create_grant(project_id=5563d83687534242a56eaa5054d6ed92, user_id=417f9e3fafbd4d549108c326f06391c6, role_id=f7b5f822a48e4e269ab53ce00a04194e)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:24.147513 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66124070-0945-44ac-9bd4-aa163ef4acba None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:24.148726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daac26d-134c-4f79-a93b-8f5331419c44 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:24.159127 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 67/132] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:24.159127 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66124070-0945-44ac-9bd4-aa163ef4acba None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:24.251859 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 66/133] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:42:24 2022] PUT /identity/v3/projects/5563d83687534242a56eaa5054d6ed92/users/417f9e3fafbd4d549108c326f06391c6/roles/f7b5f822a48e4e269ab53ce00a04194e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:42:24.253073 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daac26d-134c-4f79-a93b-8f5331419c44 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:24.267889 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66124070-0945-44ac-9bd4-aa163ef4acba None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:24.305692 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d47282-4c3e-4f67-8503-14def2611da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:24.306620 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d47282-4c3e-4f67-8503-14def2611da6 None admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:24.306928 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d47282-4c3e-4f67-8503-14def2611da6 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:24.307206 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d47282-4c3e-4f67-8503-14def2611da6 None admin] PATH_INFO: `/v3/projects/3288719b5d804b02bc71c8f45b9917c4/users/417f9e3fafbd4d549108c326f06391c6/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:24.309318 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d47282-4c3e-4f67-8503-14def2611da6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3288719b5d804b02bc71c8f45b9917c4, user_id=417f9e3fafbd4d549108c326f06391c6, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:24.310818 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d47282-4c3e-4f67-8503-14def2611da6 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:24.402389 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 68/134] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:42:24 2022] PUT /identity/v3/projects/3288719b5d804b02bc71c8f45b9917c4/users/417f9e3fafbd4d549108c326f06391c6/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:42:24.433577 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daac26d-134c-4f79-a93b-8f5331419c44 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:24.470376 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8592d1-f753-4006-9040-7715e62a9bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:24.471470 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8592d1-f753-4006-9040-7715e62a9bba None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:24.471760 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8592d1-f753-4006-9040-7715e62a9bba None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:24.472051 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8592d1-f753-4006-9040-7715e62a9bba None admin] PATH_INFO: `/v3/users/417f9e3fafbd4d549108c326f06391c6` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:24.473369 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8592d1-f753-4006-9040-7715e62a9bba None admin] RBAC: Authorizing `identity:get_user(user_id=417f9e3fafbd4d549108c326f06391c6)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:24.475563 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8592d1-f753-4006-9040-7715e62a9bba None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:24.477338 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 67/135] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:24 2022] GET /identity/v3/users/417f9e3fafbd4d549108c326f06391c6 => generated 275 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:24.483031 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d47282-4c3e-4f67-8503-14def2611da6 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:24.615985 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d47282-4c3e-4f67-8503-14def2611da6 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:24.652226 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d4e6c-8600-42a1-93dd-d460049dc00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:24.653110 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d4e6c-8600-42a1-93dd-d460049dc00e None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:24.653400 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d4e6c-8600-42a1-93dd-d460049dc00e None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:24.653679 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d4e6c-8600-42a1-93dd-d460049dc00e None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:24.654971 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d4e6c-8600-42a1-93dd-d460049dc00e None admin] RBAC: Authorizing `identity:get_project(project_id=5563d83687534242a56eaa5054d6ed92)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:24.656472 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d4e6c-8600-42a1-93dd-d460049dc00e None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:24.658437 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 69/136] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:24 2022] GET /identity/v3/projects/5563d83687534242a56eaa5054d6ed92 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:24.664595 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8592d1-f753-4006-9040-7715e62a9bba None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:24.780070 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8592d1-f753-4006-9040-7715e62a9bba None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:24.816671 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f044d-4556-48ba-b1ea-9ecf3503bca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:24.817600 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f044d-4556-48ba-b1ea-9ecf3503bca5 None admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:24.817884 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f044d-4556-48ba-b1ea-9ecf3503bca5 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:24.818160 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81f044d-4556-48ba-b1ea-9ecf3503bca5 None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92/users/417f9e3fafbd4d549108c326f06391c6/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:24.820189 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f044d-4556-48ba-b1ea-9ecf3503bca5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5563d83687534242a56eaa5054d6ed92, user_id=417f9e3fafbd4d549108c326f06391c6, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:24.821656 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81f044d-4556-48ba-b1ea-9ecf3503bca5 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:24.886987 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f972d6-d780-48d5-aa16-de16c35a9a4f None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:24.887256 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f972d6-d780-48d5-aa16-de16c35a9a4f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:24.887480 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f972d6-d780-48d5-aa16-de16c35a9a4f None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:24.889558 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 70/137] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:24.894396 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3ffc5-f43e-45f2-8cc7-f2c8e27868ab None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:24.894690 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3ffc5-f43e-45f2-8cc7-f2c8e27868ab None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:24.895008 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3ffc5-f43e-45f2-8cc7-f2c8e27868ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:24.912868 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-17a3ffc5-f43e-45f2-8cc7-f2c8e27868ab None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:24.914266 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-17a3ffc5-f43e-45f2-8cc7-f2c8e27868ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:24.921612 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 68/138] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:42:24 2022] PUT /identity/v3/projects/5563d83687534242a56eaa5054d6ed92/users/417f9e3fafbd4d549108c326f06391c6/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:42:25.000512 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 71/139] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:42:25.044080 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f044d-4556-48ba-b1ea-9ecf3503bca5 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:25.173965 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81f044d-4556-48ba-b1ea-9ecf3503bca5 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:25.214901 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa8ce20-9075-4049-9597-d69562bbb106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:25.215712 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8ce20-9075-4049-9597-d69562bbb106 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:25.216031 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8ce20-9075-4049-9597-d69562bbb106 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:25.216276 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa8ce20-9075-4049-9597-d69562bbb106 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:25.217473 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8ce20-9075-4049-9597-d69562bbb106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:25.218974 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa8ce20-9075-4049-9597-d69562bbb106 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:25.220914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 69/140] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:42:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:25.227001 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3ffc5-f43e-45f2-8cc7-f2c8e27868ab None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:25.350635 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a3ffc5-f43e-45f2-8cc7-f2c8e27868ab None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:25.389158 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d037765-56eb-4786-89c6-dcf5ac838cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:25.389897 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d037765-56eb-4786-89c6-dcf5ac838cd6 None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:25.390182 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d037765-56eb-4786-89c6-dcf5ac838cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:25.390511 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d037765-56eb-4786-89c6-dcf5ac838cd6 None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:25.391259 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d037765-56eb-4786-89c6-dcf5ac838cd6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:25.392725 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d037765-56eb-4786-89c6-dcf5ac838cd6 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:25.540028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 72/141] 10.222.0.24 () {60 vars in 1132 bytes} [Mon Apr 11 23:42:25 2022] POST /identity/v3/users => generated 283 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:42:26.078362 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc90c28-3c54-4a18-8751-e02c1686d0a6 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:26.079116 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc90c28-3c54-4a18-8751-e02c1686d0a6 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:26.079116 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc90c28-3c54-4a18-8751-e02c1686d0a6 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:26.080896 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 70/142] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:26.086822 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12482105-dd5d-4081-a690-231e5b117b79 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:26.087321 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12482105-dd5d-4081-a690-231e5b117b79 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:26.087961 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12482105-dd5d-4081-a690-231e5b117b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:26.111098 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-12482105-dd5d-4081-a690-231e5b117b79 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:26.112286 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-12482105-dd5d-4081-a690-231e5b117b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:26.198196 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 73/143] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:26.234982 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc90c28-3c54-4a18-8751-e02c1686d0a6 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:26.365104 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc90c28-3c54-4a18-8751-e02c1686d0a6 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:26.403853 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacdaa0-f6bb-4307-b8d9-d47d74cc827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:26.404652 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacdaa0-f6bb-4307-b8d9-d47d74cc827e None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:26.404938 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacdaa0-f6bb-4307-b8d9-d47d74cc827e None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:26.405218 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacdaa0-f6bb-4307-b8d9-d47d74cc827e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:26.423833 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecacdaa0-f6bb-4307-b8d9-d47d74cc827e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:26.431586 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-ecacdaa0-f6bb-4307-b8d9-d47d74cc827e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 23:42:26.433117 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 71/144] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:26.438731 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12482105-dd5d-4081-a690-231e5b117b79 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:26.522403 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03ff49-ee9a-42ab-87de-b8a799ce216b None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:26.522730 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03ff49-ee9a-42ab-87de-b8a799ce216b None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:26.522998 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03ff49-ee9a-42ab-87de-b8a799ce216b None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:26.524799 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 72/145] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:42:26.531786 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c0142-ece3-40fa-a8fe-440c65893ba1 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:26.532073 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c0142-ece3-40fa-a8fe-440c65893ba1 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:26.532355 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c0142-ece3-40fa-a8fe-440c65893ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:26.556552 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-4d1c0142-ece3-40fa-a8fe-440c65893ba1 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:26.557753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-4d1c0142-ece3-40fa-a8fe-440c65893ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:26.578693 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12482105-dd5d-4081-a690-231e5b117b79 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:26.642860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901a8b1-44b2-41a1-8c8d-386154b2c18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:26.643468 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901a8b1-44b2-41a1-8c8d-386154b2c18c None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:26.643753 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901a8b1-44b2-41a1-8c8d-386154b2c18c None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:26.644028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901a8b1-44b2-41a1-8c8d-386154b2c18c None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:26.644858 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901a8b1-44b2-41a1-8c8d-386154b2c18c None admin] RBAC: Adding query filter params (name=reader) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:26.645167 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901a8b1-44b2-41a1-8c8d-386154b2c18c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:26.647923 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901a8b1-44b2-41a1-8c8d-386154b2c18c None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:26.665152 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 74/146] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:26.669781 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901a8b1-44b2-41a1-8c8d-386154b2c18c None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:26.686478 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 73/147] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:42:26.724855 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c0142-ece3-40fa-a8fe-440c65893ba1 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:26.841553 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901a8b1-44b2-41a1-8c8d-386154b2c18c None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:26.888708 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf0bd6-3930-4e1e-a633-aa3c4fa8b71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:26.889674 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf0bd6-3930-4e1e-a633-aa3c4fa8b71d None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:26.889956 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf0bd6-3930-4e1e-a633-aa3c4fa8b71d None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:26.890228 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf0bd6-3930-4e1e-a633-aa3c4fa8b71d None admin] PATH_INFO: `/v3/users/8cab219006a74de0a7569808bd60bee0` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:26.892090 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf0bd6-3930-4e1e-a633-aa3c4fa8b71d None admin] RBAC: Authorizing `identity:get_user(user_id=8cab219006a74de0a7569808bd60bee0)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:26.893588 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf0bd6-3930-4e1e-a633-aa3c4fa8b71d None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:26.895350 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 75/148] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:26 2022] GET /identity/v3/users/8cab219006a74de0a7569808bd60bee0 => generated 289 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:26.902470 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf0bd6-3930-4e1e-a633-aa3c4fa8b71d None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:26.908318 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c0142-ece3-40fa-a8fe-440c65893ba1 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:27.004337 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10295c8a-79dc-4bd7-b062-4a55c4d56e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:27.005147 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10295c8a-79dc-4bd7-b062-4a55c4d56e99 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:27.005429 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10295c8a-79dc-4bd7-b062-4a55c4d56e99 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:27.005701 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10295c8a-79dc-4bd7-b062-4a55c4d56e99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:27.035746 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10295c8a-79dc-4bd7-b062-4a55c4d56e99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:27.047363 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-10295c8a-79dc-4bd7-b062-4a55c4d56e99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:42:27.048827 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 74/149] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:42:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:42:27.054981 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10295c8a-79dc-4bd7-b062-4a55c4d56e99 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:27.058512 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf0bd6-3930-4e1e-a633-aa3c4fa8b71d None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:27.099356 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51929b-6eab-4a23-b8f7-e86dfd5343ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:27.100232 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51929b-6eab-4a23-b8f7-e86dfd5343ec None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:27.100512 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51929b-6eab-4a23-b8f7-e86dfd5343ec None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:27.100787 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51929b-6eab-4a23-b8f7-e86dfd5343ec None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:27.102931 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51929b-6eab-4a23-b8f7-e86dfd5343ec None admin] RBAC: Authorizing `identity:get_project(project_id=5563d83687534242a56eaa5054d6ed92)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:27.104378 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51929b-6eab-4a23-b8f7-e86dfd5343ec None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:27.106069 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 76/150] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:26 2022] GET /identity/v3/projects/5563d83687534242a56eaa5054d6ed92 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:27.112054 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51929b-6eab-4a23-b8f7-e86dfd5343ec None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:27.200214 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10295c8a-79dc-4bd7-b062-4a55c4d56e99 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:27.237790 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd842d-7e4c-46d9-a198-e408449fce3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:27.238459 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd842d-7e4c-46d9-a198-e408449fce3f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:27.238741 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd842d-7e4c-46d9-a198-e408449fce3f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:27.239046 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd842d-7e4c-46d9-a198-e408449fce3f None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:27.240337 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd842d-7e4c-46d9-a198-e408449fce3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:27.240657 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd842d-7e4c-46d9-a198-e408449fce3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:27.242209 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cd842d-7e4c-46d9-a198-e408449fce3f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:27.251778 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 75/151] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:27.258077 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd842d-7e4c-46d9-a198-e408449fce3f None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:27.314952 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51929b-6eab-4a23-b8f7-e86dfd5343ec None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:27.374635 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd842d-7e4c-46d9-a198-e408449fce3f None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:27.407575 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02926388-ec63-4b07-97d8-1ca068746c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:27.408495 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02926388-ec63-4b07-97d8-1ca068746c52 None admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:27.408777 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02926388-ec63-4b07-97d8-1ca068746c52 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:27.409214 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02926388-ec63-4b07-97d8-1ca068746c52 None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92/users/8cab219006a74de0a7569808bd60bee0/roles/d970ab64b060491c919ed8a7cf36313c` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:27.412264 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6ffc5-4e53-4073-8c2c-d0108d6ae066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:27.413141 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6ffc5-4e53-4073-8c2c-d0108d6ae066 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:27.413357 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02926388-ec63-4b07-97d8-1ca068746c52 None admin] RBAC: Authorizing `identity:create_grant(project_id=5563d83687534242a56eaa5054d6ed92, user_id=8cab219006a74de0a7569808bd60bee0, role_id=d970ab64b060491c919ed8a7cf36313c)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:27.413464 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6ffc5-4e53-4073-8c2c-d0108d6ae066 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:27.413686 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6ffc5-4e53-4073-8c2c-d0108d6ae066 None admin] PATH_INFO: `/v3/users/abec147e21ba4a90ada48328d76ea483` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:27.414929 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb6ffc5-4e53-4073-8c2c-d0108d6ae066 None admin] RBAC: Authorizing `identity:get_user(user_id=abec147e21ba4a90ada48328d76ea483)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:27.415368 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02926388-ec63-4b07-97d8-1ca068746c52 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:27.416381 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb6ffc5-4e53-4073-8c2c-d0108d6ae066 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:27.418243 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 76/152] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:27 2022] GET /identity/v3/users/abec147e21ba4a90ada48328d76ea483 => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:27.423707 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6ffc5-4e53-4073-8c2c-d0108d6ae066 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:27.513304 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 77/153] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:42:27 2022] PUT /identity/v3/projects/5563d83687534242a56eaa5054d6ed92/users/8cab219006a74de0a7569808bd60bee0/roles/d970ab64b060491c919ed8a7cf36313c => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:42:27.530067 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb6ffc5-4e53-4073-8c2c-d0108d6ae066 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:27.569527 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bba710-b07f-4be7-b279-8d595c09eda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:27.570171 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bba710-b07f-4be7-b279-8d595c09eda5 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:27.570451 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bba710-b07f-4be7-b279-8d595c09eda5 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:27.570719 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bba710-b07f-4be7-b279-8d595c09eda5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:27.648023 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bba710-b07f-4be7-b279-8d595c09eda5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:27.649502 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bba710-b07f-4be7-b279-8d595c09eda5 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:27.754698 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 77/154] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:42:27.762355 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02926388-ec63-4b07-97d8-1ca068746c52 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:27.826736 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3b5c8-e541-4ae1-bea4-de5d323aa727 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:27.827077 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3b5c8-e541-4ae1-bea4-de5d323aa727 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:27.827331 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3b5c8-e541-4ae1-bea4-de5d323aa727 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:27.829360 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 78/155] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:27.837465 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84783c36-228e-4a86-a549-63f115391f93 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:27.838017 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84783c36-228e-4a86-a549-63f115391f93 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:27.838288 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84783c36-228e-4a86-a549-63f115391f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:27.865370 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-84783c36-228e-4a86-a549-63f115391f93 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:27.866605 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-84783c36-228e-4a86-a549-63f115391f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:27.919840 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02926388-ec63-4b07-97d8-1ca068746c52 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:27.971635 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acf2a3-4ebd-4c15-bd95-a4152f101e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:27.972561 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 79/156] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:42:27.972688 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acf2a3-4ebd-4c15-bd95-a4152f101e4b None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:27.972881 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acf2a3-4ebd-4c15-bd95-a4152f101e4b None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:27.973131 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44acf2a3-4ebd-4c15-bd95-a4152f101e4b None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:27.974356 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bcae7-16c7-435d-84e1-9407259fb6c6 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:27.974648 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bcae7-16c7-435d-84e1-9407259fb6c6 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:27.974940 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9bcae7-16c7-435d-84e1-9407259fb6c6 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:27.975947 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44acf2a3-4ebd-4c15-bd95-a4152f101e4b None admin] RBAC: Authorizing `identity:get_project(project_id=5563d83687534242a56eaa5054d6ed92)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:27.976823 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 80/157] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:27.977478 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44acf2a3-4ebd-4c15-bd95-a4152f101e4b None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:27.981226 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 78/158] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:27 2022] GET /identity/v3/projects/5563d83687534242a56eaa5054d6ed92 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:27.982605 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f143d-a86c-4620-9cf6-056e34ec94b6 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:27.982910 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f143d-a86c-4620-9cf6-056e34ec94b6 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:27.988701 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f143d-a86c-4620-9cf6-056e34ec94b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:27.988828 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acf2a3-4ebd-4c15-bd95-a4152f101e4b None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:28.012737 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-8f5f143d-a86c-4620-9cf6-056e34ec94b6 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:28.013934 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-8f5f143d-a86c-4620-9cf6-056e34ec94b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:28.108665 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 81/159] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:42:28.109358 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f143d-a86c-4620-9cf6-056e34ec94b6 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:28.184552 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44acf2a3-4ebd-4c15-bd95-a4152f101e4b None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:28.209048 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f143d-a86c-4620-9cf6-056e34ec94b6 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:28.241491 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4783c-3dc4-46aa-8b76-ac203d1faaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:28.242519 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4783c-3dc4-46aa-8b76-ac203d1faaca None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:28.242935 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4783c-3dc4-46aa-8b76-ac203d1faaca None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:28.243326 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c4783c-3dc4-46aa-8b76-ac203d1faaca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:28.244375 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4783c-3dc4-46aa-8b76-ac203d1faaca None admin] RBAC: Adding query filter params (role.id=c8affbefb4c5462a921650b24b13c80f, scope.project.id=5563d83687534242a56eaa5054d6ed92, user.id=abec147e21ba4a90ada48328d76ea483) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:28.244785 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4783c-3dc4-46aa-8b76-ac203d1faaca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:28.245080 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb4a3d-d88f-4f13-9c7e-5353c36a5b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:28.246034 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb4a3d-d88f-4f13-9c7e-5353c36a5b08 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:28.246444 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb4a3d-d88f-4f13-9c7e-5353c36a5b08 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:28.246630 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c4783c-3dc4-46aa-8b76-ac203d1faaca None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:28.247011 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb4a3d-d88f-4f13-9c7e-5353c36a5b08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:28.261773 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 79/160] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:42:27 2022] GET /identity/v3/role_assignments?user.id=abec147e21ba4a90ada48328d76ea483&scope.project.id=5563d83687534242a56eaa5054d6ed92&role.id=c8affbefb4c5462a921650b24b13c80f => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:28.263002 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4783c-3dc4-46aa-8b76-ac203d1faaca None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:28.272292 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb4a3d-d88f-4f13-9c7e-5353c36a5b08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:28.280133 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-0cdb4a3d-d88f-4f13-9c7e-5353c36a5b08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 23:42:28.289006 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 82/161] 10.222.0.24 () {56 vars in 1114 bytes} [Mon Apr 11 23:42:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:28.295729 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb4a3d-d88f-4f13-9c7e-5353c36a5b08 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:28.484491 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb4a3d-d88f-4f13-9c7e-5353c36a5b08 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:28.498756 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c4783c-3dc4-46aa-8b76-ac203d1faaca None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:28.524478 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dde76-cd49-416c-a388-8e9ccf7590d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:28.525172 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dde76-cd49-416c-a388-8e9ccf7590d1 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:28.525458 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dde76-cd49-416c-a388-8e9ccf7590d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:28.525732 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777dde76-cd49-416c-a388-8e9ccf7590d1 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:28.526500 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dde76-cd49-416c-a388-8e9ccf7590d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:28.526807 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dde76-cd49-416c-a388-8e9ccf7590d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:28.528329 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777dde76-cd49-416c-a388-8e9ccf7590d1 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:28.546340 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 83/162] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:42:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:28.552055 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dde76-cd49-416c-a388-8e9ccf7590d1 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:28.587889 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497c611-4a99-4f5c-b6e1-e4a26008c9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:28.588699 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497c611-4a99-4f5c-b6e1-e4a26008c9bb None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:28.588974 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497c611-4a99-4f5c-b6e1-e4a26008c9bb None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:28.589241 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497c611-4a99-4f5c-b6e1-e4a26008c9bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:28.611860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497c611-4a99-4f5c-b6e1-e4a26008c9bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:28.619131 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-6497c611-4a99-4f5c-b6e1-e4a26008c9bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 23:42:28.627576 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 80/163] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:28.634264 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497c611-4a99-4f5c-b6e1-e4a26008c9bb None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:28.726559 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777dde76-cd49-416c-a388-8e9ccf7590d1 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:28.804516 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b4a17-07fb-4945-9514-31024892cf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:28.805682 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b4a17-07fb-4945-9514-31024892cf25 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:28.806107 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b4a17-07fb-4945-9514-31024892cf25 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:28.806549 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b4a17-07fb-4945-9514-31024892cf25 None admin] PATH_INFO: `/v3/users/417f9e3fafbd4d549108c326f06391c6` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:28.808003 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b4a17-07fb-4945-9514-31024892cf25 None admin] RBAC: Authorizing `identity:get_user(user_id=417f9e3fafbd4d549108c326f06391c6)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:28.809596 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b4a17-07fb-4945-9514-31024892cf25 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:28.811738 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 84/164] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:28 2022] GET /identity/v3/users/417f9e3fafbd4d549108c326f06391c6 => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:28.818808 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b4a17-07fb-4945-9514-31024892cf25 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:28.862789 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497c611-4a99-4f5c-b6e1-e4a26008c9bb None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:28.947610 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926d24b-e041-495d-80f4-df33adc1dfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:28.948294 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926d24b-e041-495d-80f4-df33adc1dfbe None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:28.948567 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926d24b-e041-495d-80f4-df33adc1dfbe None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:28.948838 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926d24b-e041-495d-80f4-df33adc1dfbe None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:28.949596 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926d24b-e041-495d-80f4-df33adc1dfbe None admin] RBAC: Adding query filter params (name=member) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:28.949892 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926d24b-e041-495d-80f4-df33adc1dfbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:28.951536 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6926d24b-e041-495d-80f4-df33adc1dfbe None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:28.966407 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b4a17-07fb-4945-9514-31024892cf25 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:28.976974 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 81/165] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:28.982521 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926d24b-e041-495d-80f4-df33adc1dfbe None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:29.001566 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179fcdb-976b-4a1a-be9f-66b8f4c46aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:29.002207 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179fcdb-976b-4a1a-be9f-66b8f4c46aae None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:29.002492 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179fcdb-976b-4a1a-be9f-66b8f4c46aae None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:29.002747 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2179fcdb-976b-4a1a-be9f-66b8f4c46aae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:29.071155 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179fcdb-976b-4a1a-be9f-66b8f4c46aae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:29.072557 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2179fcdb-976b-4a1a-be9f-66b8f4c46aae None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:29.170625 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 85/166] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:42:29.176003 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179fcdb-976b-4a1a-be9f-66b8f4c46aae None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:29.186468 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926d24b-e041-495d-80f4-df33adc1dfbe None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:29.274728 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2179fcdb-976b-4a1a-be9f-66b8f4c46aae None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:29.279547 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652e4b5-8b41-4d2f-bee1-1dd92231c855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:29.280437 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652e4b5-8b41-4d2f-bee1-1dd92231c855 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:29.280714 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652e4b5-8b41-4d2f-bee1-1dd92231c855 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:29.280984 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b652e4b5-8b41-4d2f-bee1-1dd92231c855 None admin] PATH_INFO: `/v3/users/417f9e3fafbd4d549108c326f06391c6` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:29.282235 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652e4b5-8b41-4d2f-bee1-1dd92231c855 None admin] RBAC: Authorizing `identity:get_user(user_id=417f9e3fafbd4d549108c326f06391c6)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:29.283711 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b652e4b5-8b41-4d2f-bee1-1dd92231c855 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:29.285517 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 82/167] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:28 2022] GET /identity/v3/users/417f9e3fafbd4d549108c326f06391c6 => generated 275 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:29.291423 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652e4b5-8b41-4d2f-bee1-1dd92231c855 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:29.310876 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09379bf4-3069-4797-bdab-8455558c5129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:29.311998 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09379bf4-3069-4797-bdab-8455558c5129 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:29.312411 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09379bf4-3069-4797-bdab-8455558c5129 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:29.312813 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09379bf4-3069-4797-bdab-8455558c5129 None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:29.314163 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09379bf4-3069-4797-bdab-8455558c5129 None admin] RBAC: Authorizing `identity:get_project(project_id=5563d83687534242a56eaa5054d6ed92)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:29.315770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09379bf4-3069-4797-bdab-8455558c5129 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:29.317659 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 86/168] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:29 2022] GET /identity/v3/projects/5563d83687534242a56eaa5054d6ed92 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:29.326322 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09379bf4-3069-4797-bdab-8455558c5129 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:29.437503 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09379bf4-3069-4797-bdab-8455558c5129 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:29.479640 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e5864-d52b-4e72-bb7f-c492951dded1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:29.480563 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e5864-d52b-4e72-bb7f-c492951dded1 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:29.482054 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e5864-d52b-4e72-bb7f-c492951dded1 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:29.482467 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e5864-d52b-4e72-bb7f-c492951dded1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:29.484845 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e5864-d52b-4e72-bb7f-c492951dded1 None admin] RBAC: Adding query filter params (role.id=f7b5f822a48e4e269ab53ce00a04194e, scope.project.id=5563d83687534242a56eaa5054d6ed92, user.id=417f9e3fafbd4d549108c326f06391c6) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:29.485318 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e5864-d52b-4e72-bb7f-c492951dded1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:29.488164 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e5864-d52b-4e72-bb7f-c492951dded1 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:29.503052 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b652e4b5-8b41-4d2f-bee1-1dd92231c855 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:29.503979 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 87/169] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:42:29 2022] GET /identity/v3/role_assignments?user.id=417f9e3fafbd4d549108c326f06391c6&scope.project.id=5563d83687534242a56eaa5054d6ed92&role.id=f7b5f822a48e4e269ab53ce00a04194e => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:29.506095 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ed28f-7202-4e72-9126-e34562f72bec None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:29.507477 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ed28f-7202-4e72-9126-e34562f72bec None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:29.507963 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ed28f-7202-4e72-9126-e34562f72bec None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:29.509872 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 88/170] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:29.517147 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1363a4-3336-4520-8a42-3595873e7a36 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:29.517638 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1363a4-3336-4520-8a42-3595873e7a36 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:29.518047 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1363a4-3336-4520-8a42-3595873e7a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:29.555481 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-ac1363a4-3336-4520-8a42-3595873e7a36 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:29.557132 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ac1363a4-3336-4520-8a42-3595873e7a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:29.566367 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fa4d8-a36c-41eb-bcb3-71f1a9c9f7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:29.567347 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fa4d8-a36c-41eb-bcb3-71f1a9c9f7f8 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:29.567813 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fa4d8-a36c-41eb-bcb3-71f1a9c9f7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:29.568275 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fa4d8-a36c-41eb-bcb3-71f1a9c9f7f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:29.673486 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 89/171] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:29.722760 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fa4d8-a36c-41eb-bcb3-71f1a9c9f7f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:29.724867 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fa4d8-a36c-41eb-bcb3-71f1a9c9f7f8 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:29.758310 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1363a4-3336-4520-8a42-3595873e7a36 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:29.891254 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 83/172] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:42:29.896980 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fa4d8-a36c-41eb-bcb3-71f1a9c9f7f8 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:29.957269 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1363a4-3336-4520-8a42-3595873e7a36 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:30.021415 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fa4d8-a36c-41eb-bcb3-71f1a9c9f7f8 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:30.034666 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304a567-8c64-49ee-88f4-05933dcb4b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:30.035509 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304a567-8c64-49ee-88f4-05933dcb4b7d None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:30.035785 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304a567-8c64-49ee-88f4-05933dcb4b7d None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:30.036597 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304a567-8c64-49ee-88f4-05933dcb4b7d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:30.052884 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1304a567-8c64-49ee-88f4-05933dcb4b7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:30.059953 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-1304a567-8c64-49ee-88f4-05933dcb4b7d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 23:42:30.061198 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 90/173] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:30.067792 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304a567-8c64-49ee-88f4-05933dcb4b7d None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:30.167065 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f910e2-b03d-4490-95f8-841b9252647f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:30.167939 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f910e2-b03d-4490-95f8-841b9252647f None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:30.168212 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f910e2-b03d-4490-95f8-841b9252647f None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:30.168481 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f910e2-b03d-4490-95f8-841b9252647f None admin] PATH_INFO: `/v3/projects/3288719b5d804b02bc71c8f45b9917c4` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:30.170626 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f910e2-b03d-4490-95f8-841b9252647f None admin] RBAC: Authorizing `identity:get_project(project_id=3288719b5d804b02bc71c8f45b9917c4)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:30.172105 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f910e2-b03d-4490-95f8-841b9252647f None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:30.173781 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 84/174] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:29 2022] GET /identity/v3/projects/3288719b5d804b02bc71c8f45b9917c4 => generated 312 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:30.183614 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f910e2-b03d-4490-95f8-841b9252647f None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:30.254794 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1304a567-8c64-49ee-88f4-05933dcb4b7d None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:30.300449 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f849bbb-27d9-4834-a8b2-a0a9b3a4b467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:30.301206 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f849bbb-27d9-4834-a8b2-a0a9b3a4b467 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:30.301365 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f849bbb-27d9-4834-a8b2-a0a9b3a4b467 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:30.301651 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f849bbb-27d9-4834-a8b2-a0a9b3a4b467 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:30.302965 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f849bbb-27d9-4834-a8b2-a0a9b3a4b467 None admin] RBAC: Adding query filter params (name=member) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:30.303268 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f849bbb-27d9-4834-a8b2-a0a9b3a4b467 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:30.304640 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f849bbb-27d9-4834-a8b2-a0a9b3a4b467 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:30.320889 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 91/175] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:30.331624 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f849bbb-27d9-4834-a8b2-a0a9b3a4b467 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:30.350866 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f910e2-b03d-4490-95f8-841b9252647f None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:30.421043 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a37977-45e5-46fc-8bbd-551e2271e767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:30.421720 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a37977-45e5-46fc-8bbd-551e2271e767 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:30.422002 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a37977-45e5-46fc-8bbd-551e2271e767 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:30.422278 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a37977-45e5-46fc-8bbd-551e2271e767 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:30.423453 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a37977-45e5-46fc-8bbd-551e2271e767 None admin] RBAC: Adding query filter params (role.id=d0f74491c28e4d1094a60391d71c2246, scope.project.id=3288719b5d804b02bc71c8f45b9917c4, user.id=417f9e3fafbd4d549108c326f06391c6) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:30.423780 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a37977-45e5-46fc-8bbd-551e2271e767 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:30.425502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a37977-45e5-46fc-8bbd-551e2271e767 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:30.438635 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 85/176] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:42:30 2022] GET /identity/v3/role_assignments?user.id=417f9e3fafbd4d549108c326f06391c6&scope.project.id=3288719b5d804b02bc71c8f45b9917c4&role.id=d0f74491c28e4d1094a60391d71c2246 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:30.513013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f849bbb-27d9-4834-a8b2-a0a9b3a4b467 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:30.567817 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b839550-83d6-4630-b7aa-6a6a2e48501e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:30.568726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b839550-83d6-4630-b7aa-6a6a2e48501e None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:30.569006 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b839550-83d6-4630-b7aa-6a6a2e48501e None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:30.569277 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b839550-83d6-4630-b7aa-6a6a2e48501e None admin] PATH_INFO: `/v3/users/417f9e3fafbd4d549108c326f06391c6` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:30.570641 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b839550-83d6-4630-b7aa-6a6a2e48501e None admin] RBAC: Authorizing `identity:get_user(user_id=417f9e3fafbd4d549108c326f06391c6)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:30.572132 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b839550-83d6-4630-b7aa-6a6a2e48501e None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:30.573780 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 92/177] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:30 2022] GET /identity/v3/users/417f9e3fafbd4d549108c326f06391c6 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:30.579500 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a37977-45e5-46fc-8bbd-551e2271e767 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:30.598200 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eda7fb-8fe9-425a-b3c1-75573a4f6023 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:30.599483 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eda7fb-8fe9-425a-b3c1-75573a4f6023 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:30.599952 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eda7fb-8fe9-425a-b3c1-75573a4f6023 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:30.601950 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 93/178] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:42:30.607481 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938b597-90a5-42d6-b8d1-8c0bd810ae78 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:30.608072 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938b597-90a5-42d6-b8d1-8c0bd810ae78 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:30.608563 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4938b597-90a5-42d6-b8d1-8c0bd810ae78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:30.626122 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-4938b597-90a5-42d6-b8d1-8c0bd810ae78 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:30.627663 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-4938b597-90a5-42d6-b8d1-8c0bd810ae78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:30.745187 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 94/179] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:42:30.777922 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a37977-45e5-46fc-8bbd-551e2271e767 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:30.818770 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4993338-7f28-444f-904c-eaaa2b7d0cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:30.819825 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4993338-7f28-444f-904c-eaaa2b7d0cf4 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:30.820297 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4993338-7f28-444f-904c-eaaa2b7d0cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:30.820755 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4993338-7f28-444f-904c-eaaa2b7d0cf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:30.829421 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938b597-90a5-42d6-b8d1-8c0bd810ae78 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:30.913336 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4993338-7f28-444f-904c-eaaa2b7d0cf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:30.915283 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4993338-7f28-444f-904c-eaaa2b7d0cf4 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:30.974298 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4938b597-90a5-42d6-b8d1-8c0bd810ae78 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:31.010483 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc55e9-5dbb-463b-adfb-ff7dccca5f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:31.011748 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc55e9-5dbb-463b-adfb-ff7dccca5f87 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:31.012238 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc55e9-5dbb-463b-adfb-ff7dccca5f87 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:31.012714 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fc55e9-5dbb-463b-adfb-ff7dccca5f87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:31.025237 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fc55e9-5dbb-463b-adfb-ff7dccca5f87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:31.032743 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-09fc55e9-5dbb-463b-adfb-ff7dccca5f87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:42:31.038955 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 95/180] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:42:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:42:31.040790 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc55e9-5dbb-463b-adfb-ff7dccca5f87 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:31.110700 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 86/181] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:42:31.116695 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4993338-7f28-444f-904c-eaaa2b7d0cf4 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:31.144466 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fc55e9-5dbb-463b-adfb-ff7dccca5f87 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:31.178558 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4823e9-5459-4c9c-8452-9821fc5ec816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:31.179569 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4823e9-5459-4c9c-8452-9821fc5ec816 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:31.180021 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4823e9-5459-4c9c-8452-9821fc5ec816 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:31.180460 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4823e9-5459-4c9c-8452-9821fc5ec816 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:31.181404 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4823e9-5459-4c9c-8452-9821fc5ec816 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:31.181917 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4823e9-5459-4c9c-8452-9821fc5ec816 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:31.183530 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4823e9-5459-4c9c-8452-9821fc5ec816 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:31.200623 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 96/182] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:31.206973 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4823e9-5459-4c9c-8452-9821fc5ec816 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:31.262256 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4993338-7f28-444f-904c-eaaa2b7d0cf4 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:31.311945 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4823e9-5459-4c9c-8452-9821fc5ec816 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:31.312886 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0038fe1-f484-4f2e-be8f-2ca26cbf31d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:31.313771 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0038fe1-f484-4f2e-be8f-2ca26cbf31d6 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:31.314055 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0038fe1-f484-4f2e-be8f-2ca26cbf31d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:31.314327 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0038fe1-f484-4f2e-be8f-2ca26cbf31d6 None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:31.316358 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0038fe1-f484-4f2e-be8f-2ca26cbf31d6 None admin] RBAC: Authorizing `identity:get_project(project_id=5563d83687534242a56eaa5054d6ed92)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:31.317044 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0038fe1-f484-4f2e-be8f-2ca26cbf31d6 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:31.319668 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 87/183] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:31 2022] GET /identity/v3/projects/5563d83687534242a56eaa5054d6ed92 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:31.325158 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0038fe1-f484-4f2e-be8f-2ca26cbf31d6 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:31.355172 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b088bd4f-898e-4260-98fe-e34808ded302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:31.356148 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088bd4f-898e-4260-98fe-e34808ded302 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:31.356517 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088bd4f-898e-4260-98fe-e34808ded302 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:31.356858 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b088bd4f-898e-4260-98fe-e34808ded302 None admin] PATH_INFO: `/v3/users/6f02f16a4cfb482490bd6f25caab1622` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:31.374869 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088bd4f-898e-4260-98fe-e34808ded302 None admin] RBAC: Authorizing `identity:get_user(user_id=6f02f16a4cfb482490bd6f25caab1622)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:31.376432 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b088bd4f-898e-4260-98fe-e34808ded302 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:31.378192 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 97/184] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:31 2022] GET /identity/v3/users/6f02f16a4cfb482490bd6f25caab1622 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:31.384273 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cbd7d-3c2f-4a9b-8462-c002ce5274d4 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:31.384273 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cbd7d-3c2f-4a9b-8462-c002ce5274d4 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:31.384273 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cbd7d-3c2f-4a9b-8462-c002ce5274d4 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:31.386967 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 98/185] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:31.389130 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cbd7d-3c2f-4a9b-8462-c002ce5274d4 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:31.454294 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0038fe1-f484-4f2e-be8f-2ca26cbf31d6 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:31.490919 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c98331c-d699-4b66-b96a-ee8e3bca2399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:31.491427 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98331c-d699-4b66-b96a-ee8e3bca2399 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:31.491779 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98331c-d699-4b66-b96a-ee8e3bca2399 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:31.492118 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c98331c-d699-4b66-b96a-ee8e3bca2399 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:31.493021 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98331c-d699-4b66-b96a-ee8e3bca2399 None admin] RBAC: Adding query filter params (role.id=d0f74491c28e4d1094a60391d71c2246, scope.project.id=5563d83687534242a56eaa5054d6ed92, user.id=417f9e3fafbd4d549108c326f06391c6) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:31.493396 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98331c-d699-4b66-b96a-ee8e3bca2399 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:31.495058 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c98331c-d699-4b66-b96a-ee8e3bca2399 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:31.507004 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 88/186] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:42:31 2022] GET /identity/v3/role_assignments?user.id=417f9e3fafbd4d549108c326f06391c6&scope.project.id=5563d83687534242a56eaa5054d6ed92&role.id=d0f74491c28e4d1094a60391d71c2246 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:31.508573 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610785a-c9bb-4602-8d8a-0957bff9c35c None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:31.508941 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610785a-c9bb-4602-8d8a-0957bff9c35c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:31.509221 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610785a-c9bb-4602-8d8a-0957bff9c35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:31.519924 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cbd7d-3c2f-4a9b-8462-c002ce5274d4 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:31.541698 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-a610785a-c9bb-4602-8d8a-0957bff9c35c None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:31.542920 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a610785a-c9bb-4602-8d8a-0957bff9c35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:31.575821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74925db2-5d74-488b-8168-83fae1dea904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:31.576871 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74925db2-5d74-488b-8168-83fae1dea904 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:31.577388 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74925db2-5d74-488b-8168-83fae1dea904 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:31.577846 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74925db2-5d74-488b-8168-83fae1dea904 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:31.637362 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 89/187] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:31.638773 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097be3df-8521-49ee-b98a-25ebf9ef5b32 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:31.639091 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097be3df-8521-49ee-b98a-25ebf9ef5b32 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:31.639365 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097be3df-8521-49ee-b98a-25ebf9ef5b32 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:31.641184 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 90/188] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:31.642215 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db35752-8f69-438d-be4c-6fd67a9b85f6 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:31.642415 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db35752-8f69-438d-be4c-6fd67a9b85f6 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:31.642691 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db35752-8f69-438d-be4c-6fd67a9b85f6 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:31.644434 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 91/189] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:31.650142 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba72c34-ec4a-4c6a-9c6e-28fc7bf0c419 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:31.650421 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba72c34-ec4a-4c6a-9c6e-28fc7bf0c419 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:31.650702 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba72c34-ec4a-4c6a-9c6e-28fc7bf0c419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:31.668014 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-7ba72c34-ec4a-4c6a-9c6e-28fc7bf0c419 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:31.669235 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-7ba72c34-ec4a-4c6a-9c6e-28fc7bf0c419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:31.673832 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74925db2-5d74-488b-8168-83fae1dea904 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:31.675353 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74925db2-5d74-488b-8168-83fae1dea904 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:31.740085 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 92/190] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:31.741907 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9c349-59af-474a-8db6-9ee5e02e72fc None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:31.742412 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9c349-59af-474a-8db6-9ee5e02e72fc None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:31.742926 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9c349-59af-474a-8db6-9ee5e02e72fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:31.760660 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-a8f9c349-59af-474a-8db6-9ee5e02e72fc None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:31.761984 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a8f9c349-59af-474a-8db6-9ee5e02e72fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:31.792000 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 99/191] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:42:31.793210 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74925db2-5d74-488b-8168-83fae1dea904 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:31.834548 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 93/192] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:31.836895 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9c349-59af-474a-8db6-9ee5e02e72fc None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:31.892636 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74925db2-5d74-488b-8168-83fae1dea904 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:31.923725 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7c74a-ccf0-4cce-96b9-77db97331122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:31.924524 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7c74a-ccf0-4cce-96b9-77db97331122 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:31.924801 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7c74a-ccf0-4cce-96b9-77db97331122 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:31.925068 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7c74a-ccf0-4cce-96b9-77db97331122 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:31.927801 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9c349-59af-474a-8db6-9ee5e02e72fc None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:31.935780 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7c74a-ccf0-4cce-96b9-77db97331122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:31.943622 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-c6d7c74a-ccf0-4cce-96b9-77db97331122 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 23:42:31.944802 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 100/193] 10.222.0.24 () {56 vars in 1114 bytes} [Mon Apr 11 23:42:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:31.945569 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7c74a-ccf0-4cce-96b9-77db97331122 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:31.961094 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833e3d1-bba6-4615-be3d-05dd86c3a9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:31.961890 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833e3d1-bba6-4615-be3d-05dd86c3a9c2 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:31.962164 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833e3d1-bba6-4615-be3d-05dd86c3a9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:31.962430 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833e3d1-bba6-4615-be3d-05dd86c3a9c2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:31.972489 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833e3d1-bba6-4615-be3d-05dd86c3a9c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:31.979649 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-e833e3d1-bba6-4615-be3d-05dd86c3a9c2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 23:42:31.988565 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 94/194] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:31.988565 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833e3d1-bba6-4615-be3d-05dd86c3a9c2 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:32.039129 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7c74a-ccf0-4cce-96b9-77db97331122 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:32.070801 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7623d51-6c41-48c0-aee1-387540cad50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:32.071671 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7623d51-6c41-48c0-aee1-387540cad50e None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:32.071951 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7623d51-6c41-48c0-aee1-387540cad50e None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:32.072220 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7623d51-6c41-48c0-aee1-387540cad50e None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:32.073395 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7623d51-6c41-48c0-aee1-387540cad50e None admin] RBAC: Authorizing `identity:get_project(project_id=d87423bf072e41a69237bf58f5e967c0)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:32.074865 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7623d51-6c41-48c0-aee1-387540cad50e None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:32.076527 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 101/195] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:31 2022] GET /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0 => generated 302 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:32.077280 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7623d51-6c41-48c0-aee1-387540cad50e None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:32.077883 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833e3d1-bba6-4615-be3d-05dd86c3a9c2 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:32.109982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce098dd-b437-48db-91a2-aac9c59fbd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:32.110760 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce098dd-b437-48db-91a2-aac9c59fbd57 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:32.111070 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce098dd-b437-48db-91a2-aac9c59fbd57 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:32.111340 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce098dd-b437-48db-91a2-aac9c59fbd57 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:32.112507 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce098dd-b437-48db-91a2-aac9c59fbd57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:32.113939 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce098dd-b437-48db-91a2-aac9c59fbd57 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:32.116099 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 95/196] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:42:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:32.117957 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce098dd-b437-48db-91a2-aac9c59fbd57 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:32.173750 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7623d51-6c41-48c0-aee1-387540cad50e None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:32.205470 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05996a-7d53-4932-881b-e9df005d7692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:32.206121 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05996a-7d53-4932-881b-e9df005d7692 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:32.206405 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05996a-7d53-4932-881b-e9df005d7692 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:32.206672 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05996a-7d53-4932-881b-e9df005d7692 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:32.207444 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05996a-7d53-4932-881b-e9df005d7692 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:32.207743 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05996a-7d53-4932-881b-e9df005d7692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:32.209122 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05996a-7d53-4932-881b-e9df005d7692 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:32.210039 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce098dd-b437-48db-91a2-aac9c59fbd57 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:32.217005 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 102/197] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:42:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:32.217782 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05996a-7d53-4932-881b-e9df005d7692 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:32.242429 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc43dd7-718e-44d4-ac30-f55c6a221dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:32.243115 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc43dd7-718e-44d4-ac30-f55c6a221dbc None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:32.243391 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc43dd7-718e-44d4-ac30-f55c6a221dbc None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:32.243659 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc43dd7-718e-44d4-ac30-f55c6a221dbc None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:32.244395 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc43dd7-718e-44d4-ac30-f55c6a221dbc None admin] RBAC: Adding query filter params (name=reader) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:32.244696 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc43dd7-718e-44d4-ac30-f55c6a221dbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:32.246038 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc43dd7-718e-44d4-ac30-f55c6a221dbc None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:32.253625 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 96/198] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:32.258325 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc43dd7-718e-44d4-ac30-f55c6a221dbc None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:32.311249 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05996a-7d53-4932-881b-e9df005d7692 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:32.342122 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1eda1-2a7f-47e6-9a4b-640879d3dcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:32.342865 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1eda1-2a7f-47e6-9a4b-640879d3dcb8 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:32.343164 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1eda1-2a7f-47e6-9a4b-640879d3dcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:32.343440 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1eda1-2a7f-47e6-9a4b-640879d3dcb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:32.344296 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1eda1-2a7f-47e6-9a4b-640879d3dcb8 None admin] RBAC: Adding query filter params (role.id=c8affbefb4c5462a921650b24b13c80f, scope.project.id=d87423bf072e41a69237bf58f5e967c0, user.id=6f02f16a4cfb482490bd6f25caab1622) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:32.344604 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1eda1-2a7f-47e6-9a4b-640879d3dcb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:32.346045 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e1eda1-2a7f-47e6-9a4b-640879d3dcb8 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:32.348337 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc43dd7-718e-44d4-ac30-f55c6a221dbc None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:32.351770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 103/199] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:42:32 2022] GET /identity/v3/role_assignments?user.id=6f02f16a4cfb482490bd6f25caab1622&scope.project.id=d87423bf072e41a69237bf58f5e967c0&role.id=c8affbefb4c5462a921650b24b13c80f => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:32.352540 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1eda1-2a7f-47e6-9a4b-640879d3dcb8 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:32.383667 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a003b-8f86-4b3a-8177-8641b59e1d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:32.384332 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a003b-8f86-4b3a-8177-8641b59e1d52 None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:32.384613 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a003b-8f86-4b3a-8177-8641b59e1d52 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:32.385398 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666a003b-8f86-4b3a-8177-8641b59e1d52 None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:32.385853 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a003b-8f86-4b3a-8177-8641b59e1d52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:32.387511 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666a003b-8f86-4b3a-8177-8641b59e1d52 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:32.456060 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1eda1-2a7f-47e6-9a4b-640879d3dcb8 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:32.490713 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1e644-904d-42bc-a703-f7c75a6bc27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:32.491607 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1e644-904d-42bc-a703-f7c75a6bc27b None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:32.491879 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1e644-904d-42bc-a703-f7c75a6bc27b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:32.492145 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1e644-904d-42bc-a703-f7c75a6bc27b None admin] PATH_INFO: `/v3/users/6f02f16a4cfb482490bd6f25caab1622` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:32.493347 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1e644-904d-42bc-a703-f7c75a6bc27b None admin] RBAC: Authorizing `identity:get_user(user_id=6f02f16a4cfb482490bd6f25caab1622)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:32.494871 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d1e644-904d-42bc-a703-f7c75a6bc27b None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:32.496626 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 104/200] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:32 2022] GET /identity/v3/users/6f02f16a4cfb482490bd6f25caab1622 => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:32.496626 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1e644-904d-42bc-a703-f7c75a6bc27b None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:32.508568 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 97/201] 10.222.0.24 () {60 vars in 1132 bytes} [Mon Apr 11 23:42:32 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:42:32.510288 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a003b-8f86-4b3a-8177-8641b59e1d52 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:32.606114 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1e644-904d-42bc-a703-f7c75a6bc27b None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:32.641645 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a09879-0f69-4cb6-b57b-7b81da788d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:32.642443 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a09879-0f69-4cb6-b57b-7b81da788d97 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:32.642716 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a09879-0f69-4cb6-b57b-7b81da788d97 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:32.643017 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a09879-0f69-4cb6-b57b-7b81da788d97 None admin] PATH_INFO: `/v3/users/8cab219006a74de0a7569808bd60bee0` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:32.644297 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a09879-0f69-4cb6-b57b-7b81da788d97 None admin] RBAC: Authorizing `identity:get_user(user_id=8cab219006a74de0a7569808bd60bee0)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:32.646423 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a09879-0f69-4cb6-b57b-7b81da788d97 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:32.648272 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 105/202] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:32 2022] GET /identity/v3/users/8cab219006a74de0a7569808bd60bee0 => generated 289 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:32.653874 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a09879-0f69-4cb6-b57b-7b81da788d97 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:32.660762 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666a003b-8f86-4b3a-8177-8641b59e1d52 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:32.710729 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e5793-09b0-4a9b-ad4f-3139d790d824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:32.711920 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e5793-09b0-4a9b-ad4f-3139d790d824 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:32.712405 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e5793-09b0-4a9b-ad4f-3139d790d824 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:32.713042 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e5793-09b0-4a9b-ad4f-3139d790d824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:32.772035 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a09879-0f69-4cb6-b57b-7b81da788d97 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:32.809874 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eedf36-e8bf-46a4-b159-9864bc9eab73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:32.810538 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eedf36-e8bf-46a4-b159-9864bc9eab73 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:32.810806 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eedf36-e8bf-46a4-b159-9864bc9eab73 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:32.811790 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eedf36-e8bf-46a4-b159-9864bc9eab73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:32.811892 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e5793-09b0-4a9b-ad4f-3139d790d824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:32.813256 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e5793-09b0-4a9b-ad4f-3139d790d824 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:32.896637 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eedf36-e8bf-46a4-b159-9864bc9eab73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:32.898618 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eedf36-e8bf-46a4-b159-9864bc9eab73 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:32.945686 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 98/203] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:42:32.951431 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e5793-09b0-4a9b-ad4f-3139d790d824 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:33.006052 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 106/204] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 23:42:33.011356 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eedf36-e8bf-46a4-b159-9864bc9eab73 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:33.069300 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e5793-09b0-4a9b-ad4f-3139d790d824 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:33.105362 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0830d9-1464-4a7e-b22a-bf482d38caf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:33.106235 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0830d9-1464-4a7e-b22a-bf482d38caf6 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:33.106511 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0830d9-1464-4a7e-b22a-bf482d38caf6 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:33.106789 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0830d9-1464-4a7e-b22a-bf482d38caf6 None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:33.108046 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0830d9-1464-4a7e-b22a-bf482d38caf6 None admin] RBAC: Authorizing `identity:get_project(project_id=d87423bf072e41a69237bf58f5e967c0)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:33.109512 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0830d9-1464-4a7e-b22a-bf482d38caf6 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:33.111229 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 99/205] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:32 2022] GET /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:33.117546 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0830d9-1464-4a7e-b22a-bf482d38caf6 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:33.125447 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eedf36-e8bf-46a4-b159-9864bc9eab73 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:33.159071 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adddc23-57f4-4950-95b3-d2f1f9aa6c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:33.159841 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adddc23-57f4-4950-95b3-d2f1f9aa6c2b None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:33.160116 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adddc23-57f4-4950-95b3-d2f1f9aa6c2b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:33.160383 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adddc23-57f4-4950-95b3-d2f1f9aa6c2b None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:33.162111 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adddc23-57f4-4950-95b3-d2f1f9aa6c2b None admin] RBAC: Authorizing `identity:get_project(project_id=5563d83687534242a56eaa5054d6ed92)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:33.163642 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adddc23-57f4-4950-95b3-d2f1f9aa6c2b None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:33.165392 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 107/206] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:33 2022] GET /identity/v3/projects/5563d83687534242a56eaa5054d6ed92 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:33.171044 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adddc23-57f4-4950-95b3-d2f1f9aa6c2b None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:33.217565 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0830d9-1464-4a7e-b22a-bf482d38caf6 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:33.252668 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c031939-3773-41dc-9f9b-6ec99ecf01bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:33.253327 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c031939-3773-41dc-9f9b-6ec99ecf01bc None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:33.253605 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c031939-3773-41dc-9f9b-6ec99ecf01bc None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:33.253876 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c031939-3773-41dc-9f9b-6ec99ecf01bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:33.254742 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c031939-3773-41dc-9f9b-6ec99ecf01bc None admin] RBAC: Adding query filter params (role.id=f7b5f822a48e4e269ab53ce00a04194e, scope.project.id=d87423bf072e41a69237bf58f5e967c0, user.id=6f02f16a4cfb482490bd6f25caab1622) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:33.255078 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c031939-3773-41dc-9f9b-6ec99ecf01bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:33.256515 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c031939-3773-41dc-9f9b-6ec99ecf01bc None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:33.262550 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 100/207] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:42:33 2022] GET /identity/v3/role_assignments?user.id=6f02f16a4cfb482490bd6f25caab1622&scope.project.id=d87423bf072e41a69237bf58f5e967c0&role.id=f7b5f822a48e4e269ab53ce00a04194e => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:33.278101 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adddc23-57f4-4950-95b3-d2f1f9aa6c2b None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:33.317028 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b676ca-b443-4855-8d04-0c37e2b9c3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:33.317737 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b676ca-b443-4855-8d04-0c37e2b9c3cf None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:33.318013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b676ca-b443-4855-8d04-0c37e2b9c3cf None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:33.318278 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b676ca-b443-4855-8d04-0c37e2b9c3cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:33.319144 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b676ca-b443-4855-8d04-0c37e2b9c3cf None admin] RBAC: Adding query filter params (role.id=d970ab64b060491c919ed8a7cf36313c, scope.project.id=5563d83687534242a56eaa5054d6ed92, user.id=8cab219006a74de0a7569808bd60bee0) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:33.319451 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b676ca-b443-4855-8d04-0c37e2b9c3cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:33.320889 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b676ca-b443-4855-8d04-0c37e2b9c3cf None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:33.327006 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 108/208] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:42:33 2022] GET /identity/v3/role_assignments?user.id=8cab219006a74de0a7569808bd60bee0&scope.project.id=5563d83687534242a56eaa5054d6ed92&role.id=d970ab64b060491c919ed8a7cf36313c => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:34.839306 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf4c69-77ae-4d1c-961a-dbe537f26c09 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:34.840259 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf4c69-77ae-4d1c-961a-dbe537f26c09 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:34.840759 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf4c69-77ae-4d1c-961a-dbe537f26c09 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:34.842758 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 101/209] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:34.848095 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea5df4-9523-4f6f-ba6b-174604a4014b None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:34.849089 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea5df4-9523-4f6f-ba6b-174604a4014b None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:34.849272 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea5df4-9523-4f6f-ba6b-174604a4014b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:34.866017 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-a7ea5df4-9523-4f6f-ba6b-174604a4014b None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:34.867243 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-a7ea5df4-9523-4f6f-ba6b-174604a4014b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:34.933036 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 109/210] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:34.955020 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf4c69-77ae-4d1c-961a-dbe537f26c09 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:35.059459 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf4c69-77ae-4d1c-961a-dbe537f26c09 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:35.093563 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e03445-a702-4ad9-8a6f-9ee8149774cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:35.094354 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e03445-a702-4ad9-8a6f-9ee8149774cb None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:35.094629 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e03445-a702-4ad9-8a6f-9ee8149774cb None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:35.094920 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e03445-a702-4ad9-8a6f-9ee8149774cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:35.105161 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e03445-a702-4ad9-8a6f-9ee8149774cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:35.112107 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-61e03445-a702-4ad9-8a6f-9ee8149774cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:42:35.113504 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 102/211] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:42:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:35.119503 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea5df4-9523-4f6f-ba6b-174604a4014b None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:35.177162 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7044601-2734-4d66-bb61-6010657c7aae None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:35.177776 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7044601-2734-4d66-bb61-6010657c7aae None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:35.178271 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7044601-2734-4d66-bb61-6010657c7aae None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:35.180372 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 103/212] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:42:35.185517 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ca0ff-6dc2-4613-b6b9-04edf31753dc None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:35.186041 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ca0ff-6dc2-4613-b6b9-04edf31753dc None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:35.186520 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ca0ff-6dc2-4613-b6b9-04edf31753dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:35.204115 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-115ca0ff-6dc2-4613-b6b9-04edf31753dc None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:35.205628 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-115ca0ff-6dc2-4613-b6b9-04edf31753dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:35.217221 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea5df4-9523-4f6f-ba6b-174604a4014b None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:35.258158 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeeb00f-dedb-4a71-b462-3613450aa1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:35.258853 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeeb00f-dedb-4a71-b462-3613450aa1a0 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:35.259136 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeeb00f-dedb-4a71-b462-3613450aa1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:35.259404 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeeb00f-dedb-4a71-b462-3613450aa1a0 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:35.260156 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeeb00f-dedb-4a71-b462-3613450aa1a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:35.260454 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeeb00f-dedb-4a71-b462-3613450aa1a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:35.261821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeeb00f-dedb-4a71-b462-3613450aa1a0 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:35.273027 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 110/213] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:35.276430 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 104/214] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:42:35.282992 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeeb00f-dedb-4a71-b462-3613450aa1a0 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:35.300550 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ca0ff-6dc2-4613-b6b9-04edf31753dc None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:35.396008 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeeb00f-dedb-4a71-b462-3613450aa1a0 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:35.400453 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ca0ff-6dc2-4613-b6b9-04edf31753dc None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:35.429867 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5016195-875f-4a80-94f2-c1f0ed8d890f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:35.430781 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5016195-875f-4a80-94f2-c1f0ed8d890f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:35.431139 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5016195-875f-4a80-94f2-c1f0ed8d890f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:35.431411 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5016195-875f-4a80-94f2-c1f0ed8d890f None admin] PATH_INFO: `/v3/users/6f02f16a4cfb482490bd6f25caab1622` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:35.432589 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5016195-875f-4a80-94f2-c1f0ed8d890f None admin] RBAC: Authorizing `identity:get_user(user_id=6f02f16a4cfb482490bd6f25caab1622)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:35.433181 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbfb59-7f8d-4673-9072-de35150bac7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:35.433972 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbfb59-7f8d-4673-9072-de35150bac7f None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:35.434063 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5016195-875f-4a80-94f2-c1f0ed8d890f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:35.434249 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbfb59-7f8d-4673-9072-de35150bac7f None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:35.434516 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbfb59-7f8d-4673-9072-de35150bac7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:35.435760 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 111/215] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:35 2022] GET /identity/v3/users/6f02f16a4cfb482490bd6f25caab1622 => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:35.440184 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0e3a1-e1c6-4253-a18c-d12c636cabd9 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:35.440184 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0e3a1-e1c6-4253-a18c-d12c636cabd9 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:35.440184 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0e3a1-e1c6-4253-a18c-d12c636cabd9 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:35.440184 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 112/216] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:35.440872 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0e3a1-e1c6-4253-a18c-d12c636cabd9 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:35.451888 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbfb59-7f8d-4673-9072-de35150bac7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:35.459126 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-2ddbfb59-7f8d-4673-9072-de35150bac7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 23:42:35.460491 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 105/217] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:42:35.462929 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70b654-f30a-4e8e-aadd-bb6a00f5140f None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:35.462929 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70b654-f30a-4e8e-aadd-bb6a00f5140f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:35.462929 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70b654-f30a-4e8e-aadd-bb6a00f5140f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:35.479273 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-6d70b654-f30a-4e8e-aadd-bb6a00f5140f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:35.480494 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-6d70b654-f30a-4e8e-aadd-bb6a00f5140f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:35.541937 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0e3a1-e1c6-4253-a18c-d12c636cabd9 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:35.553915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 106/218] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:35.554769 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70b654-f30a-4e8e-aadd-bb6a00f5140f None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:35.587493 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14078b5-ecfc-4603-84e1-4a809be7168c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:35.588601 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14078b5-ecfc-4603-84e1-4a809be7168c None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:35.588886 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14078b5-ecfc-4603-84e1-4a809be7168c None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:35.589153 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14078b5-ecfc-4603-84e1-4a809be7168c None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:35.590325 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14078b5-ecfc-4603-84e1-4a809be7168c None admin] RBAC: Authorizing `identity:get_project(project_id=d87423bf072e41a69237bf58f5e967c0)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:35.591870 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14078b5-ecfc-4603-84e1-4a809be7168c None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:35.598218 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 113/219] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:35 2022] GET /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:35.599672 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14078b5-ecfc-4603-84e1-4a809be7168c None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:35.660796 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70b654-f30a-4e8e-aadd-bb6a00f5140f None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:35.694143 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14078b5-ecfc-4603-84e1-4a809be7168c None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:35.697746 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61051e-1448-489f-895f-85c86a6f8ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:35.698466 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61051e-1448-489f-895f-85c86a6f8ff5 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:35.698802 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61051e-1448-489f-895f-85c86a6f8ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:35.699111 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61051e-1448-489f-895f-85c86a6f8ff5 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:35.699884 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61051e-1448-489f-895f-85c86a6f8ff5 None admin] RBAC: Adding query filter params (name=member) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:35.700187 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61051e-1448-489f-895f-85c86a6f8ff5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:35.701608 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d61051e-1448-489f-895f-85c86a6f8ff5 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:35.710028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 107/220] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:35.710028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61051e-1448-489f-895f-85c86a6f8ff5 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:35.727078 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadccaca-137c-4508-96e9-4a74add5613a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:35.727855 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadccaca-137c-4508-96e9-4a74add5613a None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:35.728127 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadccaca-137c-4508-96e9-4a74add5613a None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:35.728391 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadccaca-137c-4508-96e9-4a74add5613a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:35.729634 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadccaca-137c-4508-96e9-4a74add5613a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:35.731109 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadccaca-137c-4508-96e9-4a74add5613a None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:35.732978 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 114/221] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:42:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:35.733950 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf12a4-b26a-4fba-8a11-ae4b7878a132 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:35.734237 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf12a4-b26a-4fba-8a11-ae4b7878a132 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:35.734512 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf12a4-b26a-4fba-8a11-ae4b7878a132 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:35.736191 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 115/222] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:35.736872 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf12a4-b26a-4fba-8a11-ae4b7878a132 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:35.813310 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d61051e-1448-489f-895f-85c86a6f8ff5 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:35.831684 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf12a4-b26a-4fba-8a11-ae4b7878a132 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:35.844477 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b8189-012c-44f5-8419-c7a38a0fe9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:35.845346 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b8189-012c-44f5-8419-c7a38a0fe9f1 None admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:35.845621 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b8189-012c-44f5-8419-c7a38a0fe9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:35.845887 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b8189-012c-44f5-8419-c7a38a0fe9f1 None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0/users/6f02f16a4cfb482490bd6f25caab1622/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:35.847847 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b8189-012c-44f5-8419-c7a38a0fe9f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d87423bf072e41a69237bf58f5e967c0, user_id=6f02f16a4cfb482490bd6f25caab1622, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:35.849828 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b8189-012c-44f5-8419-c7a38a0fe9f1 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:35.864072 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645d039-bf68-4ad4-bea7-d5422728a9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:35.864928 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645d039-bf68-4ad4-bea7-d5422728a9b3 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:35.865202 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645d039-bf68-4ad4-bea7-d5422728a9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:35.865467 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645d039-bf68-4ad4-bea7-d5422728a9b3 None admin] PATH_INFO: `/v3/users/49bddf109cab4c49a1d396aae69a079a` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:35.878033 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645d039-bf68-4ad4-bea7-d5422728a9b3 None admin] RBAC: Authorizing `identity:get_user(user_id=49bddf109cab4c49a1d396aae69a079a)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:35.879489 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645d039-bf68-4ad4-bea7-d5422728a9b3 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:35.881246 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 116/223] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:35 2022] GET /identity/v3/users/49bddf109cab4c49a1d396aae69a079a => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:35.882063 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645d039-bf68-4ad4-bea7-d5422728a9b3 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:35.915589 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 108/224] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:42:35 2022] PUT /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0/users/6f02f16a4cfb482490bd6f25caab1622/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:42:35.926651 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306904a3-dbfc-464f-bcc1-6499e04c9c88 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:35.927125 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306904a3-dbfc-464f-bcc1-6499e04c9c88 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:35.927278 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306904a3-dbfc-464f-bcc1-6499e04c9c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:35.945870 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-306904a3-dbfc-464f-bcc1-6499e04c9c88 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:35.947302 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-306904a3-dbfc-464f-bcc1-6499e04c9c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:35.985529 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645d039-bf68-4ad4-bea7-d5422728a9b3 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:36.019635 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 109/225] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:36.021538 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306904a3-dbfc-464f-bcc1-6499e04c9c88 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:36.032954 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3849f-c76f-48a0-8eec-1ef40559f7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:36.033710 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3849f-c76f-48a0-8eec-1ef40559f7e8 None admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:36.034035 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3849f-c76f-48a0-8eec-1ef40559f7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:36.034310 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb3849f-c76f-48a0-8eec-1ef40559f7e8 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:36.035297 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3849f-c76f-48a0-8eec-1ef40559f7e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:36.036803 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb3849f-c76f-48a0-8eec-1ef40559f7e8 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:36.124387 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306904a3-dbfc-464f-bcc1-6499e04c9c88 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:36.127823 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 117/226] 10.222.0.24 () {60 vars in 1132 bytes} [Mon Apr 11 23:42:35 2022] POST /identity/v3/users => generated 297 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:42:36.128740 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3849f-c76f-48a0-8eec-1ef40559f7e8 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:36.162526 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac4976-72e6-4a33-9c94-2ecb46cf5dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:36.163228 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac4976-72e6-4a33-9c94-2ecb46cf5dc0 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:36.163585 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac4976-72e6-4a33-9c94-2ecb46cf5dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:36.163780 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac4976-72e6-4a33-9c94-2ecb46cf5dc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:36.234852 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb3849f-c76f-48a0-8eec-1ef40559f7e8 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:36.244857 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac4976-72e6-4a33-9c94-2ecb46cf5dc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:36.247133 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac4976-72e6-4a33-9c94-2ecb46cf5dc0 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:36.271545 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc328f4b-3672-463c-a02d-f472383d15e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:36.272690 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc328f4b-3672-463c-a02d-f472383d15e1 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:36.272804 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc328f4b-3672-463c-a02d-f472383d15e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:36.273076 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc328f4b-3672-463c-a02d-f472383d15e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:36.284701 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc328f4b-3672-463c-a02d-f472383d15e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:36.292505 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-fc328f4b-3672-463c-a02d-f472383d15e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 23:42:36.294872 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 118/227] 10.222.0.24 () {56 vars in 1114 bytes} [Mon Apr 11 23:42:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:36.299820 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc328f4b-3672-463c-a02d-f472383d15e1 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:36.365956 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 110/228] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:42:36.371617 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac4976-72e6-4a33-9c94-2ecb46cf5dc0 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:36.426252 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc328f4b-3672-463c-a02d-f472383d15e1 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:36.474735 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930da054-4bf4-4aeb-853d-95d599261dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:36.475621 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930da054-4bf4-4aeb-853d-95d599261dca None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:36.476183 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930da054-4bf4-4aeb-853d-95d599261dca None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:36.476463 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930da054-4bf4-4aeb-853d-95d599261dca None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:36.477228 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930da054-4bf4-4aeb-853d-95d599261dca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:36.477533 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930da054-4bf4-4aeb-853d-95d599261dca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:36.478979 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930da054-4bf4-4aeb-853d-95d599261dca None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:36.489775 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 119/229] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:42:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:36.495272 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930da054-4bf4-4aeb-853d-95d599261dca None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:36.497775 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac4976-72e6-4a33-9c94-2ecb46cf5dc0 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:36.539922 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3e5a8-8c26-442a-b690-5ea89ac69bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:36.540801 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3e5a8-8c26-442a-b690-5ea89ac69bdb None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:36.541085 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3e5a8-8c26-442a-b690-5ea89ac69bdb None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:36.541357 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3e5a8-8c26-442a-b690-5ea89ac69bdb None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:36.542576 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3e5a8-8c26-442a-b690-5ea89ac69bdb None admin] RBAC: Authorizing `identity:get_project(project_id=d87423bf072e41a69237bf58f5e967c0)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:36.544080 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3e5a8-8c26-442a-b690-5ea89ac69bdb None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:36.545985 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 111/230] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:36 2022] GET /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:36.551482 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3e5a8-8c26-442a-b690-5ea89ac69bdb None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:36.622098 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930da054-4bf4-4aeb-853d-95d599261dca None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:36.658713 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3e5a8-8c26-442a-b690-5ea89ac69bdb None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:36.665405 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29be4f-d10c-4281-a8c9-7da0a25c818d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:36.666292 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29be4f-d10c-4281-a8c9-7da0a25c818d None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:36.666570 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29be4f-d10c-4281-a8c9-7da0a25c818d None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:36.666859 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa29be4f-d10c-4281-a8c9-7da0a25c818d None admin] PATH_INFO: `/v3/users/6f02f16a4cfb482490bd6f25caab1622` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:36.668105 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29be4f-d10c-4281-a8c9-7da0a25c818d None admin] RBAC: Authorizing `identity:get_user(user_id=6f02f16a4cfb482490bd6f25caab1622)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:36.669563 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa29be4f-d10c-4281-a8c9-7da0a25c818d None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:36.671239 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 120/231] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:36 2022] GET /identity/v3/users/6f02f16a4cfb482490bd6f25caab1622 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:36.677832 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29be4f-d10c-4281-a8c9-7da0a25c818d None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:36.700439 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dca3d5-0204-4a59-b45a-c38241207044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:36.701555 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dca3d5-0204-4a59-b45a-c38241207044 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:36.701838 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dca3d5-0204-4a59-b45a-c38241207044 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:36.702390 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dca3d5-0204-4a59-b45a-c38241207044 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:36.703426 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dca3d5-0204-4a59-b45a-c38241207044 None admin] RBAC: Adding query filter params (role.id=d0f74491c28e4d1094a60391d71c2246, scope.project.id=d87423bf072e41a69237bf58f5e967c0, user.id=49bddf109cab4c49a1d396aae69a079a) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:36.703742 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dca3d5-0204-4a59-b45a-c38241207044 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:36.705824 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dca3d5-0204-4a59-b45a-c38241207044 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:36.713270 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 112/232] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:42:36 2022] GET /identity/v3/role_assignments?user.id=49bddf109cab4c49a1d396aae69a079a&scope.project.id=d87423bf072e41a69237bf58f5e967c0&role.id=d0f74491c28e4d1094a60391d71c2246 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:36.801317 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa29be4f-d10c-4281-a8c9-7da0a25c818d None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:36.848155 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8858bb-b38b-4ac4-841e-b2caf7cae3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:36.849577 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8858bb-b38b-4ac4-841e-b2caf7cae3aa None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:36.849854 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8858bb-b38b-4ac4-841e-b2caf7cae3aa None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:36.850126 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8858bb-b38b-4ac4-841e-b2caf7cae3aa None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:36.851380 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8858bb-b38b-4ac4-841e-b2caf7cae3aa None admin] RBAC: Authorizing `identity:get_project(project_id=d87423bf072e41a69237bf58f5e967c0)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:36.852833 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8858bb-b38b-4ac4-841e-b2caf7cae3aa None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:36.854860 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 121/233] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:36 2022] GET /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:36.860656 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dca3d5-0204-4a59-b45a-c38241207044 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:36.967199 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dca3d5-0204-4a59-b45a-c38241207044 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:37.002778 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b7768-8c64-4b4d-aefd-dfe03435a899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:37.003700 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b7768-8c64-4b4d-aefd-dfe03435a899 None admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:37.003973 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b7768-8c64-4b4d-aefd-dfe03435a899 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:37.004239 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b7768-8c64-4b4d-aefd-dfe03435a899 None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0/users/6f02f16a4cfb482490bd6f25caab1622/roles/f7b5f822a48e4e269ab53ce00a04194e` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:37.013238 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b7768-8c64-4b4d-aefd-dfe03435a899 None admin] RBAC: Authorizing `identity:create_grant(project_id=d87423bf072e41a69237bf58f5e967c0, user_id=6f02f16a4cfb482490bd6f25caab1622, role_id=f7b5f822a48e4e269ab53ce00a04194e)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:37.014728 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b7768-8c64-4b4d-aefd-dfe03435a899 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:37.198932 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 113/234] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:42:36 2022] PUT /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0/users/6f02f16a4cfb482490bd6f25caab1622/roles/f7b5f822a48e4e269ab53ce00a04194e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:42:38.652111 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5d94d-1603-4fcf-bc04-37de55a47b1d None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:38.653148 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5d94d-1603-4fcf-bc04-37de55a47b1d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:38.653662 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5d94d-1603-4fcf-bc04-37de55a47b1d None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:38.656154 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 122/235] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:38.662166 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7ead5-5edc-4d86-96d8-7ff40a873575 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:38.663127 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7ead5-5edc-4d86-96d8-7ff40a873575 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:38.663606 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7ead5-5edc-4d86-96d8-7ff40a873575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:38.687235 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-c7d7ead5-5edc-4d86-96d8-7ff40a873575 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:38.688750 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-c7d7ead5-5edc-4d86-96d8-7ff40a873575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:38.781373 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 114/236] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:38.825016 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5d94d-1603-4fcf-bc04-37de55a47b1d None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:38.947712 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5d94d-1603-4fcf-bc04-37de55a47b1d None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:38.981753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cdca0-5983-4e96-a0f1-760bf0b15eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:38.982602 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cdca0-5983-4e96-a0f1-760bf0b15eca None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:38.982907 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cdca0-5983-4e96-a0f1-760bf0b15eca None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:38.983227 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cdca0-5983-4e96-a0f1-760bf0b15eca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:38.993485 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cdca0-5983-4e96-a0f1-760bf0b15eca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:39.000559 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-be5cdca0-5983-4e96-a0f1-760bf0b15eca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:42:39.002125 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 123/237] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:42:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:39.008266 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7ead5-5edc-4d86-96d8-7ff40a873575 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:39.077844 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3309c-5a8a-422d-8d34-c63192084a7b None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:39.078123 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3309c-5a8a-422d-8d34-c63192084a7b None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:39.078661 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3309c-5a8a-422d-8d34-c63192084a7b None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:39.080971 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 124/238] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:39.092416 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5231e41-d911-4afb-ba02-7a5505da8dcd None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:39.093026 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5231e41-d911-4afb-ba02-7a5505da8dcd None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:39.093492 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5231e41-d911-4afb-ba02-7a5505da8dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:39.119292 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-d5231e41-d911-4afb-ba02-7a5505da8dcd None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:39.121417 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d5231e41-d911-4afb-ba02-7a5505da8dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:39.186724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7ead5-5edc-4d86-96d8-7ff40a873575 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:39.251478 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 125/239] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:42:39.263569 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87596bc8-fc8e-4340-b95a-e9f75753dbbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:39.264263 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87596bc8-fc8e-4340-b95a-e9f75753dbbd None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:39.264545 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87596bc8-fc8e-4340-b95a-e9f75753dbbd None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:39.264821 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87596bc8-fc8e-4340-b95a-e9f75753dbbd None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:39.265586 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87596bc8-fc8e-4340-b95a-e9f75753dbbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:39.265891 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87596bc8-fc8e-4340-b95a-e9f75753dbbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:39.267301 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87596bc8-fc8e-4340-b95a-e9f75753dbbd None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:39.277037 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5231e41-d911-4afb-ba02-7a5505da8dcd None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:39.282321 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 115/240] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:39.287895 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87596bc8-fc8e-4340-b95a-e9f75753dbbd None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:39.378656 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5231e41-d911-4afb-ba02-7a5505da8dcd None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:39.386955 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87596bc8-fc8e-4340-b95a-e9f75753dbbd None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:39.414292 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694e644-1430-423a-83c7-6a13e0237c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:39.415404 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694e644-1430-423a-83c7-6a13e0237c14 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:39.415859 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694e644-1430-423a-83c7-6a13e0237c14 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:39.416327 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694e644-1430-423a-83c7-6a13e0237c14 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:39.427380 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694e644-1430-423a-83c7-6a13e0237c14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:39.428558 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e623b6-9fef-41f4-ac63-c9dcf1172076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:39.429449 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e623b6-9fef-41f4-ac63-c9dcf1172076 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:39.429724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e623b6-9fef-41f4-ac63-c9dcf1172076 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:39.429993 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e623b6-9fef-41f4-ac63-c9dcf1172076 None admin] PATH_INFO: `/v3/users/6f02f16a4cfb482490bd6f25caab1622` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:39.431226 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e623b6-9fef-41f4-ac63-c9dcf1172076 None admin] RBAC: Authorizing `identity:get_user(user_id=6f02f16a4cfb482490bd6f25caab1622)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:39.432653 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e623b6-9fef-41f4-ac63-c9dcf1172076 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:39.434552 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 116/241] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:39 2022] GET /identity/v3/users/6f02f16a4cfb482490bd6f25caab1622 => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:39.436246 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-7694e644-1430-423a-83c7-6a13e0237c14 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 23:42:39.437693 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 126/242] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:42:39.440143 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e623b6-9fef-41f4-ac63-c9dcf1172076 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:39.443723 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb663d-0ac4-4b6c-988d-010372f46383 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:39.444188 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb663d-0ac4-4b6c-988d-010372f46383 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:39.444627 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb663d-0ac4-4b6c-988d-010372f46383 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:39.446554 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 127/243] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:42:39.447450 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb663d-0ac4-4b6c-988d-010372f46383 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:39.553597 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e623b6-9fef-41f4-ac63-c9dcf1172076 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:39.562632 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fb663d-0ac4-4b6c-988d-010372f46383 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:39.587487 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86ae53-ea0c-4a4f-a9fa-d4adaabd75c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:39.588370 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86ae53-ea0c-4a4f-a9fa-d4adaabd75c3 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:39.588654 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86ae53-ea0c-4a4f-a9fa-d4adaabd75c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:39.588929 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86ae53-ea0c-4a4f-a9fa-d4adaabd75c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:39.597561 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85f2a8-213d-4436-a949-b22482884e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:39.598032 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85f2a8-213d-4436-a949-b22482884e1a None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:39.598308 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85f2a8-213d-4436-a949-b22482884e1a None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:39.599179 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85f2a8-213d-4436-a949-b22482884e1a None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:39.600015 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85f2a8-213d-4436-a949-b22482884e1a None admin] RBAC: Adding query filter params (name=reader) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:39.600222 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85f2a8-213d-4436-a949-b22482884e1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:39.601605 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85f2a8-213d-4436-a949-b22482884e1a None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:39.609980 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 128/244] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:39.611346 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad54447-3c5c-41ac-b5ee-a1f040f55cc1 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:39.611637 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad54447-3c5c-41ac-b5ee-a1f040f55cc1 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:39.611906 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad54447-3c5c-41ac-b5ee-a1f040f55cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:39.627282 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-cad54447-3c5c-41ac-b5ee-a1f040f55cc1 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:39.628445 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-cad54447-3c5c-41ac-b5ee-a1f040f55cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:39.655901 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86ae53-ea0c-4a4f-a9fa-d4adaabd75c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:39.657357 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e86ae53-ea0c-4a4f-a9fa-d4adaabd75c3 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:39.692625 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 129/245] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:39.704234 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c18d4-f2b8-4618-9cad-68b13ddd5ecf None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:39.704513 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c18d4-f2b8-4618-9cad-68b13ddd5ecf None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:39.704795 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c18d4-f2b8-4618-9cad-68b13ddd5ecf None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:39.710878 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 130/246] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:39 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:39.710878 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c18d4-f2b8-4618-9cad-68b13ddd5ecf None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:39.762517 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 117/247] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:42:39.763911 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d98606-1a90-4799-afd5-61d1f2540326 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:39.764483 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d98606-1a90-4799-afd5-61d1f2540326 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:39.764926 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d98606-1a90-4799-afd5-61d1f2540326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:39.781496 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-11d98606-1a90-4799-afd5-61d1f2540326 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:39.782655 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-11d98606-1a90-4799-afd5-61d1f2540326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:39.831131 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c18d4-f2b8-4618-9cad-68b13ddd5ecf None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:39.858861 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 118/248] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:39.858861 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d98606-1a90-4799-afd5-61d1f2540326 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:39.866819 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaa103-e1aa-4b32-8347-04fa714fec63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:39.867717 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaa103-e1aa-4b32-8347-04fa714fec63 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:39.868001 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaa103-e1aa-4b32-8347-04fa714fec63 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:39.868278 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaa103-e1aa-4b32-8347-04fa714fec63 None admin] PATH_INFO: `/v3/users/5d96af99a9154a55a1d296894c835326` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:39.882600 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beaa103-e1aa-4b32-8347-04fa714fec63 None admin] RBAC: Authorizing `identity:get_user(user_id=5d96af99a9154a55a1d296894c835326)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:39.884100 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beaa103-e1aa-4b32-8347-04fa714fec63 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:39.885828 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 131/249] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:39 2022] GET /identity/v3/users/5d96af99a9154a55a1d296894c835326 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:39.886596 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaa103-e1aa-4b32-8347-04fa714fec63 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:39.969221 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d98606-1a90-4799-afd5-61d1f2540326 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:39.981416 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaa103-e1aa-4b32-8347-04fa714fec63 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:40.010617 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88840b9c-9020-4fb3-8ab4-b78370248ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:40.011444 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88840b9c-9020-4fb3-8ab4-b78370248ddb None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:40.011722 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88840b9c-9020-4fb3-8ab4-b78370248ddb None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:40.011992 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88840b9c-9020-4fb3-8ab4-b78370248ddb None admin] PATH_INFO: `/v3/roles/member` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:40.014323 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bc098-4f52-4dcd-99f4-bb4b254f461d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:40.015203 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bc098-4f52-4dcd-99f4-bb4b254f461d None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:40.015482 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bc098-4f52-4dcd-99f4-bb4b254f461d None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:40.015750 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71bc098-4f52-4dcd-99f4-bb4b254f461d None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:40.016942 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71bc098-4f52-4dcd-99f4-bb4b254f461d None admin] RBAC: Authorizing `identity:get_project(project_id=d87423bf072e41a69237bf58f5e967c0)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:40.018377 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71bc098-4f52-4dcd-99f4-bb4b254f461d None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:40.020910 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 132/250] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:39 2022] GET /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0 => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:40.021443 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bc098-4f52-4dcd-99f4-bb4b254f461d None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:40.022953 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88840b9c-9020-4fb3-8ab4-b78370248ddb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:40.031435 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-88840b9c-9020-4fb3-8ab4-b78370248ddb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 23:42:40.032830 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 119/251] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:40.033769 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88840b9c-9020-4fb3-8ab4-b78370248ddb None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:40.136060 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71bc098-4f52-4dcd-99f4-bb4b254f461d None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:40.154919 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88840b9c-9020-4fb3-8ab4-b78370248ddb None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:40.169983 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807acd4-e82b-4a91-995f-85bf54947dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:40.170771 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807acd4-e82b-4a91-995f-85bf54947dcc None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:40.171076 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807acd4-e82b-4a91-995f-85bf54947dcc None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:40.171349 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807acd4-e82b-4a91-995f-85bf54947dcc None admin] PATH_INFO: `/v3/domains/default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:40.172508 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807acd4-e82b-4a91-995f-85bf54947dcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:40.173953 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807acd4-e82b-4a91-995f-85bf54947dcc None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:40.175586 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 133/252] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:42:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:40.181375 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807acd4-e82b-4a91-995f-85bf54947dcc None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:40.187835 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a7f47-5253-4707-8ad3-948b180159fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:40.188478 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a7f47-5253-4707-8ad3-948b180159fd None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:40.188749 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a7f47-5253-4707-8ad3-948b180159fd None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:40.189021 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a7f47-5253-4707-8ad3-948b180159fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:40.253683 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a7f47-5253-4707-8ad3-948b180159fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:40.255738 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501a7f47-5253-4707-8ad3-948b180159fd None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:40.274578 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807acd4-e82b-4a91-995f-85bf54947dcc None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:40.306882 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41261d3d-170e-43f4-b113-c65b4b1e5f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:40.307510 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41261d3d-170e-43f4-b113-c65b4b1e5f25 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:40.307790 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41261d3d-170e-43f4-b113-c65b4b1e5f25 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:40.308056 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41261d3d-170e-43f4-b113-c65b4b1e5f25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:40.308878 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41261d3d-170e-43f4-b113-c65b4b1e5f25 None admin] RBAC: Adding query filter params (role.id=c8affbefb4c5462a921650b24b13c80f, scope.project.id=d87423bf072e41a69237bf58f5e967c0, user.id=6f02f16a4cfb482490bd6f25caab1622) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:40.309180 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41261d3d-170e-43f4-b113-c65b4b1e5f25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:40.310602 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41261d3d-170e-43f4-b113-c65b4b1e5f25 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:40.316075 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 134/253] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:42:40 2022] GET /identity/v3/role_assignments?user.id=6f02f16a4cfb482490bd6f25caab1622&scope.project.id=d87423bf072e41a69237bf58f5e967c0&role.id=c8affbefb4c5462a921650b24b13c80f => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:40.316831 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41261d3d-170e-43f4-b113-c65b4b1e5f25 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:40.349212 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 120/254] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:42:40.350071 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a7f47-5253-4707-8ad3-948b180159fd None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:40.429097 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41261d3d-170e-43f4-b113-c65b4b1e5f25 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:40.463874 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb25f0-d718-4c48-8c32-7c45446d5111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:40.464545 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb25f0-d718-4c48-8c32-7c45446d5111 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:40.464760 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a7f47-5253-4707-8ad3-948b180159fd None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:40.464861 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb25f0-d718-4c48-8c32-7c45446d5111 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:40.465074 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb25f0-d718-4c48-8c32-7c45446d5111 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:40.465825 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb25f0-d718-4c48-8c32-7c45446d5111 None admin] RBAC: Adding query filter params (name=member) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:40.466235 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb25f0-d718-4c48-8c32-7c45446d5111 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:40.467657 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb25f0-d718-4c48-8c32-7c45446d5111 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:40.477845 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 135/255] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:40.479066 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0e8d8-ae0d-4fb7-a2a8-00b27c956c01 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:40.479351 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0e8d8-ae0d-4fb7-a2a8-00b27c956c01 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:40.479622 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0e8d8-ae0d-4fb7-a2a8-00b27c956c01 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:40.482026 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 136/256] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:40.483523 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0e8d8-ae0d-4fb7-a2a8-00b27c956c01 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:40.507405 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72857fb6-6256-48f1-bfcf-539bda528b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:40.508435 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72857fb6-6256-48f1-bfcf-539bda528b40 None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:40.508853 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72857fb6-6256-48f1-bfcf-539bda528b40 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:40.509284 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72857fb6-6256-48f1-bfcf-539bda528b40 None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:40.510127 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72857fb6-6256-48f1-bfcf-539bda528b40 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:40.511737 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72857fb6-6256-48f1-bfcf-539bda528b40 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:40.587280 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 121/257] 10.222.0.24 () {60 vars in 1132 bytes} [Mon Apr 11 23:42:40 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:42:40.588008 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0e8d8-ae0d-4fb7-a2a8-00b27c956c01 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:40.588369 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72857fb6-6256-48f1-bfcf-539bda528b40 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:40.627991 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66124a51-3673-434e-a8e0-450e195b10cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:40.628862 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66124a51-3673-434e-a8e0-450e195b10cf None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:40.629141 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66124a51-3673-434e-a8e0-450e195b10cf None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:40.629414 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66124a51-3673-434e-a8e0-450e195b10cf None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:40.630934 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66124a51-3673-434e-a8e0-450e195b10cf None admin] RBAC: Authorizing `identity:get_project(project_id=d87423bf072e41a69237bf58f5e967c0)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:40.632456 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66124a51-3673-434e-a8e0-450e195b10cf None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:40.639178 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 137/258] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:40 2022] GET /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:40.639178 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bd7f6-8dfb-4435-bd9a-c7a4051aaf9d None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:40.639178 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bd7f6-8dfb-4435-bd9a-c7a4051aaf9d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:40.639178 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044bd7f6-8dfb-4435-bd9a-c7a4051aaf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:40.655638 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-044bd7f6-8dfb-4435-bd9a-c7a4051aaf9d None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:40.656850 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-044bd7f6-8dfb-4435-bd9a-c7a4051aaf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:40.700212 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72857fb6-6256-48f1-bfcf-539bda528b40 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:40.727202 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 138/259] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:40.728175 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bd7f6-8dfb-4435-bd9a-c7a4051aaf9d None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:40.743093 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65db1f2-1787-46ed-9632-1445303cc566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:40.744420 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65db1f2-1787-46ed-9632-1445303cc566 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:40.744936 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65db1f2-1787-46ed-9632-1445303cc566 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:40.745399 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65db1f2-1787-46ed-9632-1445303cc566 None admin] PATH_INFO: `/v3/users/49bddf109cab4c49a1d396aae69a079a` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:40.746989 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65db1f2-1787-46ed-9632-1445303cc566 None admin] RBAC: Authorizing `identity:get_user(user_id=49bddf109cab4c49a1d396aae69a079a)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:40.748856 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65db1f2-1787-46ed-9632-1445303cc566 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:40.755624 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 122/260] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:40 2022] GET /identity/v3/users/49bddf109cab4c49a1d396aae69a079a => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:40.756939 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65db1f2-1787-46ed-9632-1445303cc566 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:40.831942 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044bd7f6-8dfb-4435-bd9a-c7a4051aaf9d None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:40.868674 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d3f97-1c41-40bd-8d14-fa518bb9885d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:40.869330 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d3f97-1c41-40bd-8d14-fa518bb9885d None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:40.869601 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d3f97-1c41-40bd-8d14-fa518bb9885d None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:40.869870 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9d3f97-1c41-40bd-8d14-fa518bb9885d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:40.870697 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d3f97-1c41-40bd-8d14-fa518bb9885d None admin] RBAC: Adding query filter params (role.id=d970ab64b060491c919ed8a7cf36313c, scope.project.id=d87423bf072e41a69237bf58f5e967c0, user.id=5d96af99a9154a55a1d296894c835326) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:40.871173 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d3f97-1c41-40bd-8d14-fa518bb9885d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:40.872452 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9d3f97-1c41-40bd-8d14-fa518bb9885d None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:40.877837 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 139/261] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:42:40 2022] GET /identity/v3/role_assignments?user.id=5d96af99a9154a55a1d296894c835326&scope.project.id=d87423bf072e41a69237bf58f5e967c0&role.id=d970ab64b060491c919ed8a7cf36313c => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:40.878630 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d3f97-1c41-40bd-8d14-fa518bb9885d None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:40.884744 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65db1f2-1787-46ed-9632-1445303cc566 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:40.928671 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55039ec2-a021-443d-a7ec-12e4b3821290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:40.929495 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55039ec2-a021-443d-a7ec-12e4b3821290 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:40.929773 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55039ec2-a021-443d-a7ec-12e4b3821290 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:40.930042 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55039ec2-a021-443d-a7ec-12e4b3821290 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:40.947035 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55039ec2-a021-443d-a7ec-12e4b3821290 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:40.961502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-55039ec2-a021-443d-a7ec-12e4b3821290 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 23:42:40.963332 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 123/262] 10.222.0.24 () {56 vars in 1114 bytes} [Mon Apr 11 23:42:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:40.969249 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55039ec2-a021-443d-a7ec-12e4b3821290 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:40.999293 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9d3f97-1c41-40bd-8d14-fa518bb9885d None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:41.039998 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9db852-d854-4716-b927-7e76c3473804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:41.040881 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9db852-d854-4716-b927-7e76c3473804 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:41.041153 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9db852-d854-4716-b927-7e76c3473804 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:41.041423 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9db852-d854-4716-b927-7e76c3473804 None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:41.042805 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9db852-d854-4716-b927-7e76c3473804 None admin] RBAC: Authorizing `identity:get_project(project_id=d87423bf072e41a69237bf58f5e967c0)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:41.044321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9db852-d854-4716-b927-7e76c3473804 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:41.046101 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 140/263] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:40 2022] GET /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:41.052143 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9db852-d854-4716-b927-7e76c3473804 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:41.113597 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55039ec2-a021-443d-a7ec-12e4b3821290 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:41.157105 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d78417-ac57-44c1-8357-366ea4149aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:41.157874 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d78417-ac57-44c1-8357-366ea4149aeb None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:41.158220 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d78417-ac57-44c1-8357-366ea4149aeb None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:41.158559 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d78417-ac57-44c1-8357-366ea4149aeb None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:41.159515 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d78417-ac57-44c1-8357-366ea4149aeb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:41.159882 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d78417-ac57-44c1-8357-366ea4149aeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:41.161973 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d78417-ac57-44c1-8357-366ea4149aeb None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:41.170546 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 124/264] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:42:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:41.180026 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d78417-ac57-44c1-8357-366ea4149aeb None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:41.182533 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9db852-d854-4716-b927-7e76c3473804 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:41.227439 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c19ef-aaa0-429f-81b8-bf4e1c37efe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:41.228630 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c19ef-aaa0-429f-81b8-bf4e1c37efe4 None admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:41.229070 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c19ef-aaa0-429f-81b8-bf4e1c37efe4 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:41.229492 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109c19ef-aaa0-429f-81b8-bf4e1c37efe4 None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0/users/49bddf109cab4c49a1d396aae69a079a/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:41.233832 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c19ef-aaa0-429f-81b8-bf4e1c37efe4 None admin] RBAC: Authorizing `identity:create_grant(project_id=d87423bf072e41a69237bf58f5e967c0, user_id=49bddf109cab4c49a1d396aae69a079a, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:41.238517 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109c19ef-aaa0-429f-81b8-bf4e1c37efe4 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:41.316701 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d78417-ac57-44c1-8357-366ea4149aeb None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:41.330099 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 141/265] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:42:41 2022] PUT /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0/users/49bddf109cab4c49a1d396aae69a079a/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:42:41.366602 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c3bdb-7e84-41db-9b8d-e1390e4d6b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:41.367790 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c3bdb-7e84-41db-9b8d-e1390e4d6b05 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:41.368223 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c3bdb-7e84-41db-9b8d-e1390e4d6b05 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:41.368646 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c3bdb-7e84-41db-9b8d-e1390e4d6b05 None admin] PATH_INFO: `/v3/users/6f02f16a4cfb482490bd6f25caab1622` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:41.375916 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c3bdb-7e84-41db-9b8d-e1390e4d6b05 None admin] RBAC: Authorizing `identity:get_user(user_id=6f02f16a4cfb482490bd6f25caab1622)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:41.377736 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c3bdb-7e84-41db-9b8d-e1390e4d6b05 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:41.380606 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 125/266] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:41 2022] GET /identity/v3/users/6f02f16a4cfb482490bd6f25caab1622 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:41.386845 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c19ef-aaa0-429f-81b8-bf4e1c37efe4 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:41.529300 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109c19ef-aaa0-429f-81b8-bf4e1c37efe4 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:41.568573 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355b1f7-1dc1-48b4-909c-5e308f71592d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:41.569226 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355b1f7-1dc1-48b4-909c-5e308f71592d None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:41.569505 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355b1f7-1dc1-48b4-909c-5e308f71592d None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:41.569775 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3355b1f7-1dc1-48b4-909c-5e308f71592d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:41.657154 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3355b1f7-1dc1-48b4-909c-5e308f71592d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:41.658624 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3355b1f7-1dc1-48b4-909c-5e308f71592d None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:41.765914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 142/267] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:42:41.771802 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c3bdb-7e84-41db-9b8d-e1390e4d6b05 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:41.914234 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c3bdb-7e84-41db-9b8d-e1390e4d6b05 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:41.960383 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bda04-bf87-4307-810f-8e74d306d44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:41.961462 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bda04-bf87-4307-810f-8e74d306d44a None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:41.961881 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bda04-bf87-4307-810f-8e74d306d44a None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:41.962307 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bda04-bf87-4307-810f-8e74d306d44a None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:41.963931 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bda04-bf87-4307-810f-8e74d306d44a None admin] RBAC: Authorizing `identity:get_project(project_id=d87423bf072e41a69237bf58f5e967c0)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:41.965505 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bda04-bf87-4307-810f-8e74d306d44a None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:41.967408 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 126/268] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:41 2022] GET /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:41.973808 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355b1f7-1dc1-48b4-909c-5e308f71592d None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:42.163491 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3355b1f7-1dc1-48b4-909c-5e308f71592d None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:42.210327 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f9299-2b99-49ad-9094-141103d5b433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:42.211281 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f9299-2b99-49ad-9094-141103d5b433 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:42.211834 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f9299-2b99-49ad-9094-141103d5b433 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:42.212313 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f9299-2b99-49ad-9094-141103d5b433 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:42.213549 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f9299-2b99-49ad-9094-141103d5b433 None admin] RBAC: Adding query filter params (role.id=f7b5f822a48e4e269ab53ce00a04194e, scope.project.id=d87423bf072e41a69237bf58f5e967c0, user.id=6f02f16a4cfb482490bd6f25caab1622) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:42.213995 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f9299-2b99-49ad-9094-141103d5b433 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:42.215592 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f9299-2b99-49ad-9094-141103d5b433 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:42.222065 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 143/269] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:42:41 2022] GET /identity/v3/role_assignments?user.id=6f02f16a4cfb482490bd6f25caab1622&scope.project.id=d87423bf072e41a69237bf58f5e967c0&role.id=f7b5f822a48e4e269ab53ce00a04194e => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:43.387622 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0d389-e12c-4dfb-8eae-2ede633a657e None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:43.388735 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0d389-e12c-4dfb-8eae-2ede633a657e None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:43.389308 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0d389-e12c-4dfb-8eae-2ede633a657e None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:43.391600 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 127/270] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:43.397579 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d2164-8ae1-44cc-8b43-6bb5c97a1356 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:43.398429 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d2164-8ae1-44cc-8b43-6bb5c97a1356 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:43.398941 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d2164-8ae1-44cc-8b43-6bb5c97a1356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:43.416720 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-131d2164-8ae1-44cc-8b43-6bb5c97a1356 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:43.418255 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-131d2164-8ae1-44cc-8b43-6bb5c97a1356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:43.465700 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b919bb-4934-4645-85ee-9b09c16b1108 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:43.466358 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b919bb-4934-4645-85ee-9b09c16b1108 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:43.466867 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b919bb-4934-4645-85ee-9b09c16b1108 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:43.469260 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 128/271] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:43.475350 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee92589-ac04-45b3-a860-7920c145bc7a None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:43.475976 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee92589-ac04-45b3-a860-7920c145bc7a None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:43.476479 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee92589-ac04-45b3-a860-7920c145bc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:43.490973 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 144/272] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:43.495258 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-5ee92589-ac04-45b3-a860-7920c145bc7a None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:43.496774 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-5ee92589-ac04-45b3-a860-7920c145bc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:43.514171 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d2164-8ae1-44cc-8b43-6bb5c97a1356 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:43.571996 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 129/273] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:42:43.597052 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee92589-ac04-45b3-a860-7920c145bc7a None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:43.633947 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131d2164-8ae1-44cc-8b43-6bb5c97a1356 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:43.673723 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3facc-3c1c-4748-8d6f-8ec46967b686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:43.674434 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3facc-3c1c-4748-8d6f-8ec46967b686 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:43.674713 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3facc-3c1c-4748-8d6f-8ec46967b686 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:43.675012 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3facc-3c1c-4748-8d6f-8ec46967b686 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:43.684979 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3facc-3c1c-4748-8d6f-8ec46967b686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:43.691947 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-24a3facc-3c1c-4748-8d6f-8ec46967b686 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 23:42:43.693677 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 145/274] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:43.695682 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319a460-12c9-47f6-af12-a14293f53b09 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:43.695963 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319a460-12c9-47f6-af12-a14293f53b09 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:43.696234 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319a460-12c9-47f6-af12-a14293f53b09 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:43.698057 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 146/275] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:43.699248 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319a460-12c9-47f6-af12-a14293f53b09 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:43.709690 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee92589-ac04-45b3-a860-7920c145bc7a None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:43.743140 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5742d30f-9bfb-4f58-9eaf-f7cb21e3c82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:43.743935 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742d30f-9bfb-4f58-9eaf-f7cb21e3c82d None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:43.744213 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742d30f-9bfb-4f58-9eaf-f7cb21e3c82d None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:43.744482 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5742d30f-9bfb-4f58-9eaf-f7cb21e3c82d None admin] PATH_INFO: `/v3/domains/default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:43.745683 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742d30f-9bfb-4f58-9eaf-f7cb21e3c82d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:43.747156 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5742d30f-9bfb-4f58-9eaf-f7cb21e3c82d None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:43.748766 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 130/276] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:42:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:43.749897 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8384adc-6289-48c9-ac10-c390259a2740 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:43.750179 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8384adc-6289-48c9-ac10-c390259a2740 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:43.750451 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8384adc-6289-48c9-ac10-c390259a2740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:43.768083 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-d8384adc-6289-48c9-ac10-c390259a2740 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:43.769260 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d8384adc-6289-48c9-ac10-c390259a2740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:43.819070 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319a460-12c9-47f6-af12-a14293f53b09 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:43.836821 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 131/277] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:43.837703 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8384adc-6289-48c9-ac10-c390259a2740 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:43.851410 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9fcabf-2a14-4942-b416-7a2a80904cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:43.852069 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fcabf-2a14-4942-b416-7a2a80904cec None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:43.852346 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fcabf-2a14-4942-b416-7a2a80904cec None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:43.852615 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fcabf-2a14-4942-b416-7a2a80904cec None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:43.853357 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9fcabf-2a14-4942-b416-7a2a80904cec None admin] RBAC: Adding query filter params (name=reader) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:43.853658 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9fcabf-2a14-4942-b416-7a2a80904cec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:43.855077 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9fcabf-2a14-4942-b416-7a2a80904cec None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:43.863524 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 147/278] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:43.865320 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284e3af-f2fa-41ff-9e28-02a3f55a25fe None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:43.865599 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284e3af-f2fa-41ff-9e28-02a3f55a25fe None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:43.865868 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284e3af-f2fa-41ff-9e28-02a3f55a25fe None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:43.867514 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 148/279] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:43.869102 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284e3af-f2fa-41ff-9e28-02a3f55a25fe None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:43.936466 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8384adc-6289-48c9-ac10-c390259a2740 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:43.961085 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284e3af-f2fa-41ff-9e28-02a3f55a25fe None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:43.968335 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168018de-5e07-4659-8dc6-a179ba2a47e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:43.968994 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168018de-5e07-4659-8dc6-a179ba2a47e0 None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:43.969271 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168018de-5e07-4659-8dc6-a179ba2a47e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:43.969543 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168018de-5e07-4659-8dc6-a179ba2a47e0 None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:43.970250 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168018de-5e07-4659-8dc6-a179ba2a47e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:43.971751 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168018de-5e07-4659-8dc6-a179ba2a47e0 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:43.992766 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0c26c-bff4-4c80-a2f4-fb21496a1740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:43.997277 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0c26c-bff4-4c80-a2f4-fb21496a1740 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:43.997277 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0c26c-bff4-4c80-a2f4-fb21496a1740 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:43.997277 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0c26c-bff4-4c80-a2f4-fb21496a1740 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:44.003516 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0c26c-bff4-4c80-a2f4-fb21496a1740 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:44.011010 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-53b0c26c-bff4-4c80-a2f4-fb21496a1740 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 23:42:44.012168 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 149/280] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:44.013581 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0c26c-bff4-4c80-a2f4-fb21496a1740 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:44.101353 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 132/281] 10.222.0.24 () {60 vars in 1132 bytes} [Mon Apr 11 23:42:43 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:42:44.102613 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282219b-4f29-4824-aa09-b5ca74d5f819 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:44.102921 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282219b-4f29-4824-aa09-b5ca74d5f819 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:44.103198 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282219b-4f29-4824-aa09-b5ca74d5f819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:44.106588 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0c26c-bff4-4c80-a2f4-fb21496a1740 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:44.128927 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-2282219b-4f29-4824-aa09-b5ca74d5f819 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:44.131155 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-2282219b-4f29-4824-aa09-b5ca74d5f819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:44.143164 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a8673-b995-4b96-b19a-126c2195a10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:44.144050 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a8673-b995-4b96-b19a-126c2195a10c None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:44.144328 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a8673-b995-4b96-b19a-126c2195a10c None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:44.144599 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4a8673-b995-4b96-b19a-126c2195a10c None admin] PATH_INFO: `/v3/users/5d96af99a9154a55a1d296894c835326` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:44.145889 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a8673-b995-4b96-b19a-126c2195a10c None admin] RBAC: Authorizing `identity:get_user(user_id=5d96af99a9154a55a1d296894c835326)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:44.147380 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4a8673-b995-4b96-b19a-126c2195a10c None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:44.149037 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 150/282] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:44 2022] GET /identity/v3/users/5d96af99a9154a55a1d296894c835326 => generated 297 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:44.149813 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a8673-b995-4b96-b19a-126c2195a10c None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:44.210080 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 133/283] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:44.211237 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282219b-4f29-4824-aa09-b5ca74d5f819 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:44.257061 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4a8673-b995-4b96-b19a-126c2195a10c None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:44.292371 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9cc4c-82bd-4103-ad8f-f2b0c90a2df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:44.293070 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9cc4c-82bd-4103-ad8f-f2b0c90a2df0 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:44.293350 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9cc4c-82bd-4103-ad8f-f2b0c90a2df0 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:44.293622 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9cc4c-82bd-4103-ad8f-f2b0c90a2df0 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:44.294532 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9cc4c-82bd-4103-ad8f-f2b0c90a2df0 None admin] RBAC: Adding query filter params (name=member) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:44.294678 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9cc4c-82bd-4103-ad8f-f2b0c90a2df0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:44.296086 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9cc4c-82bd-4103-ad8f-f2b0c90a2df0 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:44.305700 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 151/284] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:44.306357 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9cc4c-82bd-4103-ad8f-f2b0c90a2df0 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:44.320799 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2282219b-4f29-4824-aa09-b5ca74d5f819 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:44.362129 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466eb4f-9b08-463a-81a7-60f5da57bcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:44.363385 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466eb4f-9b08-463a-81a7-60f5da57bcbb None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:44.363906 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466eb4f-9b08-463a-81a7-60f5da57bcbb None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:44.365311 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466eb4f-9b08-463a-81a7-60f5da57bcbb None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:44.367386 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466eb4f-9b08-463a-81a7-60f5da57bcbb None admin] RBAC: Authorizing `identity:get_project(project_id=d87423bf072e41a69237bf58f5e967c0)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:44.368945 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466eb4f-9b08-463a-81a7-60f5da57bcbb None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:44.370943 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 134/285] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:44 2022] GET /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:44.374870 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466eb4f-9b08-463a-81a7-60f5da57bcbb None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:44.419086 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9cc4c-82bd-4103-ad8f-f2b0c90a2df0 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:44.454066 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623fe9d-3755-46a8-a6e7-3150d8c32cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:44.455046 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623fe9d-3755-46a8-a6e7-3150d8c32cad None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:44.455448 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623fe9d-3755-46a8-a6e7-3150d8c32cad None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:44.455822 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e623fe9d-3755-46a8-a6e7-3150d8c32cad None admin] PATH_INFO: `/v3/roles/member` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:44.467117 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e623fe9d-3755-46a8-a6e7-3150d8c32cad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:44.474431 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466eb4f-9b08-463a-81a7-60f5da57bcbb None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:44.474889 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-e623fe9d-3755-46a8-a6e7-3150d8c32cad None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 23:42:44.476092 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 152/286] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:44.476998 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623fe9d-3755-46a8-a6e7-3150d8c32cad None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:44.508913 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b15fe5-d1ec-4c2d-865a-6f682652827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:44.509782 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b15fe5-d1ec-4c2d-865a-6f682652827e None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:44.510058 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b15fe5-d1ec-4c2d-865a-6f682652827e None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:44.510325 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b15fe5-d1ec-4c2d-865a-6f682652827e None admin] PATH_INFO: `/v3/users/a6cb8aa7642a44379142dfb0071980b6` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:44.523968 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b15fe5-d1ec-4c2d-865a-6f682652827e None admin] RBAC: Authorizing `identity:get_user(user_id=a6cb8aa7642a44379142dfb0071980b6)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:44.525542 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b15fe5-d1ec-4c2d-865a-6f682652827e None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:44.527656 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 135/287] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:44 2022] GET /identity/v3/users/a6cb8aa7642a44379142dfb0071980b6 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:44.528420 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b15fe5-d1ec-4c2d-865a-6f682652827e None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:44.579466 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e623fe9d-3755-46a8-a6e7-3150d8c32cad None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:44.614548 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07fd52-5bc4-4656-9657-eeeb8ef4aaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:44.616247 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07fd52-5bc4-4656-9657-eeeb8ef4aaf8 None admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:44.616654 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07fd52-5bc4-4656-9657-eeeb8ef4aaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:44.617032 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca07fd52-5bc4-4656-9657-eeeb8ef4aaf8 None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0/users/5d96af99a9154a55a1d296894c835326/roles/d970ab64b060491c919ed8a7cf36313c` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:44.619594 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07fd52-5bc4-4656-9657-eeeb8ef4aaf8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d87423bf072e41a69237bf58f5e967c0, user_id=5d96af99a9154a55a1d296894c835326, role_id=d970ab64b060491c919ed8a7cf36313c)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:44.621580 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca07fd52-5bc4-4656-9657-eeeb8ef4aaf8 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:44.632810 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b15fe5-d1ec-4c2d-865a-6f682652827e None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:44.667473 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc5b06-a8ca-4e1e-90a6-729fd9342bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:44.668188 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc5b06-a8ca-4e1e-90a6-729fd9342bca None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:44.668465 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc5b06-a8ca-4e1e-90a6-729fd9342bca None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:44.668759 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc5b06-a8ca-4e1e-90a6-729fd9342bca None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:44.669507 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc5b06-a8ca-4e1e-90a6-729fd9342bca None admin] RBAC: Adding query filter params (name=member) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:44.669806 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc5b06-a8ca-4e1e-90a6-729fd9342bca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:44.671222 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffc5b06-a8ca-4e1e-90a6-729fd9342bca None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:44.679240 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 136/288] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:44.680017 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc5b06-a8ca-4e1e-90a6-729fd9342bca None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:44.730857 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 153/289] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:42:44 2022] PUT /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0/users/5d96af99a9154a55a1d296894c835326/roles/d970ab64b060491c919ed8a7cf36313c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:42:44.731829 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07fd52-5bc4-4656-9657-eeeb8ef4aaf8 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:44.864619 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffc5b06-a8ca-4e1e-90a6-729fd9342bca None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:44.915802 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1c0b5-175d-4b78-8bf5-40468837b167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:44.916891 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1c0b5-175d-4b78-8bf5-40468837b167 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:44.917385 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1c0b5-175d-4b78-8bf5-40468837b167 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:44.917856 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1c0b5-175d-4b78-8bf5-40468837b167 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:44.918984 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1c0b5-175d-4b78-8bf5-40468837b167 None admin] RBAC: Adding query filter params (role.id=d0f74491c28e4d1094a60391d71c2246, user.id=a6cb8aa7642a44379142dfb0071980b6, scope.system=all) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:44.919505 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1c0b5-175d-4b78-8bf5-40468837b167 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:44.921191 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1c0b5-175d-4b78-8bf5-40468837b167 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:44.932650 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 137/290] 10.222.0.24 () {56 vars in 1308 bytes} [Mon Apr 11 23:42:44 2022] GET /identity/v3/role_assignments?user.id=a6cb8aa7642a44379142dfb0071980b6&scope.system=all&role.id=d0f74491c28e4d1094a60391d71c2246 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:45.060596 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca07fd52-5bc4-4656-9657-eeeb8ef4aaf8 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:45.106529 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b423be-ae10-4028-9cdf-fb9e841bb1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:45.107448 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b423be-ae10-4028-9cdf-fb9e841bb1a6 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:45.107722 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b423be-ae10-4028-9cdf-fb9e841bb1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:45.107985 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b423be-ae10-4028-9cdf-fb9e841bb1a6 None admin] PATH_INFO: `/v3/users/49bddf109cab4c49a1d396aae69a079a` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:45.109304 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b423be-ae10-4028-9cdf-fb9e841bb1a6 None admin] RBAC: Authorizing `identity:get_user(user_id=49bddf109cab4c49a1d396aae69a079a)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:45.110766 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b423be-ae10-4028-9cdf-fb9e841bb1a6 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:45.112487 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 154/291] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:44 2022] GET /identity/v3/users/49bddf109cab4c49a1d396aae69a079a => generated 297 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:45.118712 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1c0b5-175d-4b78-8bf5-40468837b167 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:45.232401 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1c0b5-175d-4b78-8bf5-40468837b167 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:45.265709 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee6a53-8ae5-4998-ac4b-e86737d2ad3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:45.266404 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee6a53-8ae5-4998-ac4b-e86737d2ad3d None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:45.266687 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee6a53-8ae5-4998-ac4b-e86737d2ad3d None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:45.266989 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee6a53-8ae5-4998-ac4b-e86737d2ad3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:45.341336 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee6a53-8ae5-4998-ac4b-e86737d2ad3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:45.342732 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee6a53-8ae5-4998-ac4b-e86737d2ad3d None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:45.441578 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 138/292] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:42:45.447132 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b423be-ae10-4028-9cdf-fb9e841bb1a6 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:45.580895 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b423be-ae10-4028-9cdf-fb9e841bb1a6 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:45.622050 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbc69b-4063-4855-942c-ee2f03c505d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:45.622924 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbc69b-4063-4855-942c-ee2f03c505d7 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:45.623201 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbc69b-4063-4855-942c-ee2f03c505d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:45.623465 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbc69b-4063-4855-942c-ee2f03c505d7 None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:45.624690 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbc69b-4063-4855-942c-ee2f03c505d7 None admin] RBAC: Authorizing `identity:get_project(project_id=d87423bf072e41a69237bf58f5e967c0)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:45.626156 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbc69b-4063-4855-942c-ee2f03c505d7 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:45.628151 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 155/293] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:45 2022] GET /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:45.633651 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee6a53-8ae5-4998-ac4b-e86737d2ad3d None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:45.774770 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee6a53-8ae5-4998-ac4b-e86737d2ad3d None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:45.822275 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d347e-893a-46de-8897-90181cd25331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:45.822948 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d347e-893a-46de-8897-90181cd25331 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:45.823226 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d347e-893a-46de-8897-90181cd25331 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:45.823496 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d347e-893a-46de-8897-90181cd25331 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:45.824321 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d347e-893a-46de-8897-90181cd25331 None admin] RBAC: Adding query filter params (role.id=d0f74491c28e4d1094a60391d71c2246, scope.project.id=d87423bf072e41a69237bf58f5e967c0, user.id=49bddf109cab4c49a1d396aae69a079a) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:45.824623 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d347e-893a-46de-8897-90181cd25331 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:45.826049 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54d347e-893a-46de-8897-90181cd25331 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:45.835647 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 139/294] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:42:45 2022] GET /identity/v3/role_assignments?user.id=49bddf109cab4c49a1d396aae69a079a&scope.project.id=d87423bf072e41a69237bf58f5e967c0&role.id=d0f74491c28e4d1094a60391d71c2246 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:46.773023 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c5cb0-c3f2-497f-99ff-257e98a7a24f None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:46.773498 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c5cb0-c3f2-497f-99ff-257e98a7a24f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:46.773669 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c5cb0-c3f2-497f-99ff-257e98a7a24f None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:46.777040 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 156/295] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:46.777226 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de46cca-480e-49b1-950c-108bdfed075a None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:46.777226 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de46cca-480e-49b1-950c-108bdfed075a None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:46.779585 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de46cca-480e-49b1-950c-108bdfed075a None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:46.780154 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 140/296] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:42:46.781252 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def5727-9b30-49c9-9cc2-9d3d559b9840 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:46.781565 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def5727-9b30-49c9-9cc2-9d3d559b9840 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:46.781841 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def5727-9b30-49c9-9cc2-9d3d559b9840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:46.785717 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe966f0-a31b-4c2c-b42d-a691caf545d2 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:46.786258 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe966f0-a31b-4c2c-b42d-a691caf545d2 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:46.786744 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe966f0-a31b-4c2c-b42d-a691caf545d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:46.803510 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-0def5727-9b30-49c9-9cc2-9d3d559b9840 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:46.806522 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-0def5727-9b30-49c9-9cc2-9d3d559b9840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:46.819952 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-0fe966f0-a31b-4c2c-b42d-a691caf545d2 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:46.829669 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-0fe966f0-a31b-4c2c-b42d-a691caf545d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:46.874817 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 157/297] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:42:46.899452 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def5727-9b30-49c9-9cc2-9d3d559b9840 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:46.902063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 141/298] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:46.924254 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe966f0-a31b-4c2c-b42d-a691caf545d2 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:47.001797 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def5727-9b30-49c9-9cc2-9d3d559b9840 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:47.041759 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f7ed4-708c-436f-a09c-43c9d2cb53d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:47.041759 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f7ed4-708c-436f-a09c-43c9d2cb53d7 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:47.041759 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f7ed4-708c-436f-a09c-43c9d2cb53d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:47.041759 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2f7ed4-708c-436f-a09c-43c9d2cb53d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:47.053435 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2f7ed4-708c-436f-a09c-43c9d2cb53d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:47.060705 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-de2f7ed4-708c-436f-a09c-43c9d2cb53d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 23:42:47.062882 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 158/299] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:47.068375 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f7ed4-708c-436f-a09c-43c9d2cb53d7 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:47.147138 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe966f0-a31b-4c2c-b42d-a691caf545d2 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:47.170130 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2f7ed4-708c-436f-a09c-43c9d2cb53d7 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:47.180932 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5424e-6d7a-420c-9ab7-9c6dc4957e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:47.182067 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5424e-6d7a-420c-9ab7-9c6dc4957e62 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:47.182175 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5424e-6d7a-420c-9ab7-9c6dc4957e62 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:47.182440 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa5424e-6d7a-420c-9ab7-9c6dc4957e62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:47.183714 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5424e-6d7a-420c-9ab7-9c6dc4957e62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:47.185231 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa5424e-6d7a-420c-9ab7-9c6dc4957e62 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:47.191686 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 142/300] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:42:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:47.193594 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5424e-6d7a-420c-9ab7-9c6dc4957e62 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:47.208785 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e61c0-a626-48d5-8d97-a360190fd587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:47.209850 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e61c0-a626-48d5-8d97-a360190fd587 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:47.210300 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e61c0-a626-48d5-8d97-a360190fd587 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:47.210773 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e61c0-a626-48d5-8d97-a360190fd587 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:47.211785 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e61c0-a626-48d5-8d97-a360190fd587 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:47.212298 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e61c0-a626-48d5-8d97-a360190fd587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:47.214232 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e61c0-a626-48d5-8d97-a360190fd587 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:47.224737 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 159/301] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:47.229910 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e61c0-a626-48d5-8d97-a360190fd587 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:47.320205 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa5424e-6d7a-420c-9ab7-9c6dc4957e62 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:47.353141 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e61c0-a626-48d5-8d97-a360190fd587 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:47.359920 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff617c76-b0c6-41a5-bf9a-c307da578a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:47.360831 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff617c76-b0c6-41a5-bf9a-c307da578a59 None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:47.361687 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff617c76-b0c6-41a5-bf9a-c307da578a59 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:47.362170 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff617c76-b0c6-41a5-bf9a-c307da578a59 None admin] PATH_INFO: `/v3/groups` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:47.363097 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff617c76-b0c6-41a5-bf9a-c307da578a59 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:47.366190 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff617c76-b0c6-41a5-bf9a-c307da578a59 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:47.388128 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19f65c-0a8b-4140-b82e-505b0dfbace4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:47.389079 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19f65c-0a8b-4140-b82e-505b0dfbace4 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:47.389428 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19f65c-0a8b-4140-b82e-505b0dfbace4 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:47.389764 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd19f65c-0a8b-4140-b82e-505b0dfbace4 None admin] PATH_INFO: `/v3/users/32408f0c3bcb413f89172ff541538906` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:47.402696 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19f65c-0a8b-4140-b82e-505b0dfbace4 None admin] RBAC: Authorizing `identity:get_user(user_id=32408f0c3bcb413f89172ff541538906)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:47.404362 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd19f65c-0a8b-4140-b82e-505b0dfbace4 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:47.406278 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 160/302] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:47 2022] GET /identity/v3/users/32408f0c3bcb413f89172ff541538906 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:47.412112 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19f65c-0a8b-4140-b82e-505b0dfbace4 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:47.433968 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 143/303] 10.222.0.24 () {60 vars in 1134 bytes} [Mon Apr 11 23:42:47 2022] POST /identity/v3/groups => generated 229 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:42:47.529163 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd19f65c-0a8b-4140-b82e-505b0dfbace4 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:47.566707 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e7cd4e-1794-4a53-a743-7b6c2474b894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:47.568691 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06844e-0326-4d51-ad67-411236886434 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:47.568978 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06844e-0326-4d51-ad67-411236886434 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:47.569263 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06844e-0326-4d51-ad67-411236886434 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:47.570130 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7cd4e-1794-4a53-a743-7b6c2474b894 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:47.570677 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7cd4e-1794-4a53-a743-7b6c2474b894 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:47.571189 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e7cd4e-1794-4a53-a743-7b6c2474b894 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:47.571484 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 144/304] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:47.572432 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7cd4e-1794-4a53-a743-7b6c2474b894 None admin] RBAC: Adding query filter params (role.id=d970ab64b060491c919ed8a7cf36313c, user.id=32408f0c3bcb413f89172ff541538906, scope.system=all) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:47.572939 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7cd4e-1794-4a53-a743-7b6c2474b894 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:47.574572 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e7cd4e-1794-4a53-a743-7b6c2474b894 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:47.580462 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 161/305] 10.222.0.24 () {56 vars in 1308 bytes} [Mon Apr 11 23:42:47 2022] GET /identity/v3/role_assignments?user.id=32408f0c3bcb413f89172ff541538906&scope.system=all&role.id=d970ab64b060491c919ed8a7cf36313c => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:47.580976 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b5939-d371-456e-8e67-199f031b22dd None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:47.581342 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b5939-d371-456e-8e67-199f031b22dd None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:47.581742 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477b5939-d371-456e-8e67-199f031b22dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:47.602512 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-477b5939-d371-456e-8e67-199f031b22dd None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:47.603937 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-477b5939-d371-456e-8e67-199f031b22dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:47.614869 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd8e80-c0d8-45e1-bf72-6e2226de81e0 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:47.615236 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd8e80-c0d8-45e1-bf72-6e2226de81e0 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:47.615579 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfd8e80-c0d8-45e1-bf72-6e2226de81e0 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:47.617893 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 162/306] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:42:47.624797 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918aee2e-d605-4f76-a090-f921a161666e None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:47.624797 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918aee2e-d605-4f76-a090-f921a161666e None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:47.625057 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918aee2e-d605-4f76-a090-f921a161666e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:47.646321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-918aee2e-d605-4f76-a090-f921a161666e None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:47.647908 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-918aee2e-d605-4f76-a090-f921a161666e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:47.685284 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 145/307] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:47.710200 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b5939-d371-456e-8e67-199f031b22dd None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:47.731965 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 163/308] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:47.759426 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918aee2e-d605-4f76-a090-f921a161666e None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:47.823717 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477b5939-d371-456e-8e67-199f031b22dd None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:47.858255 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15978545-03dc-4c5c-a69b-2ba4a131ee22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:47.859255 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15978545-03dc-4c5c-a69b-2ba4a131ee22 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:47.859632 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15978545-03dc-4c5c-a69b-2ba4a131ee22 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:47.859999 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15978545-03dc-4c5c-a69b-2ba4a131ee22 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:47.867064 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918aee2e-d605-4f76-a090-f921a161666e None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:47.870379 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15978545-03dc-4c5c-a69b-2ba4a131ee22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:47.877550 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-15978545-03dc-4c5c-a69b-2ba4a131ee22 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 23:42:47.879156 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 146/309] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:42:47.889867 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15978545-03dc-4c5c-a69b-2ba4a131ee22 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:47.903330 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a279f-1af8-4640-93cd-e19031bce8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:47.904431 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a279f-1af8-4640-93cd-e19031bce8ef None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:47.904888 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a279f-1af8-4640-93cd-e19031bce8ef None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:47.905334 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a279f-1af8-4640-93cd-e19031bce8ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:47.916346 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a279f-1af8-4640-93cd-e19031bce8ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:47.923604 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-9f5a279f-1af8-4640-93cd-e19031bce8ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 23:42:47.925332 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 164/310] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:47.931289 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a279f-1af8-4640-93cd-e19031bce8ef None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:47.997773 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15978545-03dc-4c5c-a69b-2ba4a131ee22 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:48.031931 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a279f-1af8-4640-93cd-e19031bce8ef None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:48.032186 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2bc97-26ec-4b0a-beb6-630a321247f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:48.032805 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2bc97-26ec-4b0a-beb6-630a321247f4 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:48.033091 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2bc97-26ec-4b0a-beb6-630a321247f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:48.033364 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e2bc97-26ec-4b0a-beb6-630a321247f4 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:48.036794 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2bc97-26ec-4b0a-beb6-630a321247f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:48.036794 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2bc97-26ec-4b0a-beb6-630a321247f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:48.036794 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e2bc97-26ec-4b0a-beb6-630a321247f4 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:48.049665 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 147/311] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:48.050732 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2bc97-26ec-4b0a-beb6-630a321247f4 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:48.076612 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ce446-1d46-4b12-94be-377c099be44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:48.077208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ce446-1d46-4b12-94be-377c099be44e None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:48.077488 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ce446-1d46-4b12-94be-377c099be44e None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:48.077758 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ce446-1d46-4b12-94be-377c099be44e None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:48.078503 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ce446-1d46-4b12-94be-377c099be44e None admin] RBAC: Adding query filter params (name=member) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:48.078803 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ce446-1d46-4b12-94be-377c099be44e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:48.080621 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ce446-1d46-4b12-94be-377c099be44e None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:48.096066 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 165/312] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:48.097288 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ce446-1d46-4b12-94be-377c099be44e None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:48.175376 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e2bc97-26ec-4b0a-beb6-630a321247f4 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:48.208675 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ce446-1d46-4b12-94be-377c099be44e None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:48.217267 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230c393-db8b-4ebd-814c-f2f515438a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:48.218392 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230c393-db8b-4ebd-814c-f2f515438a07 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:48.219243 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230c393-db8b-4ebd-814c-f2f515438a07 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:48.219676 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230c393-db8b-4ebd-814c-f2f515438a07 None admin] PATH_INFO: `/v3/users/5d96af99a9154a55a1d296894c835326` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:48.221650 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230c393-db8b-4ebd-814c-f2f515438a07 None admin] RBAC: Authorizing `identity:get_user(user_id=5d96af99a9154a55a1d296894c835326)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:48.223473 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230c393-db8b-4ebd-814c-f2f515438a07 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:48.225993 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 148/313] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:48 2022] GET /identity/v3/users/5d96af99a9154a55a1d296894c835326 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:48.231672 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230c393-db8b-4ebd-814c-f2f515438a07 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:48.249893 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad5b0c-8152-4ab6-a0ba-7b1d8d47863f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:48.251397 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad5b0c-8152-4ab6-a0ba-7b1d8d47863f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:48.251681 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad5b0c-8152-4ab6-a0ba-7b1d8d47863f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:48.251952 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad5b0c-8152-4ab6-a0ba-7b1d8d47863f None admin] PATH_INFO: `/v3/users/a6cb8aa7642a44379142dfb0071980b6` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:48.253186 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad5b0c-8152-4ab6-a0ba-7b1d8d47863f None admin] RBAC: Authorizing `identity:get_user(user_id=a6cb8aa7642a44379142dfb0071980b6)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:48.255725 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad5b0c-8152-4ab6-a0ba-7b1d8d47863f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:48.262047 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 166/314] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:48 2022] GET /identity/v3/users/a6cb8aa7642a44379142dfb0071980b6 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:48.263507 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad5b0c-8152-4ab6-a0ba-7b1d8d47863f None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:48.342487 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230c393-db8b-4ebd-814c-f2f515438a07 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:48.378927 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f6cca-e37b-4b40-9d9f-3de2be424900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:48.380162 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f6cca-e37b-4b40-9d9f-3de2be424900 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:48.380442 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f6cca-e37b-4b40-9d9f-3de2be424900 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:48.380710 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770f6cca-e37b-4b40-9d9f-3de2be424900 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:48.396627 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad5b0c-8152-4ab6-a0ba-7b1d8d47863f None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:48.441114 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec7656-af45-4721-9ca2-7c1f0f5d9c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:48.443094 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec7656-af45-4721-9ca2-7c1f0f5d9c0b None admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:48.443522 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec7656-af45-4721-9ca2-7c1f0f5d9c0b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:48.443940 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcec7656-af45-4721-9ca2-7c1f0f5d9c0b None admin] PATH_INFO: `/v3/system/users/a6cb8aa7642a44379142dfb0071980b6/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:48.445761 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec7656-af45-4721-9ca2-7c1f0f5d9c0b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a6cb8aa7642a44379142dfb0071980b6, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:48.448067 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcec7656-af45-4721-9ca2-7c1f0f5d9c0b None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:48.448536 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f6cca-e37b-4b40-9d9f-3de2be424900 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:48.450056 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770f6cca-e37b-4b40-9d9f-3de2be424900 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:48.543993 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 149/315] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 23:42:48.549150 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f6cca-e37b-4b40-9d9f-3de2be424900 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:48.570952 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 167/316] 10.222.0.24 () {58 vars in 1334 bytes} [Mon Apr 11 23:42:48 2022] PUT /identity/v3/system/users/a6cb8aa7642a44379142dfb0071980b6/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:42:48.665982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770f6cca-e37b-4b40-9d9f-3de2be424900 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:48.707625 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce9b87-7186-4512-b601-ae4432649eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:48.708766 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce9b87-7186-4512-b601-ae4432649eea None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:48.709185 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce9b87-7186-4512-b601-ae4432649eea None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:48.709593 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce9b87-7186-4512-b601-ae4432649eea None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:48.711096 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce9b87-7186-4512-b601-ae4432649eea None admin] RBAC: Authorizing `identity:get_project(project_id=d87423bf072e41a69237bf58f5e967c0)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:48.712773 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce9b87-7186-4512-b601-ae4432649eea None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:48.715320 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 150/317] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:48 2022] GET /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:48.721171 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec7656-af45-4721-9ca2-7c1f0f5d9c0b None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:48.829586 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcec7656-af45-4721-9ca2-7c1f0f5d9c0b None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:48.862843 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45339929-2c93-45b2-b03e-1195e87d0239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:48.863495 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45339929-2c93-45b2-b03e-1195e87d0239 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:48.863770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45339929-2c93-45b2-b03e-1195e87d0239 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:48.864595 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45339929-2c93-45b2-b03e-1195e87d0239 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:48.865418 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45339929-2c93-45b2-b03e-1195e87d0239 None admin] RBAC: Adding query filter params (role.id=d970ab64b060491c919ed8a7cf36313c, scope.project.id=d87423bf072e41a69237bf58f5e967c0, user.id=5d96af99a9154a55a1d296894c835326) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:48.865718 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45339929-2c93-45b2-b03e-1195e87d0239 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:48.867158 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45339929-2c93-45b2-b03e-1195e87d0239 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:48.873258 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 168/318] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:42:48 2022] GET /identity/v3/role_assignments?user.id=5d96af99a9154a55a1d296894c835326&scope.project.id=d87423bf072e41a69237bf58f5e967c0&role.id=d970ab64b060491c919ed8a7cf36313c => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:49.858608 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8dc69-f140-4aa4-a5f1-0c4864aac9d4 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:49.859137 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8dc69-f140-4aa4-a5f1-0c4864aac9d4 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:49.859209 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8dc69-f140-4aa4-a5f1-0c4864aac9d4 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:49.860930 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 151/319] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:49.866723 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d7c31-00a2-44a4-85d4-ed608c43d1fb None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:49.867046 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d7c31-00a2-44a4-85d4-ed608c43d1fb None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:49.867328 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d7c31-00a2-44a4-85d4-ed608c43d1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:49.884357 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-769d7c31-00a2-44a4-85d4-ed608c43d1fb None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:49.885608 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-769d7c31-00a2-44a4-85d4-ed608c43d1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:49.887519 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecc6dd-6640-4cf2-aa83-76a7235e6024 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:49.887793 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecc6dd-6640-4cf2-aa83-76a7235e6024 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:49.888064 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ecc6dd-6640-4cf2-aa83-76a7235e6024 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:49.889797 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 152/320] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:49.894805 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972f0cc-a308-4d43-84c3-973a749f65a7 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:49.895279 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972f0cc-a308-4d43-84c3-973a749f65a7 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:49.895724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972f0cc-a308-4d43-84c3-973a749f65a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:49.913022 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-2972f0cc-a308-4d43-84c3-973a749f65a7 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:49.914388 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-2972f0cc-a308-4d43-84c3-973a749f65a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:49.950427 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 169/321] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:49.972931 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d7c31-00a2-44a4-85d4-ed608c43d1fb None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:49.979478 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 153/322] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:42:50.001014 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972f0cc-a308-4d43-84c3-973a749f65a7 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:50.068648 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d7c31-00a2-44a4-85d4-ed608c43d1fb None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:50.095671 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972f0cc-a308-4d43-84c3-973a749f65a7 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:50.103674 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b0e26-da78-4d14-b8cd-2bb900d8933f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:50.104472 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b0e26-da78-4d14-b8cd-2bb900d8933f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:50.104753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b0e26-da78-4d14-b8cd-2bb900d8933f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:50.105026 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717b0e26-da78-4d14-b8cd-2bb900d8933f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:50.106192 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b0e26-da78-4d14-b8cd-2bb900d8933f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:50.107652 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717b0e26-da78-4d14-b8cd-2bb900d8933f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:50.109421 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 170/323] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:42:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:50.115230 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b0e26-da78-4d14-b8cd-2bb900d8933f None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:50.131493 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c58277-db9f-4670-880d-4f65a0ff2b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:50.132295 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c58277-db9f-4670-880d-4f65a0ff2b66 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:50.132569 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c58277-db9f-4670-880d-4f65a0ff2b66 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:50.132839 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c58277-db9f-4670-880d-4f65a0ff2b66 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:50.143080 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c58277-db9f-4670-880d-4f65a0ff2b66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:50.150203 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-f5c58277-db9f-4670-880d-4f65a0ff2b66 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 23:42:50.151586 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 154/324] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:42:50.157108 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c58277-db9f-4670-880d-4f65a0ff2b66 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:50.216313 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717b0e26-da78-4d14-b8cd-2bb900d8933f None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:50.249946 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecdb74-1fce-4310-9808-e82f93688645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:50.250603 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecdb74-1fce-4310-9808-e82f93688645 None admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:50.250905 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecdb74-1fce-4310-9808-e82f93688645 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:50.251177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fecdb74-1fce-4310-9808-e82f93688645 None admin] PATH_INFO: `/v3/groups` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:50.251858 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecdb74-1fce-4310-9808-e82f93688645 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:50.253282 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fecdb74-1fce-4310-9808-e82f93688645 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:50.256918 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c58277-db9f-4670-880d-4f65a0ff2b66 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:50.289725 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4884757-406d-4182-a17a-7801746a5338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:50.290382 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4884757-406d-4182-a17a-7801746a5338 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:50.290659 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4884757-406d-4182-a17a-7801746a5338 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:50.290960 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4884757-406d-4182-a17a-7801746a5338 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:50.291699 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4884757-406d-4182-a17a-7801746a5338 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:50.292002 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4884757-406d-4182-a17a-7801746a5338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:50.293352 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4884757-406d-4182-a17a-7801746a5338 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:50.302493 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 155/325] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:50.308296 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4884757-406d-4182-a17a-7801746a5338 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:50.342043 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 171/326] 10.222.0.24 () {60 vars in 1134 bytes} [Mon Apr 11 23:42:50 2022] POST /identity/v3/groups => generated 226 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 23:42:50.411984 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4884757-406d-4182-a17a-7801746a5338 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:50.447079 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcae487-047a-421d-933c-c3a3013499f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:50.447964 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcae487-047a-421d-933c-c3a3013499f1 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:50.448238 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcae487-047a-421d-933c-c3a3013499f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:50.448504 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcae487-047a-421d-933c-c3a3013499f1 None admin] PATH_INFO: `/v3/users/32408f0c3bcb413f89172ff541538906` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:50.449759 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcae487-047a-421d-933c-c3a3013499f1 None admin] RBAC: Authorizing `identity:get_user(user_id=32408f0c3bcb413f89172ff541538906)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:50.451236 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcae487-047a-421d-933c-c3a3013499f1 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:50.453132 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 156/327] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:50 2022] GET /identity/v3/users/32408f0c3bcb413f89172ff541538906 => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:50.458604 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecdb74-1fce-4310-9808-e82f93688645 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:50.564726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fecdb74-1fce-4310-9808-e82f93688645 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:50.600200 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f551e2-e289-49df-a1dc-fdeef35bc0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:50.601065 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f551e2-e289-49df-a1dc-fdeef35bc0da None admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:50.601344 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f551e2-e289-49df-a1dc-fdeef35bc0da None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:50.601616 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f551e2-e289-49df-a1dc-fdeef35bc0da None admin] PATH_INFO: `/v3/system/users/32408f0c3bcb413f89172ff541538906/roles/d970ab64b060491c919ed8a7cf36313c` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:50.603197 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f551e2-e289-49df-a1dc-fdeef35bc0da None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=32408f0c3bcb413f89172ff541538906, role_id=d970ab64b060491c919ed8a7cf36313c)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:50.604563 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f551e2-e289-49df-a1dc-fdeef35bc0da None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:50.680210 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 172/328] 10.222.0.24 () {58 vars in 1334 bytes} [Mon Apr 11 23:42:50 2022] PUT /identity/v3/system/users/32408f0c3bcb413f89172ff541538906/roles/d970ab64b060491c919ed8a7cf36313c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:42:50.910009 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512371b-1645-4371-8994-7e6e39b11fe6 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:50.910486 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512371b-1645-4371-8994-7e6e39b11fe6 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:50.910486 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512371b-1645-4371-8994-7e6e39b11fe6 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:50.913076 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 157/329] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:50.918275 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290033fa-c959-4fb4-8090-e86ad4289242 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:50.918707 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290033fa-c959-4fb4-8090-e86ad4289242 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:50.918892 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290033fa-c959-4fb4-8090-e86ad4289242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:50.937739 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-290033fa-c959-4fb4-8090-e86ad4289242 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:50.939907 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-290033fa-c959-4fb4-8090-e86ad4289242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:51.009133 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 173/330] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:51.033486 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512371b-1645-4371-8994-7e6e39b11fe6 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:51.135077 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512371b-1645-4371-8994-7e6e39b11fe6 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:51.168895 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6707749-0396-4d18-8d53-6c4d8c8726e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:51.169609 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6707749-0396-4d18-8d53-6c4d8c8726e0 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:51.169936 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6707749-0396-4d18-8d53-6c4d8c8726e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:51.170209 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6707749-0396-4d18-8d53-6c4d8c8726e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:51.180678 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6707749-0396-4d18-8d53-6c4d8c8726e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:51.187881 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-d6707749-0396-4d18-8d53-6c4d8c8726e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 23:42:51.189246 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 158/331] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:51.195301 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290033fa-c959-4fb4-8090-e86ad4289242 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:51.295885 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290033fa-c959-4fb4-8090-e86ad4289242 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:51.329884 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7afad2-5abc-46b0-b301-41f20eeb68db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:51.330542 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7afad2-5abc-46b0-b301-41f20eeb68db None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:51.330817 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7afad2-5abc-46b0-b301-41f20eeb68db None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:51.331109 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7afad2-5abc-46b0-b301-41f20eeb68db None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:51.331852 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7afad2-5abc-46b0-b301-41f20eeb68db None admin] RBAC: Adding query filter params (name=member) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:51.332147 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7afad2-5abc-46b0-b301-41f20eeb68db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:51.334093 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7afad2-5abc-46b0-b301-41f20eeb68db None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:51.342644 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 174/332] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:51.348159 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6707749-0396-4d18-8d53-6c4d8c8726e0 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:51.447960 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6707749-0396-4d18-8d53-6c4d8c8726e0 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:51.482987 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aaa157-6b91-47cf-8268-86dc5a2df3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:51.484147 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaa157-6b91-47cf-8268-86dc5a2df3bf None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:51.484597 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaa157-6b91-47cf-8268-86dc5a2df3bf None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:51.485062 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaa157-6b91-47cf-8268-86dc5a2df3bf None admin] PATH_INFO: `/v3/users/a6cb8aa7642a44379142dfb0071980b6` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:51.486460 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aaa157-6b91-47cf-8268-86dc5a2df3bf None admin] RBAC: Authorizing `identity:get_user(user_id=a6cb8aa7642a44379142dfb0071980b6)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:51.488109 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aaa157-6b91-47cf-8268-86dc5a2df3bf None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:51.490260 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 159/333] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:51 2022] GET /identity/v3/users/a6cb8aa7642a44379142dfb0071980b6 => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:51.496146 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7afad2-5abc-46b0-b301-41f20eeb68db None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:51.603282 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7afad2-5abc-46b0-b301-41f20eeb68db None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:51.637794 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a27348-125e-407c-9415-0389813f7658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:51.638748 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a27348-125e-407c-9415-0389813f7658 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:51.639242 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a27348-125e-407c-9415-0389813f7658 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:51.639685 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a27348-125e-407c-9415-0389813f7658 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:51.640716 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a27348-125e-407c-9415-0389813f7658 None admin] RBAC: Adding query filter params (role.id=d0f74491c28e4d1094a60391d71c2246, user.id=a6cb8aa7642a44379142dfb0071980b6, scope.system=all) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:51.641199 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a27348-125e-407c-9415-0389813f7658 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:51.642965 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a27348-125e-407c-9415-0389813f7658 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:51.659633 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 175/334] 10.222.0.24 () {56 vars in 1308 bytes} [Mon Apr 11 23:42:51 2022] GET /identity/v3/role_assignments?user.id=a6cb8aa7642a44379142dfb0071980b6&scope.system=all&role.id=d0f74491c28e4d1094a60391d71c2246 => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:53.133519 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b51172-2d26-4093-9ed4-03f12fff05c8 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:53.134072 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b51172-2d26-4093-9ed4-03f12fff05c8 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:53.134072 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b51172-2d26-4093-9ed4-03f12fff05c8 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:53.136118 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 160/335] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:53.141666 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc036e5b-111d-455e-bfe6-b9a55c63680c None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:53.142098 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc036e5b-111d-455e-bfe6-b9a55c63680c None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:53.142275 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc036e5b-111d-455e-bfe6-b9a55c63680c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:53.163385 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-fc036e5b-111d-455e-bfe6-b9a55c63680c None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:53.164547 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-fc036e5b-111d-455e-bfe6-b9a55c63680c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:53.241926 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 176/336] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:53.271433 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b51172-2d26-4093-9ed4-03f12fff05c8 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:53.387808 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b51172-2d26-4093-9ed4-03f12fff05c8 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:53.428130 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790c2de-f186-43f4-a430-ee9defb7a67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:53.429318 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790c2de-f186-43f4-a430-ee9defb7a67d None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:53.429820 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790c2de-f186-43f4-a430-ee9defb7a67d None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:53.430294 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d790c2de-f186-43f4-a430-ee9defb7a67d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:53.447255 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d790c2de-f186-43f4-a430-ee9defb7a67d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:53.454620 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-d790c2de-f186-43f4-a430-ee9defb7a67d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 23:42:53.456377 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 161/337] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:53.462342 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc036e5b-111d-455e-bfe6-b9a55c63680c None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:53.603800 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc036e5b-111d-455e-bfe6-b9a55c63680c None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:53.637433 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55573514-7b5f-49b2-bbc0-5cdc390e6769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:53.638172 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55573514-7b5f-49b2-bbc0-5cdc390e6769 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:53.638393 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55573514-7b5f-49b2-bbc0-5cdc390e6769 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:53.638665 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55573514-7b5f-49b2-bbc0-5cdc390e6769 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:53.639467 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55573514-7b5f-49b2-bbc0-5cdc390e6769 None admin] RBAC: Adding query filter params (name=member) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:53.639770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55573514-7b5f-49b2-bbc0-5cdc390e6769 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:53.641179 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55573514-7b5f-49b2-bbc0-5cdc390e6769 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:53.652028 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 177/338] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:53.657531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790c2de-f186-43f4-a430-ee9defb7a67d None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:53.834983 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d790c2de-f186-43f4-a430-ee9defb7a67d None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:53.879721 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e930ed4-efd0-4da9-bf08-492fce805e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:53.880786 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e930ed4-efd0-4da9-bf08-492fce805e74 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:53.881287 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e930ed4-efd0-4da9-bf08-492fce805e74 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:53.881765 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e930ed4-efd0-4da9-bf08-492fce805e74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:53.899248 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45fcc9-21e9-4126-99df-b6fb7b55294f None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:53.899854 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45fcc9-21e9-4126-99df-b6fb7b55294f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:53.900326 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45fcc9-21e9-4126-99df-b6fb7b55294f None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:53.902585 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 178/339] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:53.908473 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4520048-7ec2-4548-88b6-d5d38f5a8779 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:53.909107 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4520048-7ec2-4548-88b6-d5d38f5a8779 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:53.909580 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4520048-7ec2-4548-88b6-d5d38f5a8779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:53.940367 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-b4520048-7ec2-4548-88b6-d5d38f5a8779 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:53.942453 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-b4520048-7ec2-4548-88b6-d5d38f5a8779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:53.967739 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e930ed4-efd0-4da9-bf08-492fce805e74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:53.969181 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e930ed4-efd0-4da9-bf08-492fce805e74 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:54.192514 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 162/340] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:42:54.193832 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 179/341] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:42:54.198095 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e930ed4-efd0-4da9-bf08-492fce805e74 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:54.231502 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4520048-7ec2-4548-88b6-d5d38f5a8779 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:54.314339 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e930ed4-efd0-4da9-bf08-492fce805e74 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:54.353923 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a141f0c3-d4f9-4480-89c8-b5ce44dd4727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:54.354811 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141f0c3-d4f9-4480-89c8-b5ce44dd4727 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:54.355105 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141f0c3-d4f9-4480-89c8-b5ce44dd4727 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:54.355373 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a141f0c3-d4f9-4480-89c8-b5ce44dd4727 None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:54.356676 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141f0c3-d4f9-4480-89c8-b5ce44dd4727 None admin] RBAC: Authorizing `identity:get_project(project_id=5563d83687534242a56eaa5054d6ed92)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:54.358105 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a141f0c3-d4f9-4480-89c8-b5ce44dd4727 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:54.359815 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 163/342] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:54 2022] GET /identity/v3/projects/5563d83687534242a56eaa5054d6ed92 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:54.367492 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8f784-d6f7-4b00-b18e-b9230f176178 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:54.367774 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8f784-d6f7-4b00-b18e-b9230f176178 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:54.368031 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8f784-d6f7-4b00-b18e-b9230f176178 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:54.369947 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 164/343] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:54.371663 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8f784-d6f7-4b00-b18e-b9230f176178 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:54.421213 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4520048-7ec2-4548-88b6-d5d38f5a8779 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:54.463892 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2348dc40-232a-42cf-a27b-4f09cdd8b389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:54.464631 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348dc40-232a-42cf-a27b-4f09cdd8b389 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:54.464905 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348dc40-232a-42cf-a27b-4f09cdd8b389 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:54.465170 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2348dc40-232a-42cf-a27b-4f09cdd8b389 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:54.480169 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2348dc40-232a-42cf-a27b-4f09cdd8b389 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:54.491862 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-2348dc40-232a-42cf-a27b-4f09cdd8b389 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 23:42:54.493423 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 180/344] 10.222.0.24 () {56 vars in 1114 bytes} [Mon Apr 11 23:42:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:54.494644 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911ac0c-5aa8-413b-b639-2ca87715707a None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:54.494946 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911ac0c-5aa8-413b-b639-2ca87715707a None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:54.495219 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0911ac0c-5aa8-413b-b639-2ca87715707a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:54.507057 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8f784-d6f7-4b00-b18e-b9230f176178 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:54.531894 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-0911ac0c-5aa8-413b-b639-2ca87715707a None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:54.533079 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-0911ac0c-5aa8-413b-b639-2ca87715707a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:54.556336 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf3fa8-5da1-4660-a0e3-465c74735197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:54.557498 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf3fa8-5da1-4660-a0e3-465c74735197 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:54.557778 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf3fa8-5da1-4660-a0e3-465c74735197 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:54.558049 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abf3fa8-5da1-4660-a0e3-465c74735197 None admin] PATH_INFO: `/v3/groups/9a244477cb10469587f36d987c94ecdb` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:54.566279 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf3fa8-5da1-4660-a0e3-465c74735197 None admin] RBAC: Authorizing `identity:get_group(group_id=9a244477cb10469587f36d987c94ecdb)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:54.570004 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abf3fa8-5da1-4660-a0e3-465c74735197 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:54.572595 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 165/345] 10.222.0.24 () {56 vars in 1180 bytes} [Mon Apr 11 23:42:54 2022] GET /identity/v3/groups/9a244477cb10469587f36d987c94ecdb => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:54.573138 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf3fa8-5da1-4660-a0e3-465c74735197 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:54.621826 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 181/346] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:54.631177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b8ba6-41bb-4f78-a348-ae32f30dce9c None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:54.631507 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b8ba6-41bb-4f78-a348-ae32f30dce9c None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:54.631789 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b8ba6-41bb-4f78-a348-ae32f30dce9c None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:54.633918 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 182/347] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:54 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:54.634681 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b8ba6-41bb-4f78-a348-ae32f30dce9c None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:54.699386 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abf3fa8-5da1-4660-a0e3-465c74735197 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:54.736143 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea7794-522d-4313-ac61-10b14e119357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:54.737171 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea7794-522d-4313-ac61-10b14e119357 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:54.737687 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea7794-522d-4313-ac61-10b14e119357 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:54.738165 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea7794-522d-4313-ac61-10b14e119357 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:54.739737 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea7794-522d-4313-ac61-10b14e119357 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:54.740260 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea7794-522d-4313-ac61-10b14e119357 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:54.741842 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea7794-522d-4313-ac61-10b14e119357 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:54.755090 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 166/348] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:42:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:54.756847 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6b02-561f-4426-a669-9f2ed5486033 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:54.757515 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6b02-561f-4426-a669-9f2ed5486033 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:54.758101 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e6b02-561f-4426-a669-9f2ed5486033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:54.758604 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b8ba6-41bb-4f78-a348-ae32f30dce9c None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:54.776894 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-3d9e6b02-561f-4426-a669-9f2ed5486033 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:54.778201 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-3d9e6b02-561f-4426-a669-9f2ed5486033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:54.798156 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3e564-659d-454e-ba96-ca7b1ae04280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:54.798812 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3e564-659d-454e-ba96-ca7b1ae04280 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:54.799117 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3e564-659d-454e-ba96-ca7b1ae04280 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:54.799390 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3e564-659d-454e-ba96-ca7b1ae04280 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:54.800222 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3e564-659d-454e-ba96-ca7b1ae04280 None admin] RBAC: Adding query filter params (group.id=9a244477cb10469587f36d987c94ecdb, role.id=d0f74491c28e4d1094a60391d71c2246, scope.project.id=5563d83687534242a56eaa5054d6ed92) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:54.800531 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3e564-659d-454e-ba96-ca7b1ae04280 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:54.802529 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3e564-659d-454e-ba96-ca7b1ae04280 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:54.809425 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 183/349] 10.222.0.24 () {56 vars in 1376 bytes} [Mon Apr 11 23:42:54 2022] GET /identity/v3/role_assignments?group.id=9a244477cb10469587f36d987c94ecdb&scope.project.id=5563d83687534242a56eaa5054d6ed92&role.id=d0f74491c28e4d1094a60391d71c2246 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:54.810228 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3e564-659d-454e-ba96-ca7b1ae04280 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:54.872494 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 167/350] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:54.873393 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e6b02-561f-4426-a669-9f2ed5486033 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:54.921861 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3e564-659d-454e-ba96-ca7b1ae04280 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:54.983675 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764195b-cfcf-448d-99ee-e2b49205d664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:54.984506 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764195b-cfcf-448d-99ee-e2b49205d664 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:54.984786 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764195b-cfcf-448d-99ee-e2b49205d664 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:54.985060 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a764195b-cfcf-448d-99ee-e2b49205d664 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:55.003623 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a764195b-cfcf-448d-99ee-e2b49205d664 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:55.011333 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-a764195b-cfcf-448d-99ee-e2b49205d664 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Apr 11 23:42:55.012590 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 184/351] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:55.013376 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764195b-cfcf-448d-99ee-e2b49205d664 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:55.042800 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e6b02-561f-4426-a669-9f2ed5486033 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:55.114307 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320ee74-d370-4129-b54b-233d6392517b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:55.114997 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ee74-d370-4129-b54b-233d6392517b None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:55.115277 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ee74-d370-4129-b54b-233d6392517b None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:55.115578 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320ee74-d370-4129-b54b-233d6392517b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:55.177012 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a764195b-cfcf-448d-99ee-e2b49205d664 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:55.239331 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cda5e2-ba19-4cf0-b05a-d3748f2060a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:55.240135 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cda5e2-ba19-4cf0-b05a-d3748f2060a7 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:55.240414 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cda5e2-ba19-4cf0-b05a-d3748f2060a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:55.240688 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cda5e2-ba19-4cf0-b05a-d3748f2060a7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:55.246064 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320ee74-d370-4129-b54b-233d6392517b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:55.247551 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320ee74-d370-4129-b54b-233d6392517b None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:55.262625 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cda5e2-ba19-4cf0-b05a-d3748f2060a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:55.269609 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-15cda5e2-ba19-4cf0-b05a-d3748f2060a7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 23:42:55.271379 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 185/352] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:55.272146 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cda5e2-ba19-4cf0-b05a-d3748f2060a7 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:55.409162 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 168/353] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:42:55.410010 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320ee74-d370-4129-b54b-233d6392517b None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:55.417810 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cda5e2-ba19-4cf0-b05a-d3748f2060a7 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:55.450780 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d26d6-5cf9-4b16-802e-b2cb72b1d863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:55.451477 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d26d6-5cf9-4b16-802e-b2cb72b1d863 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:55.451753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d26d6-5cf9-4b16-802e-b2cb72b1d863 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:55.452022 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d26d6-5cf9-4b16-802e-b2cb72b1d863 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:55.452770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d26d6-5cf9-4b16-802e-b2cb72b1d863 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:55.453071 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d26d6-5cf9-4b16-802e-b2cb72b1d863 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:55.454430 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d26d6-5cf9-4b16-802e-b2cb72b1d863 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:55.463578 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 186/354] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:55.464846 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dd23f-a9f2-422d-ad85-25a5e1c4513d None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:55.465126 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dd23f-a9f2-422d-ad85-25a5e1c4513d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:55.465398 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dd23f-a9f2-422d-ad85-25a5e1c4513d None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:55.471195 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 187/355] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:55.471966 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dd23f-a9f2-422d-ad85-25a5e1c4513d None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:55.520754 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320ee74-d370-4129-b54b-233d6392517b None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:55.560075 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78380f-1ead-4c0d-8305-1d1fe4c4c0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:55.560896 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78380f-1ead-4c0d-8305-1d1fe4c4c0a4 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:55.561268 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78380f-1ead-4c0d-8305-1d1fe4c4c0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:55.561607 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78380f-1ead-4c0d-8305-1d1fe4c4c0a4 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:55.562423 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78380f-1ead-4c0d-8305-1d1fe4c4c0a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:55.562725 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78380f-1ead-4c0d-8305-1d1fe4c4c0a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:55.564143 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee78380f-1ead-4c0d-8305-1d1fe4c4c0a4 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:55.581389 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 169/356] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:55.581937 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78380f-1ead-4c0d-8305-1d1fe4c4c0a4 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:55.608116 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dd23f-a9f2-422d-ad85-25a5e1c4513d None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:55.647046 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d8242-473b-4c52-94a4-c263b85f16cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:55.647932 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d8242-473b-4c52-94a4-c263b85f16cd None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:55.648215 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d8242-473b-4c52-94a4-c263b85f16cd None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:55.648503 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d8242-473b-4c52-94a4-c263b85f16cd None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:55.649685 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d8242-473b-4c52-94a4-c263b85f16cd None admin] RBAC: Authorizing `identity:get_project(project_id=5563d83687534242a56eaa5054d6ed92)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:55.651895 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d8242-473b-4c52-94a4-c263b85f16cd None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:55.652974 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 188/357] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:55 2022] GET /identity/v3/projects/5563d83687534242a56eaa5054d6ed92 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:55.653964 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa08eda-28fb-4007-bbe8-a71584a23bfe None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:55.654247 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa08eda-28fb-4007-bbe8-a71584a23bfe None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:55.654517 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa08eda-28fb-4007-bbe8-a71584a23bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:55.675792 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-9fa08eda-28fb-4007-bbe8-a71584a23bfe None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:55.677119 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-9fa08eda-28fb-4007-bbe8-a71584a23bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:55.714937 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee78380f-1ead-4c0d-8305-1d1fe4c4c0a4 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:55.755388 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5ffaa-2217-4106-8b7b-dd3eaf4ed702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:55.756526 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5ffaa-2217-4106-8b7b-dd3eaf4ed702 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:55.756818 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5ffaa-2217-4106-8b7b-dd3eaf4ed702 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:55.757092 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5ffaa-2217-4106-8b7b-dd3eaf4ed702 None admin] PATH_INFO: `/v3/users/32408f0c3bcb413f89172ff541538906` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:55.758480 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5ffaa-2217-4106-8b7b-dd3eaf4ed702 None admin] RBAC: Authorizing `identity:get_user(user_id=32408f0c3bcb413f89172ff541538906)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:55.760542 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a5ffaa-2217-4106-8b7b-dd3eaf4ed702 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:55.762179 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 170/358] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:42:55 2022] GET /identity/v3/users/32408f0c3bcb413f89172ff541538906 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:55.763489 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d96897-8cd2-4ec2-b2f5-62e95fef73db None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:55.763767 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d96897-8cd2-4ec2-b2f5-62e95fef73db None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:55.764035 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d96897-8cd2-4ec2-b2f5-62e95fef73db None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:55.765179 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 189/359] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:55.767770 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 171/360] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:55.767770 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d96897-8cd2-4ec2-b2f5-62e95fef73db None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:55.768919 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa08eda-28fb-4007-bbe8-a71584a23bfe None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:55.901732 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d96897-8cd2-4ec2-b2f5-62e95fef73db None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:55.906697 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa08eda-28fb-4007-bbe8-a71584a23bfe None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:55.944557 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4023f-b79b-4a5b-8834-f0bb83ae4eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:55.945214 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4023f-b79b-4a5b-8834-f0bb83ae4eff None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:55.945319 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53077d05-bd83-4597-9a43-f512eda12c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:55.945527 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4023f-b79b-4a5b-8834-f0bb83ae4eff None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:55.945755 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a4023f-b79b-4a5b-8834-f0bb83ae4eff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:55.946145 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53077d05-bd83-4597-9a43-f512eda12c78 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:55.946417 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53077d05-bd83-4597-9a43-f512eda12c78 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:55.946682 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53077d05-bd83-4597-9a43-f512eda12c78 None admin] PATH_INFO: `/v3/groups/9a244477cb10469587f36d987c94ecdb` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:55.947933 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53077d05-bd83-4597-9a43-f512eda12c78 None admin] RBAC: Authorizing `identity:get_group(group_id=9a244477cb10469587f36d987c94ecdb)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:55.949639 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53077d05-bd83-4597-9a43-f512eda12c78 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:55.954910 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 172/361] 10.222.0.24 () {56 vars in 1180 bytes} [Mon Apr 11 23:42:55 2022] GET /identity/v3/groups/9a244477cb10469587f36d987c94ecdb => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:55.955765 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53077d05-bd83-4597-9a43-f512eda12c78 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:56.031094 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4023f-b79b-4a5b-8834-f0bb83ae4eff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:56.032564 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a4023f-b79b-4a5b-8834-f0bb83ae4eff None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:56.086066 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53077d05-bd83-4597-9a43-f512eda12c78 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:56.127047 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0ea95-7c70-4da5-977c-8055dd5cb54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:56.127695 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0ea95-7c70-4da5-977c-8055dd5cb54c None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:56.127969 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0ea95-7c70-4da5-977c-8055dd5cb54c None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:56.128235 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0ea95-7c70-4da5-977c-8055dd5cb54c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:56.129062 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0ea95-7c70-4da5-977c-8055dd5cb54c None admin] RBAC: Adding query filter params (role.id=d970ab64b060491c919ed8a7cf36313c, user.id=32408f0c3bcb413f89172ff541538906, scope.system=all) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:56.129409 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0ea95-7c70-4da5-977c-8055dd5cb54c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:56.130853 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0ea95-7c70-4da5-977c-8055dd5cb54c None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:56.146095 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 173/362] 10.222.0.24 () {56 vars in 1308 bytes} [Mon Apr 11 23:42:55 2022] GET /identity/v3/role_assignments?user.id=32408f0c3bcb413f89172ff541538906&scope.system=all&role.id=d970ab64b060491c919ed8a7cf36313c => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:56.147705 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991077ba-739d-4746-a581-3df4467c144d None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:56.147993 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991077ba-739d-4746-a581-3df4467c144d None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:56.148266 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991077ba-739d-4746-a581-3df4467c144d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:56.161338 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 190/363] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:42:56.162578 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4023f-b79b-4a5b-8834-f0bb83ae4eff None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:56.175810 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-991077ba-739d-4746-a581-3df4467c144d None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:56.177601 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-991077ba-739d-4746-a581-3df4467c144d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:56.263762 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 174/364] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:56.267756 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991077ba-739d-4746-a581-3df4467c144d None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:56.290370 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a4023f-b79b-4a5b-8834-f0bb83ae4eff None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:56.336831 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bbfe5-db72-40e3-949f-eb4034425315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:56.338294 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bbfe5-db72-40e3-949f-eb4034425315 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:56.338787 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bbfe5-db72-40e3-949f-eb4034425315 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:56.339291 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942bbfe5-db72-40e3-949f-eb4034425315 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:56.353715 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942bbfe5-db72-40e3-949f-eb4034425315 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:56.362508 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-942bbfe5-db72-40e3-949f-eb4034425315 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:42:56.365069 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 191/365] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:42:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:56.366065 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bbfe5-db72-40e3-949f-eb4034425315 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:56.420220 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991077ba-739d-4746-a581-3df4467c144d None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:56.462787 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3ef58-3a6f-4791-9dbf-bfcf80906e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:56.464007 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3ef58-3a6f-4791-9dbf-bfcf80906e05 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:56.464286 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3ef58-3a6f-4791-9dbf-bfcf80906e05 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:56.464715 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af3ef58-3a6f-4791-9dbf-bfcf80906e05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:56.465852 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3ef58-3a6f-4791-9dbf-bfcf80906e05 None admin] RBAC: Adding query filter params (group.id=9a244477cb10469587f36d987c94ecdb, role.id=f7b5f822a48e4e269ab53ce00a04194e, scope.project.id=5563d83687534242a56eaa5054d6ed92) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:56.466198 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3ef58-3a6f-4791-9dbf-bfcf80906e05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:56.467635 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af3ef58-3a6f-4791-9dbf-bfcf80906e05 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:56.477266 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 175/366] 10.222.0.24 () {56 vars in 1376 bytes} [Mon Apr 11 23:42:56 2022] GET /identity/v3/role_assignments?group.id=9a244477cb10469587f36d987c94ecdb&scope.project.id=5563d83687534242a56eaa5054d6ed92&role.id=f7b5f822a48e4e269ab53ce00a04194e => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:56.478169 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3ef58-3a6f-4791-9dbf-bfcf80906e05 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:56.484997 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942bbfe5-db72-40e3-949f-eb4034425315 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:56.532508 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aca6de-dfde-470f-9a60-bdf3432fd7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:56.534197 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aca6de-dfde-470f-9a60-bdf3432fd7c5 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:56.534700 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aca6de-dfde-470f-9a60-bdf3432fd7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:56.535505 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aca6de-dfde-470f-9a60-bdf3432fd7c5 None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:56.538161 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aca6de-dfde-470f-9a60-bdf3432fd7c5 None admin] RBAC: Authorizing `identity:get_project(project_id=d87423bf072e41a69237bf58f5e967c0)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:56.540612 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aca6de-dfde-470f-9a60-bdf3432fd7c5 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:56.543548 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 192/367] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:56 2022] GET /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:56.544652 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aca6de-dfde-470f-9a60-bdf3432fd7c5 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:56.601419 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af3ef58-3a6f-4791-9dbf-bfcf80906e05 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:56.647810 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce38ff-4f75-4837-91df-888bc40d122c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:56.648644 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce38ff-4f75-4837-91df-888bc40d122c None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:56.648918 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce38ff-4f75-4837-91df-888bc40d122c None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:56.649184 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce38ff-4f75-4837-91df-888bc40d122c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:56.661814 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ce38ff-4f75-4837-91df-888bc40d122c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:56.670151 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-40ce38ff-4f75-4837-91df-888bc40d122c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 23:42:56.674376 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aca6de-dfde-470f-9a60-bdf3432fd7c5 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:56.676337 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 176/368] 10.222.0.24 () {56 vars in 1114 bytes} [Mon Apr 11 23:42:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:56.678111 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce38ff-4f75-4837-91df-888bc40d122c None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:56.715637 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9fb91-3339-4f7a-b83d-3e7178f500e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:56.716305 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9fb91-3339-4f7a-b83d-3e7178f500e0 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:56.716578 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9fb91-3339-4f7a-b83d-3e7178f500e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:56.716845 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b9fb91-3339-4f7a-b83d-3e7178f500e0 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:56.717599 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9fb91-3339-4f7a-b83d-3e7178f500e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:56.717898 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9fb91-3339-4f7a-b83d-3e7178f500e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:56.721526 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b9fb91-3339-4f7a-b83d-3e7178f500e0 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:56.728673 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 193/369] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:56.733840 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9fb91-3339-4f7a-b83d-3e7178f500e0 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:56.814821 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce38ff-4f75-4837-91df-888bc40d122c None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:56.844824 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b9fb91-3339-4f7a-b83d-3e7178f500e0 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:56.859916 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ace15-bef4-44b4-9a5d-a1d29c679411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:56.860783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ace15-bef4-44b4-9a5d-a1d29c679411 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:56.861064 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ace15-bef4-44b4-9a5d-a1d29c679411 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:56.861494 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ace15-bef4-44b4-9a5d-a1d29c679411 None admin] PATH_INFO: `/v3/groups/9a244477cb10469587f36d987c94ecdb` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:56.863115 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ace15-bef4-44b4-9a5d-a1d29c679411 None admin] RBAC: Authorizing `identity:get_group(group_id=9a244477cb10469587f36d987c94ecdb)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:56.864811 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ace15-bef4-44b4-9a5d-a1d29c679411 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:56.870966 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 177/370] 10.222.0.24 () {56 vars in 1180 bytes} [Mon Apr 11 23:42:56 2022] GET /identity/v3/groups/9a244477cb10469587f36d987c94ecdb => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:56.872082 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ace15-bef4-44b4-9a5d-a1d29c679411 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:56.899592 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b692398-2f07-4f01-a659-cbc57d667cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:56.900682 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b692398-2f07-4f01-a659-cbc57d667cda None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:56.901186 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b692398-2f07-4f01-a659-cbc57d667cda None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:56.901675 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b692398-2f07-4f01-a659-cbc57d667cda None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:56.902689 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b692398-2f07-4f01-a659-cbc57d667cda None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:56.903219 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b692398-2f07-4f01-a659-cbc57d667cda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:56.904811 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b692398-2f07-4f01-a659-cbc57d667cda None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:56.914534 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 194/371] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:42:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:56.915746 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b692398-2f07-4f01-a659-cbc57d667cda None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:57.011041 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ace15-bef4-44b4-9a5d-a1d29c679411 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:57.044405 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b692398-2f07-4f01-a659-cbc57d667cda None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:57.060283 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f666e9c-078f-434b-80a7-2d48758a4af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:57.060956 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f666e9c-078f-434b-80a7-2d48758a4af8 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:57.061237 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f666e9c-078f-434b-80a7-2d48758a4af8 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:57.061510 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f666e9c-078f-434b-80a7-2d48758a4af8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:57.080856 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822d87a-5e2f-429b-84c8-35f748ed4a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:57.081909 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822d87a-5e2f-429b-84c8-35f748ed4a7b None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:57.082440 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822d87a-5e2f-429b-84c8-35f748ed4a7b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:57.083628 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822d87a-5e2f-429b-84c8-35f748ed4a7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:57.084663 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822d87a-5e2f-429b-84c8-35f748ed4a7b None admin] RBAC: Adding query filter params (group.id=9a244477cb10469587f36d987c94ecdb, role.id=d0f74491c28e4d1094a60391d71c2246, scope.project.id=d87423bf072e41a69237bf58f5e967c0) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:57.085177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822d87a-5e2f-429b-84c8-35f748ed4a7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:57.086944 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3822d87a-5e2f-429b-84c8-35f748ed4a7b None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:57.094980 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 195/372] 10.222.0.24 () {56 vars in 1376 bytes} [Mon Apr 11 23:42:56 2022] GET /identity/v3/role_assignments?group.id=9a244477cb10469587f36d987c94ecdb&scope.project.id=d87423bf072e41a69237bf58f5e967c0&role.id=d0f74491c28e4d1094a60391d71c2246 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:57.103642 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822d87a-5e2f-429b-84c8-35f748ed4a7b None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:57.136885 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f666e9c-078f-434b-80a7-2d48758a4af8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:57.138354 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f666e9c-078f-434b-80a7-2d48758a4af8 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:57.298651 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822d87a-5e2f-429b-84c8-35f748ed4a7b None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:57.337508 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 178/373] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:42:57.343181 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f666e9c-078f-434b-80a7-2d48758a4af8 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:57.366763 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb519f-88ec-4360-b867-b730c7c6fc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:57.367454 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb519f-88ec-4360-b867-b730c7c6fc9e None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:57.367860 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb519f-88ec-4360-b867-b730c7c6fc9e None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:57.367982 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb519f-88ec-4360-b867-b730c7c6fc9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:57.456104 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb519f-88ec-4360-b867-b730c7c6fc9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:57.458509 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb519f-88ec-4360-b867-b730c7c6fc9e None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:57.474063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f666e9c-078f-434b-80a7-2d48758a4af8 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:57.510312 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166b528c-0e5b-442d-bb7d-e0482be93355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:57.511201 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b528c-0e5b-442d-bb7d-e0482be93355 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:57.511477 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b528c-0e5b-442d-bb7d-e0482be93355 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:57.511742 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166b528c-0e5b-442d-bb7d-e0482be93355 None admin] PATH_INFO: `/v3/projects/1da535e2d1e54da3b958d1c813082f2d` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:57.512946 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b528c-0e5b-442d-bb7d-e0482be93355 None admin] RBAC: Authorizing `identity:get_project(project_id=1da535e2d1e54da3b958d1c813082f2d)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:57.514364 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166b528c-0e5b-442d-bb7d-e0482be93355 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:57.516542 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 179/374] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:57 2022] GET /identity/v3/projects/1da535e2d1e54da3b958d1c813082f2d => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:57.517553 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434df4fb-45d7-46e7-96d9-d951899e65ad None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:57.517827 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434df4fb-45d7-46e7-96d9-d951899e65ad None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:57.518164 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434df4fb-45d7-46e7-96d9-d951899e65ad None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:57.519724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 180/375] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:57.523743 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434df4fb-45d7-46e7-96d9-d951899e65ad None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:57.567965 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 196/376] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:42:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:42:57.569453 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33608fb-9cdc-409a-bb48-96cc274cebd5 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:57.569883 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33608fb-9cdc-409a-bb48-96cc274cebd5 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:57.570314 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33608fb-9cdc-409a-bb48-96cc274cebd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:57.587040 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-e33608fb-9cdc-409a-bb48-96cc274cebd5 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:57.588731 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-e33608fb-9cdc-409a-bb48-96cc274cebd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:57.626755 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434df4fb-45d7-46e7-96d9-d951899e65ad None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:57.658289 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 197/377] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:57.659390 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33608fb-9cdc-409a-bb48-96cc274cebd5 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:57.665467 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cc63b-2f62-42d2-a52a-c5e4217627a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:57.666439 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cc63b-2f62-42d2-a52a-c5e4217627a8 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:57.666810 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cc63b-2f62-42d2-a52a-c5e4217627a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:57.667198 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cc63b-2f62-42d2-a52a-c5e4217627a8 None admin] PATH_INFO: `/v3/groups/4655538b608d4e63a223dfb5a755bd87` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:57.679566 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736cc63b-2f62-42d2-a52a-c5e4217627a8 None admin] RBAC: Authorizing `identity:get_group(group_id=4655538b608d4e63a223dfb5a755bd87)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:57.681059 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736cc63b-2f62-42d2-a52a-c5e4217627a8 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:57.682857 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 181/378] 10.222.0.24 () {56 vars in 1180 bytes} [Mon Apr 11 23:42:57 2022] GET /identity/v3/groups/4655538b608d4e63a223dfb5a755bd87 => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:57.688484 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cc63b-2f62-42d2-a52a-c5e4217627a8 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:57.763281 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33608fb-9cdc-409a-bb48-96cc274cebd5 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:57.797871 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc8a46-8aa3-48c5-808c-972fec509479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:57.799104 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc8a46-8aa3-48c5-808c-972fec509479 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:57.799535 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc8a46-8aa3-48c5-808c-972fec509479 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:57.799994 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc8a46-8aa3-48c5-808c-972fec509479 None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:57.801538 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc8a46-8aa3-48c5-808c-972fec509479 None admin] RBAC: Authorizing `identity:get_project(project_id=d87423bf072e41a69237bf58f5e967c0)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:57.803219 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc8a46-8aa3-48c5-808c-972fec509479 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:57.805169 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 198/379] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:57 2022] GET /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:57.805520 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cc63b-2f62-42d2-a52a-c5e4217627a8 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:57.806250 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc8a46-8aa3-48c5-808c-972fec509479 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:57.842137 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41502b9-933f-4667-bf9d-0141ac3c020d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:57.842893 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41502b9-933f-4667-bf9d-0141ac3c020d None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:57.843270 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41502b9-933f-4667-bf9d-0141ac3c020d None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:57.843670 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41502b9-933f-4667-bf9d-0141ac3c020d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:57.845194 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41502b9-933f-4667-bf9d-0141ac3c020d None admin] RBAC: Adding query filter params (group.id=4655538b608d4e63a223dfb5a755bd87, role.id=c8affbefb4c5462a921650b24b13c80f, scope.project.id=1da535e2d1e54da3b958d1c813082f2d) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:57.845194 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41502b9-933f-4667-bf9d-0141ac3c020d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:57.846443 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41502b9-933f-4667-bf9d-0141ac3c020d None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:57.852498 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 182/380] 10.222.0.24 () {56 vars in 1376 bytes} [Mon Apr 11 23:42:57 2022] GET /identity/v3/role_assignments?group.id=4655538b608d4e63a223dfb5a755bd87&scope.project.id=1da535e2d1e54da3b958d1c813082f2d&role.id=c8affbefb4c5462a921650b24b13c80f => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:57.853549 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41502b9-933f-4667-bf9d-0141ac3c020d None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:57.915225 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc8a46-8aa3-48c5-808c-972fec509479 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:57.951007 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21214907-ed49-4720-b9fd-b4c08e17c974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:57.952138 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21214907-ed49-4720-b9fd-b4c08e17c974 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:57.952611 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21214907-ed49-4720-b9fd-b4c08e17c974 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:57.953036 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21214907-ed49-4720-b9fd-b4c08e17c974 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:57.956882 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41502b9-933f-4667-bf9d-0141ac3c020d None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:57.965228 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21214907-ed49-4720-b9fd-b4c08e17c974 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:57.972833 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-21214907-ed49-4720-b9fd-b4c08e17c974 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 23:42:57.974378 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 199/381] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:42:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:57.996453 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21214907-ed49-4720-b9fd-b4c08e17c974 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:57.998284 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed9651-1c4b-4a81-a7bd-fafb203ea207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:58.003345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed9651-1c4b-4a81-a7bd-fafb203ea207 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:58.003345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed9651-1c4b-4a81-a7bd-fafb203ea207 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:58.003345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ed9651-1c4b-4a81-a7bd-fafb203ea207 None admin] PATH_INFO: `/v3/groups/9a244477cb10469587f36d987c94ecdb` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:58.003345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed9651-1c4b-4a81-a7bd-fafb203ea207 None admin] RBAC: Authorizing `identity:get_group(group_id=9a244477cb10469587f36d987c94ecdb)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:58.003345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ed9651-1c4b-4a81-a7bd-fafb203ea207 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:58.005069 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 183/382] 10.222.0.24 () {56 vars in 1180 bytes} [Mon Apr 11 23:42:57 2022] GET /identity/v3/groups/9a244477cb10469587f36d987c94ecdb => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:58.011911 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed9651-1c4b-4a81-a7bd-fafb203ea207 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:58.138240 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ed9651-1c4b-4a81-a7bd-fafb203ea207 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:58.177724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a245771-9101-4f51-814a-a7469af1e7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:58.178652 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a245771-9101-4f51-814a-a7469af1e7c5 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:58.178956 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a245771-9101-4f51-814a-a7469af1e7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:58.179231 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a245771-9101-4f51-814a-a7469af1e7c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:58.180519 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a245771-9101-4f51-814a-a7469af1e7c5 None admin] RBAC: Adding query filter params (group.id=9a244477cb10469587f36d987c94ecdb, role.id=f7b5f822a48e4e269ab53ce00a04194e, scope.project.id=d87423bf072e41a69237bf58f5e967c0) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:58.180827 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a245771-9101-4f51-814a-a7469af1e7c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:58.182266 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a245771-9101-4f51-814a-a7469af1e7c5 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:58.190158 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 184/383] 10.222.0.24 () {56 vars in 1376 bytes} [Mon Apr 11 23:42:58 2022] GET /identity/v3/role_assignments?group.id=9a244477cb10469587f36d987c94ecdb&scope.project.id=d87423bf072e41a69237bf58f5e967c0&role.id=f7b5f822a48e4e269ab53ce00a04194e => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:58.200351 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21214907-ed49-4720-b9fd-b4c08e17c974 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:58.247812 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3a5a7-650e-4720-8bae-e359b5a98866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:58.248484 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3a5a7-650e-4720-8bae-e359b5a98866 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:58.248763 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3a5a7-650e-4720-8bae-e359b5a98866 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:58.249032 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d3a5a7-650e-4720-8bae-e359b5a98866 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:58.249785 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3a5a7-650e-4720-8bae-e359b5a98866 None admin] RBAC: Adding query filter params (name=member) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:58.250085 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3a5a7-650e-4720-8bae-e359b5a98866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:58.251522 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d3a5a7-650e-4720-8bae-e359b5a98866 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:58.260712 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 200/384] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:42:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:42:58.266501 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a245771-9101-4f51-814a-a7469af1e7c5 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:58.376164 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a245771-9101-4f51-814a-a7469af1e7c5 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:58.412338 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa69304-6416-4ab0-b2f5-e927ca5c7a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:58.413112 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa69304-6416-4ab0-b2f5-e927ca5c7a2b None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:58.413387 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa69304-6416-4ab0-b2f5-e927ca5c7a2b None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:58.413655 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa69304-6416-4ab0-b2f5-e927ca5c7a2b None admin] PATH_INFO: `/v3/groups/9a244477cb10469587f36d987c94ecdb` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:58.414864 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa69304-6416-4ab0-b2f5-e927ca5c7a2b None admin] RBAC: Authorizing `identity:get_group(group_id=9a244477cb10469587f36d987c94ecdb)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:58.416327 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa69304-6416-4ab0-b2f5-e927ca5c7a2b None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:58.417976 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 185/385] 10.222.0.24 () {56 vars in 1180 bytes} [Mon Apr 11 23:42:58 2022] GET /identity/v3/groups/9a244477cb10469587f36d987c94ecdb => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:58.423675 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3a5a7-650e-4720-8bae-e359b5a98866 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:58.530765 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d3a5a7-650e-4720-8bae-e359b5a98866 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:58.566439 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385d3a4-126d-493e-8328-4bc4518ab067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:58.567375 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385d3a4-126d-493e-8328-4bc4518ab067 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:58.567648 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385d3a4-126d-493e-8328-4bc4518ab067 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:58.567920 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385d3a4-126d-493e-8328-4bc4518ab067 None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:58.569150 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385d3a4-126d-493e-8328-4bc4518ab067 None admin] RBAC: Authorizing `identity:get_project(project_id=5563d83687534242a56eaa5054d6ed92)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:58.570602 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385d3a4-126d-493e-8328-4bc4518ab067 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:58.572573 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 201/386] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:58 2022] GET /identity/v3/projects/5563d83687534242a56eaa5054d6ed92 => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:58.578889 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa69304-6416-4ab0-b2f5-e927ca5c7a2b None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:58.685410 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa69304-6416-4ab0-b2f5-e927ca5c7a2b None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:58.718789 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfa33e-1909-4295-bee8-0069fdd825f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:58.719748 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfa33e-1909-4295-bee8-0069fdd825f9 None admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:58.720020 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfa33e-1909-4295-bee8-0069fdd825f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:58.720335 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfa33e-1909-4295-bee8-0069fdd825f9 None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92/groups/9a244477cb10469587f36d987c94ecdb/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:58.722283 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfa33e-1909-4295-bee8-0069fdd825f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5563d83687534242a56eaa5054d6ed92, group_id=9a244477cb10469587f36d987c94ecdb, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:58.724318 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfa33e-1909-4295-bee8-0069fdd825f9 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:58.799695 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 186/387] 10.222.0.24 () {58 vars in 1442 bytes} [Mon Apr 11 23:42:58 2022] PUT /identity/v3/projects/5563d83687534242a56eaa5054d6ed92/groups/9a244477cb10469587f36d987c94ecdb/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:42:59.165350 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab10978-a550-45e3-a7b9-981d14c3b36e None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:59.165750 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab10978-a550-45e3-a7b9-981d14c3b36e None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:59.165918 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab10978-a550-45e3-a7b9-981d14c3b36e None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:59.167974 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 202/388] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:42:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:42:59.173151 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51969c6b-d1df-4c11-b6b5-defd630b08db None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:59.173414 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51969c6b-d1df-4c11-b6b5-defd630b08db None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:59.173686 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51969c6b-d1df-4c11-b6b5-defd630b08db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:59.198324 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-51969c6b-d1df-4c11-b6b5-defd630b08db None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:42:59.199550 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-51969c6b-d1df-4c11-b6b5-defd630b08db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:42:59.287206 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 187/389] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:42:59.320702 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab10978-a550-45e3-a7b9-981d14c3b36e None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:59.444177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab10978-a550-45e3-a7b9-981d14c3b36e None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:59.484316 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3dde7f-0661-4635-be82-8e9b2bad94c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:59.485122 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3dde7f-0661-4635-be82-8e9b2bad94c4 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:59.485397 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3dde7f-0661-4635-be82-8e9b2bad94c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:59.485665 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3dde7f-0661-4635-be82-8e9b2bad94c4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:59.499527 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3dde7f-0661-4635-be82-8e9b2bad94c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:42:59.507163 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-ad3dde7f-0661-4635-be82-8e9b2bad94c4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 23:42:59.508741 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 203/390] 10.222.0.24 () {56 vars in 1114 bytes} [Mon Apr 11 23:42:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:42:59.514726 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51969c6b-d1df-4c11-b6b5-defd630b08db None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:59.615953 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51969c6b-d1df-4c11-b6b5-defd630b08db None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:59.654313 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379043c-c743-4037-9bd2-76f13e7a045a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:59.655009 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379043c-c743-4037-9bd2-76f13e7a045a None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:59.655287 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379043c-c743-4037-9bd2-76f13e7a045a None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:59.655552 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379043c-c743-4037-9bd2-76f13e7a045a None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:59.656303 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379043c-c743-4037-9bd2-76f13e7a045a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:42:59.656603 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379043c-c743-4037-9bd2-76f13e7a045a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:59.657951 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379043c-c743-4037-9bd2-76f13e7a045a None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:59.667236 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 188/391] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:42:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:59.672713 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3dde7f-0661-4635-be82-8e9b2bad94c4 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:59.808775 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3dde7f-0661-4635-be82-8e9b2bad94c4 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:42:59.850824 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd4abe-5752-4375-8291-7ab7a1fcdec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:42:59.851703 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd4abe-5752-4375-8291-7ab7a1fcdec5 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:42:59.851979 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd4abe-5752-4375-8291-7ab7a1fcdec5 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:42:59.852252 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd4abe-5752-4375-8291-7ab7a1fcdec5 None admin] PATH_INFO: `/v3/groups/9a244477cb10469587f36d987c94ecdb` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:42:59.853444 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd4abe-5752-4375-8291-7ab7a1fcdec5 None admin] RBAC: Authorizing `identity:get_group(group_id=9a244477cb10469587f36d987c94ecdb)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:42:59.854886 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd4abe-5752-4375-8291-7ab7a1fcdec5 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:42:59.856798 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 204/392] 10.222.0.24 () {56 vars in 1180 bytes} [Mon Apr 11 23:42:59 2022] GET /identity/v3/groups/9a244477cb10469587f36d987c94ecdb => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:42:59.861959 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379043c-c743-4037-9bd2-76f13e7a045a None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:42:59.963908 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379043c-c743-4037-9bd2-76f13e7a045a None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:00.001921 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbdac14-890a-46cf-a62d-257c501f8670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:00.002784 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdac14-890a-46cf-a62d-257c501f8670 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:00.003080 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdac14-890a-46cf-a62d-257c501f8670 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:00.003346 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbdac14-890a-46cf-a62d-257c501f8670 None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:00.004605 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbdac14-890a-46cf-a62d-257c501f8670 None admin] RBAC: Authorizing `identity:get_project(project_id=5563d83687534242a56eaa5054d6ed92)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:00.006024 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbdac14-890a-46cf-a62d-257c501f8670 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:00.008040 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 189/393] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:42:59 2022] GET /identity/v3/projects/5563d83687534242a56eaa5054d6ed92 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:00.013377 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd4abe-5752-4375-8291-7ab7a1fcdec5 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:00.137353 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd4abe-5752-4375-8291-7ab7a1fcdec5 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:00.171879 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de9047-2b3c-4acf-87a3-728ef5c9a321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:00.172756 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de9047-2b3c-4acf-87a3-728ef5c9a321 None admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:00.173034 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de9047-2b3c-4acf-87a3-728ef5c9a321 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:00.173352 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91de9047-2b3c-4acf-87a3-728ef5c9a321 None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92/groups/9a244477cb10469587f36d987c94ecdb/roles/f7b5f822a48e4e269ab53ce00a04194e` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:00.175599 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de9047-2b3c-4acf-87a3-728ef5c9a321 None admin] RBAC: Authorizing `identity:create_grant(project_id=5563d83687534242a56eaa5054d6ed92, group_id=9a244477cb10469587f36d987c94ecdb, role_id=f7b5f822a48e4e269ab53ce00a04194e)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:00.177646 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91de9047-2b3c-4acf-87a3-728ef5c9a321 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:00.224334 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0004d18-e68b-4731-91b8-e867399ae2ec None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:00.224957 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0004d18-e68b-4731-91b8-e867399ae2ec None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:00.225422 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0004d18-e68b-4731-91b8-e867399ae2ec None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:00.227416 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 190/394] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:43:00.232853 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d3e49-fe2e-471e-b0ea-9def0283aad8 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:00.233378 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d3e49-fe2e-471e-b0ea-9def0283aad8 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:00.233807 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d3e49-fe2e-471e-b0ea-9def0283aad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:00.254291 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-ba4d3e49-fe2e-471e-b0ea-9def0283aad8 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:00.255811 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-ba4d3e49-fe2e-471e-b0ea-9def0283aad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:00.266811 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 205/395] 10.222.0.24 () {58 vars in 1442 bytes} [Mon Apr 11 23:43:00 2022] PUT /identity/v3/projects/5563d83687534242a56eaa5054d6ed92/groups/9a244477cb10469587f36d987c94ecdb/roles/f7b5f822a48e4e269ab53ce00a04194e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:43:00.339011 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 191/396] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:00.378736 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de9047-2b3c-4acf-87a3-728ef5c9a321 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:00.499991 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91de9047-2b3c-4acf-87a3-728ef5c9a321 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:00.535364 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15540871-dade-4097-b8ba-07112c33736e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:00.536749 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15540871-dade-4097-b8ba-07112c33736e None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:00.537029 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15540871-dade-4097-b8ba-07112c33736e None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:00.537298 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15540871-dade-4097-b8ba-07112c33736e None admin] PATH_INFO: `/v3/roles/member` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:00.547864 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15540871-dade-4097-b8ba-07112c33736e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:00.555029 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-15540871-dade-4097-b8ba-07112c33736e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 23:43:00.556235 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 206/397] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:43:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:00.562104 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d3e49-fe2e-471e-b0ea-9def0283aad8 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:00.678979 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d3e49-fe2e-471e-b0ea-9def0283aad8 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:00.720450 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc98bdd-f5ac-47f5-b108-9b2615f41011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:00.721420 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc98bdd-f5ac-47f5-b108-9b2615f41011 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:00.721901 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc98bdd-f5ac-47f5-b108-9b2615f41011 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:00.722365 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc98bdd-f5ac-47f5-b108-9b2615f41011 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:00.723355 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc98bdd-f5ac-47f5-b108-9b2615f41011 None admin] RBAC: Adding query filter params (name=member) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:00.723835 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc98bdd-f5ac-47f5-b108-9b2615f41011 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:00.725376 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc98bdd-f5ac-47f5-b108-9b2615f41011 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:00.734583 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 192/398] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:43:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:00.740428 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15540871-dade-4097-b8ba-07112c33736e None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:00.849892 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15540871-dade-4097-b8ba-07112c33736e None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:00.889883 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a3a3c-f550-4cc0-b10e-5f524028a803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:00.891147 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a3a3c-f550-4cc0-b10e-5f524028a803 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:00.891650 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a3a3c-f550-4cc0-b10e-5f524028a803 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:00.892123 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a3a3c-f550-4cc0-b10e-5f524028a803 None admin] PATH_INFO: `/v3/groups/9a244477cb10469587f36d987c94ecdb` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:00.893521 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a3a3c-f550-4cc0-b10e-5f524028a803 None admin] RBAC: Authorizing `identity:get_group(group_id=9a244477cb10469587f36d987c94ecdb)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:00.895726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a3a3c-f550-4cc0-b10e-5f524028a803 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:00.897561 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 207/399] 10.222.0.24 () {56 vars in 1180 bytes} [Mon Apr 11 23:43:00 2022] GET /identity/v3/groups/9a244477cb10469587f36d987c94ecdb => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:00.903905 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc98bdd-f5ac-47f5-b108-9b2615f41011 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:01.042450 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc98bdd-f5ac-47f5-b108-9b2615f41011 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:01.084521 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fc6afe-d88a-4a2e-8295-08548bafb972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:01.085754 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc6afe-d88a-4a2e-8295-08548bafb972 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:01.086276 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc6afe-d88a-4a2e-8295-08548bafb972 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:01.086776 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fc6afe-d88a-4a2e-8295-08548bafb972 None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:01.088490 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc6afe-d88a-4a2e-8295-08548bafb972 None admin] RBAC: Authorizing `identity:get_project(project_id=d87423bf072e41a69237bf58f5e967c0)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:01.090127 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fc6afe-d88a-4a2e-8295-08548bafb972 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:01.092068 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 193/400] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:43:00 2022] GET /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:01.097752 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a3a3c-f550-4cc0-b10e-5f524028a803 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:01.203358 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a3a3c-f550-4cc0-b10e-5f524028a803 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:01.242119 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f25b85-1c8d-47b8-bd81-75ba82c979e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:01.243367 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f25b85-1c8d-47b8-bd81-75ba82c979e1 None admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:01.243851 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f25b85-1c8d-47b8-bd81-75ba82c979e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:01.244322 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f25b85-1c8d-47b8-bd81-75ba82c979e1 None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0/groups/9a244477cb10469587f36d987c94ecdb/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:01.246541 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f25b85-1c8d-47b8-bd81-75ba82c979e1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d87423bf072e41a69237bf58f5e967c0, group_id=9a244477cb10469587f36d987c94ecdb, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:01.248202 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f25b85-1c8d-47b8-bd81-75ba82c979e1 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:01.289891 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60d5ba-08d0-4313-96df-f025c29e548f None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:01.290513 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60d5ba-08d0-4313-96df-f025c29e548f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:01.291025 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60d5ba-08d0-4313-96df-f025c29e548f None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:01.293330 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 194/401] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:43:01.298470 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2a312-bfe0-488b-b535-a017eb64ab6c None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:01.299074 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2a312-bfe0-488b-b535-a017eb64ab6c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:01.299412 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2a312-bfe0-488b-b535-a017eb64ab6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:01.317399 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-e5f2a312-bfe0-488b-b535-a017eb64ab6c None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:01.318568 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-e5f2a312-bfe0-488b-b535-a017eb64ab6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:01.332079 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 208/402] 10.222.0.24 () {58 vars in 1442 bytes} [Mon Apr 11 23:43:01 2022] PUT /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0/groups/9a244477cb10469587f36d987c94ecdb/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:43:01.334492 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b196e0-ed8e-4e28-bcf8-dc6aa26cdaec None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:01.335246 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b196e0-ed8e-4e28-bcf8-dc6aa26cdaec None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:01.336108 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b196e0-ed8e-4e28-bcf8-dc6aa26cdaec None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:01.343650 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 209/403] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:01.345763 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b899a3e-1284-43b1-b6bf-1b51523ca34d None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:01.346232 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b899a3e-1284-43b1-b6bf-1b51523ca34d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:01.346892 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b899a3e-1284-43b1-b6bf-1b51523ca34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:01.369717 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-8b899a3e-1284-43b1-b6bf-1b51523ca34d None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:01.371408 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-8b899a3e-1284-43b1-b6bf-1b51523ca34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:01.445584 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 195/404] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:43:01.453773 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 210/405] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:01.477753 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2a312-bfe0-488b-b535-a017eb64ab6c None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:01.484842 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b899a3e-1284-43b1-b6bf-1b51523ca34d None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:01.604196 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b899a3e-1284-43b1-b6bf-1b51523ca34d None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:01.648357 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5815a-291c-4b22-a84b-4f93e713f2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:01.649590 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5815a-291c-4b22-a84b-4f93e713f2f8 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:01.650018 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5815a-291c-4b22-a84b-4f93e713f2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:01.650746 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e5815a-291c-4b22-a84b-4f93e713f2f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:01.653190 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2a312-bfe0-488b-b535-a017eb64ab6c None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:01.664444 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e5815a-291c-4b22-a84b-4f93e713f2f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:01.674224 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-28e5815a-291c-4b22-a84b-4f93e713f2f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 23:43:01.676691 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 211/406] 10.222.0.24 () {56 vars in 1114 bytes} [Mon Apr 11 23:43:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:01.682556 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5815a-291c-4b22-a84b-4f93e713f2f8 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:01.690860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c82e6-bfb2-4335-878a-fa40300b64a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:01.692445 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c82e6-bfb2-4335-878a-fa40300b64a3 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:01.699285 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c82e6-bfb2-4335-878a-fa40300b64a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:01.699661 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c82e6-bfb2-4335-878a-fa40300b64a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:01.717062 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c82e6-bfb2-4335-878a-fa40300b64a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:01.724358 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-6d0c82e6-bfb2-4335-878a-fa40300b64a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:43:01.725690 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 196/407] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:43:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:01.741874 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c82e6-bfb2-4335-878a-fa40300b64a3 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:01.799508 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e5815a-291c-4b22-a84b-4f93e713f2f8 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:01.836445 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812711bd-375e-4ba5-a859-7f705e8e2288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:01.837572 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812711bd-375e-4ba5-a859-7f705e8e2288 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:01.839057 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812711bd-375e-4ba5-a859-7f705e8e2288 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:01.839057 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812711bd-375e-4ba5-a859-7f705e8e2288 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:01.839628 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812711bd-375e-4ba5-a859-7f705e8e2288 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:01.839940 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812711bd-375e-4ba5-a859-7f705e8e2288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:01.841321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812711bd-375e-4ba5-a859-7f705e8e2288 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:01.854064 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 212/408] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:01.855714 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e5e76-4562-492e-9901-af2df8b103d0 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:01.856586 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e5e76-4562-492e-9901-af2df8b103d0 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:01.857072 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95e5e76-4562-492e-9901-af2df8b103d0 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:01.860091 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 213/409] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:01.861332 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e5e76-4562-492e-9901-af2df8b103d0 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:01.903888 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c82e6-bfb2-4335-878a-fa40300b64a3 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:01.938303 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96be97-dadf-4ca2-9d8c-8b9bb10224db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:01.939100 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96be97-dadf-4ca2-9d8c-8b9bb10224db None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:01.939394 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96be97-dadf-4ca2-9d8c-8b9bb10224db None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:01.939661 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96be97-dadf-4ca2-9d8c-8b9bb10224db None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:01.940393 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96be97-dadf-4ca2-9d8c-8b9bb10224db None admin] RBAC: Adding query filter params (name=admin) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:01.940853 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96be97-dadf-4ca2-9d8c-8b9bb10224db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:01.942602 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96be97-dadf-4ca2-9d8c-8b9bb10224db None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:01.955577 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 197/410] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:43:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:01.955577 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245802b-67f6-44e9-a6d0-c62b1ccf2614 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:01.955577 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245802b-67f6-44e9-a6d0-c62b1ccf2614 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:01.955577 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245802b-67f6-44e9-a6d0-c62b1ccf2614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:01.972114 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-8245802b-67f6-44e9-a6d0-c62b1ccf2614 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:01.973538 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-8245802b-67f6-44e9-a6d0-c62b1ccf2614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:01.999359 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95e5e76-4562-492e-9901-af2df8b103d0 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:02.041150 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 198/411] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:02.043160 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca7b8b-94d1-46ea-8e05-bc176d09063f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:02.058949 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca7b8b-94d1-46ea-8e05-bc176d09063f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:02.058949 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca7b8b-94d1-46ea-8e05-bc176d09063f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:02.058949 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca7b8b-94d1-46ea-8e05-bc176d09063f None admin] PATH_INFO: `/v3/groups/9a244477cb10469587f36d987c94ecdb` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:02.058949 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca7b8b-94d1-46ea-8e05-bc176d09063f None admin] RBAC: Authorizing `identity:get_group(group_id=9a244477cb10469587f36d987c94ecdb)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:02.058949 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca7b8b-94d1-46ea-8e05-bc176d09063f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:02.059316 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245802b-67f6-44e9-a6d0-c62b1ccf2614 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:02.059390 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 214/412] 10.222.0.24 () {56 vars in 1180 bytes} [Mon Apr 11 23:43:01 2022] GET /identity/v3/groups/9a244477cb10469587f36d987c94ecdb => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:02.060245 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca7b8b-94d1-46ea-8e05-bc176d09063f None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:02.158475 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245802b-67f6-44e9-a6d0-c62b1ccf2614 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:02.175294 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca7b8b-94d1-46ea-8e05-bc176d09063f None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:02.191542 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d18c72-8c85-47f3-b692-97b3bb9d9dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:02.192946 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d18c72-8c85-47f3-b692-97b3bb9d9dc5 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:02.193217 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d18c72-8c85-47f3-b692-97b3bb9d9dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:02.193485 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d18c72-8c85-47f3-b692-97b3bb9d9dc5 None admin] PATH_INFO: `/v3/groups/4655538b608d4e63a223dfb5a755bd87` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:02.194652 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d18c72-8c85-47f3-b692-97b3bb9d9dc5 None admin] RBAC: Authorizing `identity:get_group(group_id=4655538b608d4e63a223dfb5a755bd87)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:02.196105 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d18c72-8c85-47f3-b692-97b3bb9d9dc5 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:02.198052 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 199/413] 10.222.0.24 () {56 vars in 1180 bytes} [Mon Apr 11 23:43:02 2022] GET /identity/v3/groups/4655538b608d4e63a223dfb5a755bd87 => generated 229 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:02.198811 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d18c72-8c85-47f3-b692-97b3bb9d9dc5 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:02.209709 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493181e3-d426-40ae-a149-d5deb5a65f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:02.210568 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493181e3-d426-40ae-a149-d5deb5a65f0f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:02.210874 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493181e3-d426-40ae-a149-d5deb5a65f0f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:02.211197 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493181e3-d426-40ae-a149-d5deb5a65f0f None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:02.212503 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493181e3-d426-40ae-a149-d5deb5a65f0f None admin] RBAC: Authorizing `identity:get_project(project_id=d87423bf072e41a69237bf58f5e967c0)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:02.214192 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493181e3-d426-40ae-a149-d5deb5a65f0f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:02.215896 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 215/414] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:43:02 2022] GET /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:02.216648 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493181e3-d426-40ae-a149-d5deb5a65f0f None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:02.302544 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d18c72-8c85-47f3-b692-97b3bb9d9dc5 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:02.316266 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493181e3-d426-40ae-a149-d5deb5a65f0f None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:02.346522 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d7f09-4afb-42c8-a225-186a5de29424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:02.347348 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d7f09-4afb-42c8-a225-186a5de29424 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:02.347624 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d7f09-4afb-42c8-a225-186a5de29424 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:02.347891 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d7f09-4afb-42c8-a225-186a5de29424 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:02.350072 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7c15b-e9a8-4334-bbb5-eb236ebb1a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:02.351018 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7c15b-e9a8-4334-bbb5-eb236ebb1a22 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:02.351361 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7c15b-e9a8-4334-bbb5-eb236ebb1a22 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:02.351715 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7c15b-e9a8-4334-bbb5-eb236ebb1a22 None admin] PATH_INFO: `/v3/projects/1da535e2d1e54da3b958d1c813082f2d` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:02.352973 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7c15b-e9a8-4334-bbb5-eb236ebb1a22 None admin] RBAC: Authorizing `identity:get_project(project_id=1da535e2d1e54da3b958d1c813082f2d)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:02.354456 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f7c15b-e9a8-4334-bbb5-eb236ebb1a22 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:02.356241 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 216/415] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:43:02 2022] GET /identity/v3/projects/1da535e2d1e54da3b958d1c813082f2d => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:02.357109 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7c15b-e9a8-4334-bbb5-eb236ebb1a22 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:02.359230 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d7f09-4afb-42c8-a225-186a5de29424 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:02.368464 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-ba1d7f09-4afb-42c8-a225-186a5de29424 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 23:43:02.370627 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 200/416] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:43:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:02.375764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d7f09-4afb-42c8-a225-186a5de29424 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:02.463927 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7c15b-e9a8-4334-bbb5-eb236ebb1a22 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:02.497672 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1d908-1413-4923-a193-cf850049af1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:02.498588 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1d908-1413-4923-a193-cf850049af1b None admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:02.498881 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1d908-1413-4923-a193-cf850049af1b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:02.499152 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1d908-1413-4923-a193-cf850049af1b None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0/groups/9a244477cb10469587f36d987c94ecdb/roles/f7b5f822a48e4e269ab53ce00a04194e` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:02.501368 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1d908-1413-4923-a193-cf850049af1b None admin] RBAC: Authorizing `identity:create_grant(project_id=d87423bf072e41a69237bf58f5e967c0, group_id=9a244477cb10469587f36d987c94ecdb, role_id=f7b5f822a48e4e269ab53ce00a04194e)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:02.502792 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1d908-1413-4923-a193-cf850049af1b None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:02.503312 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d7f09-4afb-42c8-a225-186a5de29424 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:02.537821 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded31a3-e159-41c5-80fe-ca75813540e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:02.538702 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded31a3-e159-41c5-80fe-ca75813540e0 None admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:02.539014 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded31a3-e159-41c5-80fe-ca75813540e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:02.539289 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded31a3-e159-41c5-80fe-ca75813540e0 None admin] PATH_INFO: `/v3/projects/1da535e2d1e54da3b958d1c813082f2d/groups/4655538b608d4e63a223dfb5a755bd87/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:02.541258 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded31a3-e159-41c5-80fe-ca75813540e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=1da535e2d1e54da3b958d1c813082f2d, group_id=4655538b608d4e63a223dfb5a755bd87, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:02.542683 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded31a3-e159-41c5-80fe-ca75813540e0 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:02.579000 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 217/417] 10.222.0.24 () {58 vars in 1442 bytes} [Mon Apr 11 23:43:02 2022] PUT /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0/groups/9a244477cb10469587f36d987c94ecdb/roles/f7b5f822a48e4e269ab53ce00a04194e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:43:02.579000 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1d908-1413-4923-a193-cf850049af1b None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:02.653379 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 201/418] 10.222.0.24 () {58 vars in 1442 bytes} [Mon Apr 11 23:43:02 2022] PUT /identity/v3/projects/1da535e2d1e54da3b958d1c813082f2d/groups/4655538b608d4e63a223dfb5a755bd87/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:43:02.704411 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1d908-1413-4923-a193-cf850049af1b None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:02.743785 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bf6c3-cb17-4cb5-8992-a4adbf3cb74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:02.744426 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bf6c3-cb17-4cb5-8992-a4adbf3cb74f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:02.744711 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bf6c3-cb17-4cb5-8992-a4adbf3cb74f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:02.744986 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4bf6c3-cb17-4cb5-8992-a4adbf3cb74f None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:02.745810 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4bf6c3-cb17-4cb5-8992-a4adbf3cb74f None admin] RBAC: Adding query filter params (name=member) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:02.746123 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4bf6c3-cb17-4cb5-8992-a4adbf3cb74f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:02.747678 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4bf6c3-cb17-4cb5-8992-a4adbf3cb74f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:02.762823 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 218/419] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:43:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:02.768571 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded31a3-e159-41c5-80fe-ca75813540e0 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:02.917611 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded31a3-e159-41c5-80fe-ca75813540e0 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:02.954370 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe92c5-592f-4669-ba9b-32b9e97e089b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:02.955423 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe92c5-592f-4669-ba9b-32b9e97e089b None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:02.955901 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe92c5-592f-4669-ba9b-32b9e97e089b None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:02.956364 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe92c5-592f-4669-ba9b-32b9e97e089b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:03.026022 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe92c5-592f-4669-ba9b-32b9e97e089b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:03.027938 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe92c5-592f-4669-ba9b-32b9e97e089b None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:03.137249 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 202/420] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:43:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:43:03.142514 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bf6c3-cb17-4cb5-8992-a4adbf3cb74f None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:03.269374 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4bf6c3-cb17-4cb5-8992-a4adbf3cb74f None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:03.296040 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c56952-d11e-47dc-9357-3f62fa53a9e1 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:03.296636 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c56952-d11e-47dc-9357-3f62fa53a9e1 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:03.297131 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c56952-d11e-47dc-9357-3f62fa53a9e1 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:03.299140 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 203/421] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:03.304840 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9691f06-e12e-4e17-9d84-8e21b9034161 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:03.305235 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9691f06-e12e-4e17-9d84-8e21b9034161 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:03.305738 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9691f06-e12e-4e17-9d84-8e21b9034161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:03.323084 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-f9691f06-e12e-4e17-9d84-8e21b9034161 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:03.324115 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a949d-98c1-41e9-89ca-80280cedc225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:03.324835 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-f9691f06-e12e-4e17-9d84-8e21b9034161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:03.325015 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a949d-98c1-41e9-89ca-80280cedc225 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:03.325261 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a949d-98c1-41e9-89ca-80280cedc225 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:03.325535 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a949d-98c1-41e9-89ca-80280cedc225 None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:03.326748 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a949d-98c1-41e9-89ca-80280cedc225 None admin] RBAC: Authorizing `identity:get_project(project_id=5563d83687534242a56eaa5054d6ed92)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:03.328208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a949d-98c1-41e9-89ca-80280cedc225 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:03.330895 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 219/422] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:43:03 2022] GET /identity/v3/projects/5563d83687534242a56eaa5054d6ed92 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:03.335602 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a949d-98c1-41e9-89ca-80280cedc225 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:03.449618 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 204/423] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:43:03.497172 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a949d-98c1-41e9-89ca-80280cedc225 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:03.510000 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9691f06-e12e-4e17-9d84-8e21b9034161 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:03.560730 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b363f10-5efd-47bc-b307-0ac959c6fa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:03.561915 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b363f10-5efd-47bc-b307-0ac959c6fa9b None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:03.562417 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b363f10-5efd-47bc-b307-0ac959c6fa9b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:03.562913 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b363f10-5efd-47bc-b307-0ac959c6fa9b None admin] PATH_INFO: `/v3/groups/9a244477cb10469587f36d987c94ecdb` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:03.564996 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b363f10-5efd-47bc-b307-0ac959c6fa9b None admin] RBAC: Authorizing `identity:get_group(group_id=9a244477cb10469587f36d987c94ecdb)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:03.571711 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b363f10-5efd-47bc-b307-0ac959c6fa9b None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:03.573618 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 220/424] 10.222.0.24 () {56 vars in 1180 bytes} [Mon Apr 11 23:43:03 2022] GET /identity/v3/groups/9a244477cb10469587f36d987c94ecdb => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:03.580454 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b363f10-5efd-47bc-b307-0ac959c6fa9b None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:03.664774 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9691f06-e12e-4e17-9d84-8e21b9034161 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:03.703274 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5309043-c7af-4c38-9ed4-f22d43b92dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:03.704426 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5309043-c7af-4c38-9ed4-f22d43b92dc5 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:03.704935 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5309043-c7af-4c38-9ed4-f22d43b92dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:03.705419 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5309043-c7af-4c38-9ed4-f22d43b92dc5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:03.718440 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5309043-c7af-4c38-9ed4-f22d43b92dc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:03.728471 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-f5309043-c7af-4c38-9ed4-f22d43b92dc5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 23:43:03.729961 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 205/425] 10.222.0.24 () {56 vars in 1114 bytes} [Mon Apr 11 23:43:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:03.740167 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5309043-c7af-4c38-9ed4-f22d43b92dc5 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:03.785025 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b363f10-5efd-47bc-b307-0ac959c6fa9b None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:03.865775 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5309043-c7af-4c38-9ed4-f22d43b92dc5 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:03.887526 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b938757-5645-48f4-9de1-44e358c76958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:03.888183 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b938757-5645-48f4-9de1-44e358c76958 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:03.888465 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b938757-5645-48f4-9de1-44e358c76958 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:03.888740 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b938757-5645-48f4-9de1-44e358c76958 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:03.889583 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b938757-5645-48f4-9de1-44e358c76958 None admin] RBAC: Adding query filter params (group.id=9a244477cb10469587f36d987c94ecdb, role.id=d0f74491c28e4d1094a60391d71c2246, scope.project.id=5563d83687534242a56eaa5054d6ed92) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:03.889891 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b938757-5645-48f4-9de1-44e358c76958 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:03.891354 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b938757-5645-48f4-9de1-44e358c76958 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:03.900904 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71cdc78-33b6-46b1-8eb5-2439b3fbd009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:03.901718 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cdc78-33b6-46b1-8eb5-2439b3fbd009 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:03.902153 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cdc78-33b6-46b1-8eb5-2439b3fbd009 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:03.902432 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71cdc78-33b6-46b1-8eb5-2439b3fbd009 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:03.903202 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cdc78-33b6-46b1-8eb5-2439b3fbd009 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:03.903504 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cdc78-33b6-46b1-8eb5-2439b3fbd009 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:03.904856 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71cdc78-33b6-46b1-8eb5-2439b3fbd009 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:03.909322 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 221/426] 10.222.0.24 () {56 vars in 1376 bytes} [Mon Apr 11 23:43:03 2022] GET /identity/v3/role_assignments?group.id=9a244477cb10469587f36d987c94ecdb&scope.project.id=5563d83687534242a56eaa5054d6ed92&role.id=d0f74491c28e4d1094a60391d71c2246 => generated 611 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:03.914032 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 206/427] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:03.919639 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b938757-5645-48f4-9de1-44e358c76958 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:03.968100 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf452dd-6ede-498b-8a72-87f7764dd53f None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:03.968414 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf452dd-6ede-498b-8a72-87f7764dd53f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:03.968655 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf452dd-6ede-498b-8a72-87f7764dd53f None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:03.970662 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 207/428] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:43:03.978277 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab917097-fdf2-4f65-94bf-47789be0b134 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:03.978586 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab917097-fdf2-4f65-94bf-47789be0b134 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:03.978861 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab917097-fdf2-4f65-94bf-47789be0b134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:04.007855 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-ab917097-fdf2-4f65-94bf-47789be0b134 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:04.009052 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-ab917097-fdf2-4f65-94bf-47789be0b134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:04.083957 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b938757-5645-48f4-9de1-44e358c76958 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:04.145994 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 208/429] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:04.148290 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbd4b9-4d86-4c0c-aff3-bbedf50689a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:04.148940 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbd4b9-4d86-4c0c-aff3-bbedf50689a9 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:04.149218 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbd4b9-4d86-4c0c-aff3-bbedf50689a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:04.149486 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cbd4b9-4d86-4c0c-aff3-bbedf50689a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:04.188731 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab917097-fdf2-4f65-94bf-47789be0b134 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:04.230038 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbd4b9-4d86-4c0c-aff3-bbedf50689a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:04.231869 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cbd4b9-4d86-4c0c-aff3-bbedf50689a9 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:04.312493 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab917097-fdf2-4f65-94bf-47789be0b134 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:04.358468 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae6d86-8a28-4736-9ba4-8f1f91124ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:04.359307 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae6d86-8a28-4736-9ba4-8f1f91124ba2 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:04.359590 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae6d86-8a28-4736-9ba4-8f1f91124ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:04.359863 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae6d86-8a28-4736-9ba4-8f1f91124ba2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:04.360420 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 222/430] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:43:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:43:04.366103 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbd4b9-4d86-4c0c-aff3-bbedf50689a9 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:04.376455 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ae6d86-8a28-4736-9ba4-8f1f91124ba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:04.384248 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-b1ae6d86-8a28-4736-9ba4-8f1f91124ba2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Apr 11 23:43:04.386007 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 209/431] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:43:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:04.393693 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae6d86-8a28-4736-9ba4-8f1f91124ba2 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:04.470924 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cbd4b9-4d86-4c0c-aff3-bbedf50689a9 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:04.502427 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae6d86-8a28-4736-9ba4-8f1f91124ba2 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:04.505782 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce690e-7abb-4ae9-899e-bf571d3158f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:04.506919 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce690e-7abb-4ae9-899e-bf571d3158f6 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:04.507418 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce690e-7abb-4ae9-899e-bf571d3158f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:04.507902 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce690e-7abb-4ae9-899e-bf571d3158f6 None admin] PATH_INFO: `/v3/projects/5563d83687534242a56eaa5054d6ed92` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:04.509283 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce690e-7abb-4ae9-899e-bf571d3158f6 None admin] RBAC: Authorizing `identity:get_project(project_id=5563d83687534242a56eaa5054d6ed92)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:04.510914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ce690e-7abb-4ae9-899e-bf571d3158f6 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:04.513094 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 223/432] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:43:04 2022] GET /identity/v3/projects/5563d83687534242a56eaa5054d6ed92 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:04.518373 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce690e-7abb-4ae9-899e-bf571d3158f6 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:04.541897 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecf671-8c78-4075-a499-a5e28d577180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:04.542591 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecf671-8c78-4075-a499-a5e28d577180 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:04.543234 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecf671-8c78-4075-a499-a5e28d577180 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:04.543234 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ecf671-8c78-4075-a499-a5e28d577180 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:04.543901 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ecf671-8c78-4075-a499-a5e28d577180 None admin] RBAC: Adding query filter params (name=member) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:04.544206 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ecf671-8c78-4075-a499-a5e28d577180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:04.545577 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ecf671-8c78-4075-a499-a5e28d577180 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:04.555275 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 210/433] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:43:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:04.573931 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecf671-8c78-4075-a499-a5e28d577180 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:04.626581 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce690e-7abb-4ae9-899e-bf571d3158f6 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:04.663489 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05076b15-bd9c-4fee-94cc-225194d97f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:04.664696 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05076b15-bd9c-4fee-94cc-225194d97f9d None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:04.665191 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05076b15-bd9c-4fee-94cc-225194d97f9d None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:04.665657 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05076b15-bd9c-4fee-94cc-225194d97f9d None admin] PATH_INFO: `/v3/groups/9a244477cb10469587f36d987c94ecdb` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:04.667074 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05076b15-bd9c-4fee-94cc-225194d97f9d None admin] RBAC: Authorizing `identity:get_group(group_id=9a244477cb10469587f36d987c94ecdb)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:04.668716 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05076b15-bd9c-4fee-94cc-225194d97f9d None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:04.670866 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 224/434] 10.222.0.24 () {56 vars in 1180 bytes} [Mon Apr 11 23:43:04 2022] GET /identity/v3/groups/9a244477cb10469587f36d987c94ecdb => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:04.679920 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05076b15-bd9c-4fee-94cc-225194d97f9d None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:04.683458 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ecf671-8c78-4075-a499-a5e28d577180 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:04.718600 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86565b9a-9bb7-4e4c-909e-c444b44a0845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:04.719050 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86565b9a-9bb7-4e4c-909e-c444b44a0845 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:04.719294 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86565b9a-9bb7-4e4c-909e-c444b44a0845 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:04.719565 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86565b9a-9bb7-4e4c-909e-c444b44a0845 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:04.787736 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86565b9a-9bb7-4e4c-909e-c444b44a0845 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:04.789194 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86565b9a-9bb7-4e4c-909e-c444b44a0845 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:04.798427 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05076b15-bd9c-4fee-94cc-225194d97f9d None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:04.834441 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba78ac-2db1-4f5b-9b30-f6446f1c42da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:04.835512 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba78ac-2db1-4f5b-9b30-f6446f1c42da None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:04.836005 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba78ac-2db1-4f5b-9b30-f6446f1c42da None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:04.836639 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba78ac-2db1-4f5b-9b30-f6446f1c42da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:04.837669 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba78ac-2db1-4f5b-9b30-f6446f1c42da None admin] RBAC: Adding query filter params (group.id=9a244477cb10469587f36d987c94ecdb, role.id=f7b5f822a48e4e269ab53ce00a04194e, scope.project.id=5563d83687534242a56eaa5054d6ed92) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:04.838438 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba78ac-2db1-4f5b-9b30-f6446f1c42da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:04.840144 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba78ac-2db1-4f5b-9b30-f6446f1c42da None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:04.846746 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 225/435] 10.222.0.24 () {56 vars in 1376 bytes} [Mon Apr 11 23:43:04 2022] GET /identity/v3/role_assignments?group.id=9a244477cb10469587f36d987c94ecdb&scope.project.id=5563d83687534242a56eaa5054d6ed92&role.id=f7b5f822a48e4e269ab53ce00a04194e => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:04.898965 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 211/436] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:43:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 23:43:04.901147 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba78ac-2db1-4f5b-9b30-f6446f1c42da None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:05.020580 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba78ac-2db1-4f5b-9b30-f6446f1c42da None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:05.060170 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32524287-393f-4df5-8042-fc96c2821789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:05.061355 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32524287-393f-4df5-8042-fc96c2821789 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:05.061841 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32524287-393f-4df5-8042-fc96c2821789 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:05.062287 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32524287-393f-4df5-8042-fc96c2821789 None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:05.063719 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32524287-393f-4df5-8042-fc96c2821789 None admin] RBAC: Authorizing `identity:get_project(project_id=d87423bf072e41a69237bf58f5e967c0)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:05.065982 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32524287-393f-4df5-8042-fc96c2821789 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:05.070935 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 226/437] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:43:04 2022] GET /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:05.074126 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86565b9a-9bb7-4e4c-909e-c444b44a0845 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:05.188821 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86565b9a-9bb7-4e4c-909e-c444b44a0845 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:05.226320 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539348f1-0fdd-46e7-915a-66a795c3f8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:05.227233 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539348f1-0fdd-46e7-915a-66a795c3f8da None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:05.227612 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539348f1-0fdd-46e7-915a-66a795c3f8da None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:05.227890 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539348f1-0fdd-46e7-915a-66a795c3f8da None admin] PATH_INFO: `/v3/groups/9a244477cb10469587f36d987c94ecdb` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:05.229087 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539348f1-0fdd-46e7-915a-66a795c3f8da None admin] RBAC: Authorizing `identity:get_group(group_id=9a244477cb10469587f36d987c94ecdb)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:05.230534 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539348f1-0fdd-46e7-915a-66a795c3f8da None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:05.232510 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 212/438] 10.222.0.24 () {56 vars in 1180 bytes} [Mon Apr 11 23:43:05 2022] GET /identity/v3/groups/9a244477cb10469587f36d987c94ecdb => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:05.238474 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32524287-393f-4df5-8042-fc96c2821789 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:05.340958 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32524287-393f-4df5-8042-fc96c2821789 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:05.376004 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0353779-b9d0-4437-837c-07a6f0823974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:05.376655 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0353779-b9d0-4437-837c-07a6f0823974 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:05.376932 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0353779-b9d0-4437-837c-07a6f0823974 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:05.377201 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0353779-b9d0-4437-837c-07a6f0823974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:05.378035 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0353779-b9d0-4437-837c-07a6f0823974 None admin] RBAC: Adding query filter params (group.id=9a244477cb10469587f36d987c94ecdb, role.id=d0f74491c28e4d1094a60391d71c2246, scope.project.id=d87423bf072e41a69237bf58f5e967c0) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:05.378341 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0353779-b9d0-4437-837c-07a6f0823974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:05.379824 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0353779-b9d0-4437-837c-07a6f0823974 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:05.385629 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 227/439] 10.222.0.24 () {56 vars in 1376 bytes} [Mon Apr 11 23:43:05 2022] GET /identity/v3/role_assignments?group.id=9a244477cb10469587f36d987c94ecdb&scope.project.id=d87423bf072e41a69237bf58f5e967c0&role.id=d0f74491c28e4d1094a60391d71c2246 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:05.398185 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff85f2e-fc21-4d4e-86f2-29d8d432289c None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:05.398487 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff85f2e-fc21-4d4e-86f2-29d8d432289c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:05.398741 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff85f2e-fc21-4d4e-86f2-29d8d432289c None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:05.400802 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 213/440] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:05.406596 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf4c7a-f512-49d2-8326-f13ad27a04d2 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:05.406956 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf4c7a-f512-49d2-8326-f13ad27a04d2 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:05.407205 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf4c7a-f512-49d2-8326-f13ad27a04d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:05.425404 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-d9bf4c7a-f512-49d2-8326-f13ad27a04d2 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:05.427325 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d9bf4c7a-f512-49d2-8326-f13ad27a04d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:05.495634 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229f2dc-b58e-48b7-9589-ba2ea7d806e8 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:05.495918 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229f2dc-b58e-48b7-9589-ba2ea7d806e8 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:05.496263 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9229f2dc-b58e-48b7-9589-ba2ea7d806e8 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:05.498882 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 214/441] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:43:05.499006 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 228/442] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:05.503358 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb4597-3cf7-4a16-b5d2-d57aec32256e None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:05.503644 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb4597-3cf7-4a16-b5d2-d57aec32256e None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:05.503920 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb4597-3cf7-4a16-b5d2-d57aec32256e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:05.521353 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-fdbb4597-3cf7-4a16-b5d2-d57aec32256e None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:05.521761 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf4c7a-f512-49d2-8326-f13ad27a04d2 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:05.522552 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-fdbb4597-3cf7-4a16-b5d2-d57aec32256e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:05.604930 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 215/443] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:05.627819 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb4597-3cf7-4a16-b5d2-d57aec32256e None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:05.633527 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf4c7a-f512-49d2-8326-f13ad27a04d2 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:05.672150 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f17f21-d877-41a4-ace9-11d77f1f7209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:05.673337 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f17f21-d877-41a4-ace9-11d77f1f7209 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:05.673337 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f17f21-d877-41a4-ace9-11d77f1f7209 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:05.673535 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f17f21-d877-41a4-ace9-11d77f1f7209 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:05.683568 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f17f21-d877-41a4-ace9-11d77f1f7209 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:05.690667 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-b9f17f21-d877-41a4-ace9-11d77f1f7209 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:43:05.692188 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 229/444] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:43:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:05.698122 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f17f21-d877-41a4-ace9-11d77f1f7209 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:05.734725 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb4597-3cf7-4a16-b5d2-d57aec32256e None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:05.773934 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949e250-3759-468e-b604-f4d45adf6105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:05.774784 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949e250-3759-468e-b604-f4d45adf6105 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:05.775108 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949e250-3759-468e-b604-f4d45adf6105 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:05.775376 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949e250-3759-468e-b604-f4d45adf6105 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:05.787225 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6949e250-3759-468e-b604-f4d45adf6105 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:05.794568 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-6949e250-3759-468e-b604-f4d45adf6105 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 23:43:05.795772 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 216/445] 10.222.0.24 () {56 vars in 1114 bytes} [Mon Apr 11 23:43:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:05.801317 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949e250-3759-468e-b604-f4d45adf6105 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:05.808840 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f17f21-d877-41a4-ace9-11d77f1f7209 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:05.840453 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fbdab-80ca-4275-9665-4ab0676579e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:05.841107 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fbdab-80ca-4275-9665-4ab0676579e4 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:05.841387 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fbdab-80ca-4275-9665-4ab0676579e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:05.841660 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32fbdab-80ca-4275-9665-4ab0676579e4 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:05.842403 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fbdab-80ca-4275-9665-4ab0676579e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:05.842709 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fbdab-80ca-4275-9665-4ab0676579e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:05.844099 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32fbdab-80ca-4275-9665-4ab0676579e4 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:05.852415 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 230/446] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:43:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:05.857786 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fbdab-80ca-4275-9665-4ab0676579e4 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:05.893965 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949e250-3759-468e-b604-f4d45adf6105 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:05.925483 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f26d3f-f966-4f0b-9cbe-4f6c5631be44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:05.926152 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f26d3f-f966-4f0b-9cbe-4f6c5631be44 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:05.926428 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f26d3f-f966-4f0b-9cbe-4f6c5631be44 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:05.926699 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f26d3f-f966-4f0b-9cbe-4f6c5631be44 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:05.927467 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f26d3f-f966-4f0b-9cbe-4f6c5631be44 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:05.927765 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f26d3f-f966-4f0b-9cbe-4f6c5631be44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:05.929105 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f26d3f-f966-4f0b-9cbe-4f6c5631be44 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:05.936504 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 217/447] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:05.942480 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f26d3f-f966-4f0b-9cbe-4f6c5631be44 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:05.950498 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32fbdab-80ca-4275-9665-4ab0676579e4 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:05.982282 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f6608-d197-4156-b708-4786a71ff15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:05.982940 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f6608-d197-4156-b708-4786a71ff15c None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:05.983218 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f6608-d197-4156-b708-4786a71ff15c None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:05.983489 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80f6608-d197-4156-b708-4786a71ff15c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:06.036514 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f26d3f-f966-4f0b-9cbe-4f6c5631be44 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:06.047203 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f6608-d197-4156-b708-4786a71ff15c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:06.048644 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80f6608-d197-4156-b708-4786a71ff15c None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:06.068047 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46985cf1-7149-4347-8e41-6d797b8f0feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:06.068684 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46985cf1-7149-4347-8e41-6d797b8f0feb None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:06.068954 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46985cf1-7149-4347-8e41-6d797b8f0feb None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:06.069222 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46985cf1-7149-4347-8e41-6d797b8f0feb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:06.131356 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46985cf1-7149-4347-8e41-6d797b8f0feb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:06.132709 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46985cf1-7149-4347-8e41-6d797b8f0feb None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:06.140128 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 231/448] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 23:43:06.146141 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f6608-d197-4156-b708-4786a71ff15c None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:06.224510 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 218/449] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 23:43:06.230079 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46985cf1-7149-4347-8e41-6d797b8f0feb None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:06.236325 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80f6608-d197-4156-b708-4786a71ff15c None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:06.267868 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b660f9-5ece-442c-a068-0df414c4cf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:06.268710 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b660f9-5ece-442c-a068-0df414c4cf44 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:06.268989 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b660f9-5ece-442c-a068-0df414c4cf44 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:06.269256 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b660f9-5ece-442c-a068-0df414c4cf44 None admin] PATH_INFO: `/v3/projects/1da535e2d1e54da3b958d1c813082f2d` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:06.271058 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b660f9-5ece-442c-a068-0df414c4cf44 None admin] RBAC: Authorizing `identity:get_project(project_id=1da535e2d1e54da3b958d1c813082f2d)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:06.272474 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b660f9-5ece-442c-a068-0df414c4cf44 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:06.274138 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 232/450] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:43:06 2022] GET /identity/v3/projects/1da535e2d1e54da3b958d1c813082f2d => generated 344 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:06.279247 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b660f9-5ece-442c-a068-0df414c4cf44 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:06.322601 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46985cf1-7149-4347-8e41-6d797b8f0feb None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:06.354454 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05523dc-33b6-407e-8c6f-3a91d6cd4691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:06.355396 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05523dc-33b6-407e-8c6f-3a91d6cd4691 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:06.355673 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05523dc-33b6-407e-8c6f-3a91d6cd4691 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:06.355942 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05523dc-33b6-407e-8c6f-3a91d6cd4691 None admin] PATH_INFO: `/v3/projects/d87423bf072e41a69237bf58f5e967c0` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:06.357099 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05523dc-33b6-407e-8c6f-3a91d6cd4691 None admin] RBAC: Authorizing `identity:get_project(project_id=d87423bf072e41a69237bf58f5e967c0)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:06.358510 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05523dc-33b6-407e-8c6f-3a91d6cd4691 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:06.360194 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 219/451] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:43:06 2022] GET /identity/v3/projects/d87423bf072e41a69237bf58f5e967c0 => generated 302 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:06.366074 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05523dc-33b6-407e-8c6f-3a91d6cd4691 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:06.370890 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b660f9-5ece-442c-a068-0df414c4cf44 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:06.402519 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb908b-a564-4080-b047-e6dafb5f4a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:06.403314 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb908b-a564-4080-b047-e6dafb5f4a2e None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:06.403594 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb908b-a564-4080-b047-e6dafb5f4a2e None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:06.403860 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bb908b-a564-4080-b047-e6dafb5f4a2e None admin] PATH_INFO: `/v3/groups/4655538b608d4e63a223dfb5a755bd87` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:06.405375 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb908b-a564-4080-b047-e6dafb5f4a2e None admin] RBAC: Authorizing `identity:get_group(group_id=4655538b608d4e63a223dfb5a755bd87)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:06.406796 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bb908b-a564-4080-b047-e6dafb5f4a2e None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:06.408412 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 233/452] 10.222.0.24 () {56 vars in 1180 bytes} [Mon Apr 11 23:43:06 2022] GET /identity/v3/groups/4655538b608d4e63a223dfb5a755bd87 => generated 229 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:06.413874 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb908b-a564-4080-b047-e6dafb5f4a2e None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:06.458697 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05523dc-33b6-407e-8c6f-3a91d6cd4691 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:06.490287 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077ee25-61fc-41f5-aae2-1717ccacbb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:06.491152 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077ee25-61fc-41f5-aae2-1717ccacbb58 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:06.491424 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077ee25-61fc-41f5-aae2-1717ccacbb58 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:06.491690 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3077ee25-61fc-41f5-aae2-1717ccacbb58 None admin] PATH_INFO: `/v3/groups/9a244477cb10469587f36d987c94ecdb` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:06.492839 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077ee25-61fc-41f5-aae2-1717ccacbb58 None admin] RBAC: Authorizing `identity:get_group(group_id=9a244477cb10469587f36d987c94ecdb)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:06.494247 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3077ee25-61fc-41f5-aae2-1717ccacbb58 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:06.495871 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 220/453] 10.222.0.24 () {56 vars in 1180 bytes} [Mon Apr 11 23:43:06 2022] GET /identity/v3/groups/9a244477cb10469587f36d987c94ecdb => generated 226 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:06.501499 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077ee25-61fc-41f5-aae2-1717ccacbb58 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:06.505050 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bb908b-a564-4080-b047-e6dafb5f4a2e None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:06.536338 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f4fa50-8526-455b-b363-0aa312c16898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:06.536979 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4fa50-8526-455b-b363-0aa312c16898 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:06.537257 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4fa50-8526-455b-b363-0aa312c16898 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:06.537528 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f4fa50-8526-455b-b363-0aa312c16898 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:06.538352 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4fa50-8526-455b-b363-0aa312c16898 None admin] RBAC: Adding query filter params (group.id=4655538b608d4e63a223dfb5a755bd87, role.id=c8affbefb4c5462a921650b24b13c80f, scope.project.id=1da535e2d1e54da3b958d1c813082f2d) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:06.538660 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4fa50-8526-455b-b363-0aa312c16898 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:06.540103 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f4fa50-8526-455b-b363-0aa312c16898 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:06.545557 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 234/454] 10.222.0.24 () {56 vars in 1376 bytes} [Mon Apr 11 23:43:06 2022] GET /identity/v3/role_assignments?group.id=4655538b608d4e63a223dfb5a755bd87&scope.project.id=1da535e2d1e54da3b958d1c813082f2d&role.id=c8affbefb4c5462a921650b24b13c80f => generated 611 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:06.598732 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3077ee25-61fc-41f5-aae2-1717ccacbb58 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:06.635236 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dd375-61eb-4a4b-9cd7-7af6ab3e8128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:06.635888 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dd375-61eb-4a4b-9cd7-7af6ab3e8128 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:06.636167 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dd375-61eb-4a4b-9cd7-7af6ab3e8128 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:06.636428 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dd375-61eb-4a4b-9cd7-7af6ab3e8128 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:06.637263 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dd375-61eb-4a4b-9cd7-7af6ab3e8128 None admin] RBAC: Adding query filter params (group.id=9a244477cb10469587f36d987c94ecdb, role.id=f7b5f822a48e4e269ab53ce00a04194e, scope.project.id=d87423bf072e41a69237bf58f5e967c0) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:06.637569 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dd375-61eb-4a4b-9cd7-7af6ab3e8128 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:06.639033 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dd375-61eb-4a4b-9cd7-7af6ab3e8128 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:06.645393 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 221/455] 10.222.0.24 () {56 vars in 1376 bytes} [Mon Apr 11 23:43:06 2022] GET /identity/v3/role_assignments?group.id=9a244477cb10469587f36d987c94ecdb&scope.project.id=d87423bf072e41a69237bf58f5e967c0&role.id=f7b5f822a48e4e269ab53ce00a04194e => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:09.411794 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0470514-c866-4c1c-bf4d-fcc99d331319 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:09.412311 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0470514-c866-4c1c-bf4d-fcc99d331319 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:09.412385 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0470514-c866-4c1c-bf4d-fcc99d331319 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:09.414603 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 235/456] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:09.420296 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30059ea-1e0e-4e1a-8ab7-9af080d56eeb None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:09.421117 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30059ea-1e0e-4e1a-8ab7-9af080d56eeb None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:09.421594 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30059ea-1e0e-4e1a-8ab7-9af080d56eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:09.447823 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-d30059ea-1e0e-4e1a-8ab7-9af080d56eeb None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:09.449326 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d30059ea-1e0e-4e1a-8ab7-9af080d56eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:09.538315 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 222/457] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:09.581643 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0470514-c866-4c1c-bf4d-fcc99d331319 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:09.718264 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0470514-c866-4c1c-bf4d-fcc99d331319 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:09.762400 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8079a5a-0a4a-46d2-b7e5-c1a32def3535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:09.763457 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8079a5a-0a4a-46d2-b7e5-c1a32def3535 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:09.763905 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8079a5a-0a4a-46d2-b7e5-c1a32def3535 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:09.764321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8079a5a-0a4a-46d2-b7e5-c1a32def3535 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:09.781251 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8079a5a-0a4a-46d2-b7e5-c1a32def3535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:09.782717 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8079a5a-0a4a-46d2-b7e5-c1a32def3535 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:09.803901 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-f8079a5a-0a4a-46d2-b7e5-c1a32def3535 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:09.805412 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 236/458] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:09.810959 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30059ea-1e0e-4e1a-8ab7-9af080d56eeb None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:09.898152 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3cd6a-9c21-4cc9-813a-6a624e590db8 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:09.898434 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3cd6a-9c21-4cc9-813a-6a624e590db8 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:09.898989 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae3cd6a-9c21-4cc9-813a-6a624e590db8 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:09.901201 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 237/459] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:09.906264 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8223c-b5ed-4cad-989d-bd8f8f4bc1bc None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:09.906772 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8223c-b5ed-4cad-989d-bd8f8f4bc1bc None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:09.907272 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8223c-b5ed-4cad-989d-bd8f8f4bc1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:09.932285 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-a5c8223c-b5ed-4cad-989d-bd8f8f4bc1bc None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:09.933817 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-a5c8223c-b5ed-4cad-989d-bd8f8f4bc1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:09.972121 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30059ea-1e0e-4e1a-8ab7-9af080d56eeb None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:10.010328 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190850c-84a4-465e-a2a0-4edd326112ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:10.011251 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190850c-84a4-465e-a2a0-4edd326112ba None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:10.011700 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190850c-84a4-465e-a2a0-4edd326112ba None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:10.012114 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4190850c-84a4-465e-a2a0-4edd326112ba None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:10.014169 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190850c-84a4-465e-a2a0-4edd326112ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:10.014619 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190850c-84a4-465e-a2a0-4edd326112ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:10.017090 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4190850c-84a4-465e-a2a0-4edd326112ba None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:10.036662 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 238/460] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:43:10.039857 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 223/461] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:10.045261 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8223c-b5ed-4cad-989d-bd8f8f4bc1bc None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:10.061875 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190850c-84a4-465e-a2a0-4edd326112ba None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:10.156956 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8223c-b5ed-4cad-989d-bd8f8f4bc1bc None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:10.170237 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4190850c-84a4-465e-a2a0-4edd326112ba None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:10.190669 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af632fe-c15d-4162-a5a0-6bcb37eded07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:10.191384 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af632fe-c15d-4162-a5a0-6bcb37eded07 None admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:10.191712 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af632fe-c15d-4162-a5a0-6bcb37eded07 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:10.191981 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af632fe-c15d-4162-a5a0-6bcb37eded07 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:10.192688 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af632fe-c15d-4162-a5a0-6bcb37eded07 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:10.194104 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af632fe-c15d-4162-a5a0-6bcb37eded07 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:10.205066 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10da1a7-eef9-4428-b539-49fd27eb59bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:10.205863 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10da1a7-eef9-4428-b539-49fd27eb59bd None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:10.206142 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10da1a7-eef9-4428-b539-49fd27eb59bd None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:10.206411 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10da1a7-eef9-4428-b539-49fd27eb59bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:10.217965 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10da1a7-eef9-4428-b539-49fd27eb59bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:10.219596 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10da1a7-eef9-4428-b539-49fd27eb59bd None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:10.236630 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-b10da1a7-eef9-4428-b539-49fd27eb59bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:10.237993 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 224/462] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:10.239413 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0382cd-214b-4a9b-89b9-aaf7253fde2d None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:10.239906 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0382cd-214b-4a9b-89b9-aaf7253fde2d None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:10.240376 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0382cd-214b-4a9b-89b9-aaf7253fde2d None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:10.242264 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 225/463] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:10.243735 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0382cd-214b-4a9b-89b9-aaf7253fde2d None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:10.287191 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 239/464] 10.222.0.24 () {60 vars in 1132 bytes} [Mon Apr 11 23:43:10 2022] POST /identity/v3/users => generated 246 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 23:43:10.288567 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509841c-e77e-44ec-9441-240bc2930acd None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:10.288865 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509841c-e77e-44ec-9441-240bc2930acd None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:10.289144 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d509841c-e77e-44ec-9441-240bc2930acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:10.325645 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-d509841c-e77e-44ec-9441-240bc2930acd None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:10.327078 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d509841c-e77e-44ec-9441-240bc2930acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:10.360597 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0382cd-214b-4a9b-89b9-aaf7253fde2d None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:10.401959 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 240/465] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:10.403509 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dafd0-76e6-40c6-ade0-b43a167f1779 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:10.403895 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dafd0-76e6-40c6-ade0-b43a167f1779 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:10.404267 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204dafd0-76e6-40c6-ade0-b43a167f1779 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:10.406891 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f63fcd-06b1-4998-be9d-2a17f3df3f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:10.407786 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f63fcd-06b1-4998-be9d-2a17f3df3f56 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:10.408440 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f63fcd-06b1-4998-be9d-2a17f3df3f56 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:10.409050 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f63fcd-06b1-4998-be9d-2a17f3df3f56 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:10.410344 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f63fcd-06b1-4998-be9d-2a17f3df3f56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:10.411273 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 241/466] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:10 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:10.411561 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f63fcd-06b1-4998-be9d-2a17f3df3f56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:10.412815 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9f174-4838-4037-9658-a8aceb209280 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:10.413261 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9f174-4838-4037-9658-a8aceb209280 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:10.413540 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9f174-4838-4037-9658-a8aceb209280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:10.413876 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f63fcd-06b1-4998-be9d-2a17f3df3f56 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:10.428310 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 226/467] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:10.433351 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-8ac9f174-4838-4037-9658-a8aceb209280 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:10.434505 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f63fcd-06b1-4998-be9d-2a17f3df3f56 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:10.436289 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-8ac9f174-4838-4037-9658-a8aceb209280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:10.506812 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 242/468] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:10.507976 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9f174-4838-4037-9658-a8aceb209280 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:10.551362 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f63fcd-06b1-4998-be9d-2a17f3df3f56 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:10.598014 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8de4f-0de1-4e2b-8709-6c2efdfde3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:10.598738 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8de4f-0de1-4e2b-8709-6c2efdfde3e2 None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:10.599052 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8de4f-0de1-4e2b-8709-6c2efdfde3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:10.599328 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8de4f-0de1-4e2b-8709-6c2efdfde3e2 None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:10.600066 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8de4f-0de1-4e2b-8709-6c2efdfde3e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:10.601497 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd8de4f-0de1-4e2b-8709-6c2efdfde3e2 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:10.626808 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9f174-4838-4037-9658-a8aceb209280 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:10.660769 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d1894-a723-45d3-8bd7-12760d6c3406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:10.661558 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d1894-a723-45d3-8bd7-12760d6c3406 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:10.661837 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d1894-a723-45d3-8bd7-12760d6c3406 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:10.662109 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4d1894-a723-45d3-8bd7-12760d6c3406 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:10.672180 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d1894-a723-45d3-8bd7-12760d6c3406 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:10.673644 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4d1894-a723-45d3-8bd7-12760d6c3406 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:10.682718 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 227/469] 10.222.0.24 () {60 vars in 1132 bytes} [Mon Apr 11 23:43:10 2022] POST /identity/v3/users => generated 248 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:43:10.688217 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8de4f-0de1-4e2b-8709-6c2efdfde3e2 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:10.717444 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-5f4d1894-a723-45d3-8bd7-12760d6c3406 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:10.718725 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 243/470] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:10.725437 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d1894-a723-45d3-8bd7-12760d6c3406 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:10.823807 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd8de4f-0de1-4e2b-8709-6c2efdfde3e2 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:10.860706 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a0ae7-3481-476c-814c-28bdb1177bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:10.861788 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a0ae7-3481-476c-814c-28bdb1177bff None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:10.862265 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a0ae7-3481-476c-814c-28bdb1177bff None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:10.862680 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a0ae7-3481-476c-814c-28bdb1177bff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:10.875161 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a0ae7-3481-476c-814c-28bdb1177bff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:10.876882 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a0ae7-3481-476c-814c-28bdb1177bff None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:10.895149 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-886a0ae7-3481-476c-814c-28bdb1177bff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:10.896939 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 228/471] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:10.903157 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a0ae7-3481-476c-814c-28bdb1177bff None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:10.949826 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4d1894-a723-45d3-8bd7-12760d6c3406 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:10.991919 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb254944-bc15-4b18-bc1f-eb0c96aab83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:10.991919 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb254944-bc15-4b18-bc1f-eb0c96aab83f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:10.992244 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb254944-bc15-4b18-bc1f-eb0c96aab83f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:10.992873 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb254944-bc15-4b18-bc1f-eb0c96aab83f None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:10.993634 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb254944-bc15-4b18-bc1f-eb0c96aab83f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:10.993934 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb254944-bc15-4b18-bc1f-eb0c96aab83f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:10.995987 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb254944-bc15-4b18-bc1f-eb0c96aab83f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:11.014983 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 244/472] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:11.017696 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb254944-bc15-4b18-bc1f-eb0c96aab83f None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:11.031570 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a0ae7-3481-476c-814c-28bdb1177bff None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:11.072972 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740713b-7486-4cd0-b5a2-6f281f8be9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:11.073639 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740713b-7486-4cd0-b5a2-6f281f8be9f1 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:11.080860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740713b-7486-4cd0-b5a2-6f281f8be9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:11.080860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740713b-7486-4cd0-b5a2-6f281f8be9f1 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:11.080860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740713b-7486-4cd0-b5a2-6f281f8be9f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:11.080860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740713b-7486-4cd0-b5a2-6f281f8be9f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:11.080860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740713b-7486-4cd0-b5a2-6f281f8be9f1 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:11.090251 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 229/473] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:11.091730 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a59c4f-1a1b-4e1e-a1ed-f52b58c69377 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:11.092010 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a59c4f-1a1b-4e1e-a1ed-f52b58c69377 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:11.092280 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a59c4f-1a1b-4e1e-a1ed-f52b58c69377 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:11.093907 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 230/474] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:11.095409 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a59c4f-1a1b-4e1e-a1ed-f52b58c69377 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:11.192557 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb254944-bc15-4b18-bc1f-eb0c96aab83f None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:11.220078 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a59c4f-1a1b-4e1e-a1ed-f52b58c69377 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:11.233629 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5ed90-12cd-46fa-9d02-91426689467f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:11.234568 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5ed90-12cd-46fa-9d02-91426689467f None admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:11.234857 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5ed90-12cd-46fa-9d02-91426689467f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:11.235140 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5ed90-12cd-46fa-9d02-91426689467f None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:11.236016 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5ed90-12cd-46fa-9d02-91426689467f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:11.237875 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5ed90-12cd-46fa-9d02-91426689467f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:11.259141 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca3049-bfa0-435f-9392-9912f252862c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:11.259935 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca3049-bfa0-435f-9392-9912f252862c None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:11.260323 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca3049-bfa0-435f-9392-9912f252862c None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:11.260665 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ca3049-bfa0-435f-9392-9912f252862c None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:11.261516 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca3049-bfa0-435f-9392-9912f252862c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:11.263034 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ca3049-bfa0-435f-9392-9912f252862c None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:11.373852 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 245/475] 10.222.0.24 () {60 vars in 1132 bytes} [Mon Apr 11 23:43:11 2022] POST /identity/v3/users => generated 248 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:43:11.373852 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97b528-90c0-406c-bae8-c8c04c3f7a32 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:11.373852 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97b528-90c0-406c-bae8-c8c04c3f7a32 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:11.373852 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97b528-90c0-406c-bae8-c8c04c3f7a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:11.390855 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-dd97b528-90c0-406c-bae8-c8c04c3f7a32 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:11.399223 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 231/476] 10.222.0.24 () {60 vars in 1132 bytes} [Mon Apr 11 23:43:11 2022] POST /identity/v3/users => generated 249 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 23:43:11.399411 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-dd97b528-90c0-406c-bae8-c8c04c3f7a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:11.501993 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 246/477] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:11.539132 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca3049-bfa0-435f-9392-9912f252862c None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:11.658594 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ca3049-bfa0-435f-9392-9912f252862c None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:11.696810 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7ac99-1c75-432f-a903-12851108967a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:11.697968 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7ac99-1c75-432f-a903-12851108967a None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:11.698444 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7ac99-1c75-432f-a903-12851108967a None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:11.698982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7ac99-1c75-432f-a903-12851108967a None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:11.699898 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7ac99-1c75-432f-a903-12851108967a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:11.701538 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7ac99-1c75-432f-a903-12851108967a None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:11.739299 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.sql.core [None req-c3d7ac99-1c75-432f-a903-12851108967a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Apr 11 23:43:11.739299 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Apr 11 23:43:11.739299 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [parameters: {'id': 'a83327e9cead4b2a82f35db60b33b3a3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Apr 11 23:43:11.739299 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86501) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 11 23:43:11.762309 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-c3d7ac99-1c75-432f-a903-12851108967a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Apr 11 23:43:11.764084 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 232/478] 10.222.0.24 () {60 vars in 1131 bytes} [Mon Apr 11 23:43:11 2022] POST /identity/v3/roles => generated 144 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:11.769879 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97b528-90c0-406c-bae8-c8c04c3f7a32 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:11.885153 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97b528-90c0-406c-bae8-c8c04c3f7a32 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:11.918719 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11924f34-b00a-407f-90cd-d5d7e8ffdba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:11.919462 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11924f34-b00a-407f-90cd-d5d7e8ffdba8 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:11.919738 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11924f34-b00a-407f-90cd-d5d7e8ffdba8 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:11.920005 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11924f34-b00a-407f-90cd-d5d7e8ffdba8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:11.930716 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11924f34-b00a-407f-90cd-d5d7e8ffdba8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:11.937920 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-11924f34-b00a-407f-90cd-d5d7e8ffdba8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Apr 11 23:43:11.939433 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 247/479] 10.222.0.24 () {56 vars in 1114 bytes} [Mon Apr 11 23:43:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:11.945121 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7ac99-1c75-432f-a903-12851108967a None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:12.102223 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7ac99-1c75-432f-a903-12851108967a None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:12.146285 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2d095-4b33-468b-93e7-3943e6a0dbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:12.146976 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2d095-4b33-468b-93e7-3943e6a0dbe1 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:12.147257 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2d095-4b33-468b-93e7-3943e6a0dbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:12.147530 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2d095-4b33-468b-93e7-3943e6a0dbe1 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:12.148275 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2d095-4b33-468b-93e7-3943e6a0dbe1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:12.148575 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2d095-4b33-468b-93e7-3943e6a0dbe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:12.149947 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2d095-4b33-468b-93e7-3943e6a0dbe1 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:12.162621 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 233/480] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:13.351261 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdf5de-517e-42c0-9a9e-909e01362fde None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:13.351772 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdf5de-517e-42c0-9a9e-909e01362fde None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:13.351845 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdf5de-517e-42c0-9a9e-909e01362fde None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:13.353874 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 248/481] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:13.359506 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7be02b-d11b-4d63-8678-213a7cc14470 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:13.360015 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7be02b-d11b-4d63-8678-213a7cc14470 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:13.360113 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7be02b-d11b-4d63-8678-213a7cc14470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:13.378472 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-de7be02b-d11b-4d63-8678-213a7cc14470 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:13.379746 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-de7be02b-d11b-4d63-8678-213a7cc14470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:13.449271 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 234/482] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:13.472516 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdf5de-517e-42c0-9a9e-909e01362fde None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:13.574675 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdf5de-517e-42c0-9a9e-909e01362fde None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:13.608879 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366bf73-ec8d-4f56-aaba-9937767ff3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:13.609594 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366bf73-ec8d-4f56-aaba-9937767ff3f5 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:13.609874 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366bf73-ec8d-4f56-aaba-9937767ff3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:13.610144 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366bf73-ec8d-4f56-aaba-9937767ff3f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:13.620622 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366bf73-ec8d-4f56-aaba-9937767ff3f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:13.627652 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-9366bf73-ec8d-4f56-aaba-9937767ff3f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 23:43:13.629662 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 249/483] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:43:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:13.635350 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7be02b-d11b-4d63-8678-213a7cc14470 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:13.739631 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7be02b-d11b-4d63-8678-213a7cc14470 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:13.782028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa0e560-4e17-4dc7-9182-f76e1714ae40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:13.782706 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0e560-4e17-4dc7-9182-f76e1714ae40 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:13.783007 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0e560-4e17-4dc7-9182-f76e1714ae40 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:13.783278 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa0e560-4e17-4dc7-9182-f76e1714ae40 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:13.784030 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0e560-4e17-4dc7-9182-f76e1714ae40 None admin] RBAC: Adding query filter params (name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:13.784335 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0e560-4e17-4dc7-9182-f76e1714ae40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:13.785745 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa0e560-4e17-4dc7-9182-f76e1714ae40 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:13.794667 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 235/484] 10.222.0.24 () {56 vars in 1103 bytes} [Mon Apr 11 23:43:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:13.799988 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366bf73-ec8d-4f56-aaba-9937767ff3f5 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:13.951514 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366bf73-ec8d-4f56-aaba-9937767ff3f5 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:13.977372 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9f560-70e7-44fb-a2f5-6c54cb0ecfc4 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:13.977692 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9f560-70e7-44fb-a2f5-6c54cb0ecfc4 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:13.977933 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9f560-70e7-44fb-a2f5-6c54cb0ecfc4 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:13.980053 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 236/485] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:13.986931 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64734a-c16e-4355-9401-99f2f345c74f None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:13.987628 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64734a-c16e-4355-9401-99f2f345c74f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:13.988216 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64734a-c16e-4355-9401-99f2f345c74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:14.020459 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-ad64734a-c16e-4355-9401-99f2f345c74f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:14.020459 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-ad64734a-c16e-4355-9401-99f2f345c74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:14.024341 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55bc43-d3b5-4114-bf21-e3cb5493eeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:14.025137 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55bc43-d3b5-4114-bf21-e3cb5493eeff None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:14.025422 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55bc43-d3b5-4114-bf21-e3cb5493eeff None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:14.025699 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55bc43-d3b5-4114-bf21-e3cb5493eeff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:14.045452 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55bc43-d3b5-4114-bf21-e3cb5493eeff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:14.046956 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55bc43-d3b5-4114-bf21-e3cb5493eeff None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:14.077399 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-1c55bc43-d3b5-4114-bf21-e3cb5493eeff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:14.078779 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 250/486] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:14.088632 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55bc43-d3b5-4114-bf21-e3cb5493eeff None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:14.119829 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 237/487] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:43:14.121519 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e439d3-8323-4c15-9006-2d074d4c7279 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:14.121976 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e439d3-8323-4c15-9006-2d074d4c7279 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:14.122542 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e439d3-8323-4c15-9006-2d074d4c7279 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:14.124449 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 238/488] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:14.136301 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afde93-2568-4f8f-acb3-a216d01e4ec7 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:14.137017 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afde93-2568-4f8f-acb3-a216d01e4ec7 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:14.137665 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afde93-2568-4f8f-acb3-a216d01e4ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:14.157012 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-08afde93-2568-4f8f-acb3-a216d01e4ec7 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:14.158296 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-08afde93-2568-4f8f-acb3-a216d01e4ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:14.194765 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55bc43-d3b5-4114-bf21-e3cb5493eeff None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:14.225744 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 239/489] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:14.226945 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afde93-2568-4f8f-acb3-a216d01e4ec7 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:14.228903 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f18be1-43fa-4fd7-a897-ee251451c23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:14.229533 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f18be1-43fa-4fd7-a897-ee251451c23b None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:14.229810 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f18be1-43fa-4fd7-a897-ee251451c23b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:14.230079 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f18be1-43fa-4fd7-a897-ee251451c23b None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:14.230797 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f18be1-43fa-4fd7-a897-ee251451c23b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:14.231186 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f18be1-43fa-4fd7-a897-ee251451c23b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:14.232548 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f18be1-43fa-4fd7-a897-ee251451c23b None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:14.244927 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 251/490] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:14.251898 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f18be1-43fa-4fd7-a897-ee251451c23b None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:14.339574 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afde93-2568-4f8f-acb3-a216d01e4ec7 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:14.359802 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f18be1-43fa-4fd7-a897-ee251451c23b None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:14.379861 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858f0ca-3288-4f51-b32d-b712d6dedb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:14.380662 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858f0ca-3288-4f51-b32d-b712d6dedb70 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:14.380940 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858f0ca-3288-4f51-b32d-b712d6dedb70 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:14.381209 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858f0ca-3288-4f51-b32d-b712d6dedb70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:14.391536 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858f0ca-3288-4f51-b32d-b712d6dedb70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:14.396476 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994cf89-f602-408c-86eb-0142dba0608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:14.397484 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994cf89-f602-408c-86eb-0142dba0608a None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:14.397954 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994cf89-f602-408c-86eb-0142dba0608a None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:14.398431 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994cf89-f602-408c-86eb-0142dba0608a None admin] PATH_INFO: `/v3/users/nova` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:14.399525 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-f858f0ca-3288-4f51-b32d-b712d6dedb70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 23:43:14.405542 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 240/491] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:43:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:14.406401 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858f0ca-3288-4f51-b32d-b712d6dedb70 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:14.407656 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994cf89-f602-408c-86eb-0142dba0608a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:14.409458 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994cf89-f602-408c-86eb-0142dba0608a None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:14.425178 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-9994cf89-f602-408c-86eb-0142dba0608a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 23:43:14.427050 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 252/492] 10.222.0.24 () {56 vars in 1093 bytes} [Mon Apr 11 23:43:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:14.427803 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994cf89-f602-408c-86eb-0142dba0608a None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:14.508668 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858f0ca-3288-4f51-b32d-b712d6dedb70 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:14.526879 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994cf89-f602-408c-86eb-0142dba0608a None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:14.541754 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270320c9-176e-4679-9caa-cff265325469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:14.542554 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270320c9-176e-4679-9caa-cff265325469 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:14.542852 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270320c9-176e-4679-9caa-cff265325469 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:14.543137 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270320c9-176e-4679-9caa-cff265325469 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:14.553484 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270320c9-176e-4679-9caa-cff265325469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:14.554889 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b34b9-7d85-4f5e-8fd4-2e499000d42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:14.555545 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b34b9-7d85-4f5e-8fd4-2e499000d42b None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:14.555821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b34b9-7d85-4f5e-8fd4-2e499000d42b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:14.556090 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b34b9-7d85-4f5e-8fd4-2e499000d42b None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:14.556824 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b34b9-7d85-4f5e-8fd4-2e499000d42b None admin] RBAC: Adding query filter params (name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:14.557124 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b34b9-7d85-4f5e-8fd4-2e499000d42b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:14.558484 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b34b9-7d85-4f5e-8fd4-2e499000d42b None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:14.560622 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-270320c9-176e-4679-9caa-cff265325469 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 23:43:14.566599 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 241/493] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:43:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:14.566599 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79114779-a8c5-47c5-9a17-2f6bb6576693 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:14.566599 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79114779-a8c5-47c5-9a17-2f6bb6576693 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:14.566599 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79114779-a8c5-47c5-9a17-2f6bb6576693 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:14.566599 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 242/494] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:14.566599 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79114779-a8c5-47c5-9a17-2f6bb6576693 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:14.572346 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 253/495] 10.222.0.24 () {56 vars in 1103 bytes} [Mon Apr 11 23:43:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:14.576243 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b34b9-7d85-4f5e-8fd4-2e499000d42b None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:14.668920 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79114779-a8c5-47c5-9a17-2f6bb6576693 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:14.677148 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b34b9-7d85-4f5e-8fd4-2e499000d42b None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:14.702939 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86d7f8-e1bc-4f15-8352-5ef3e4eadafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:14.703616 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86d7f8-e1bc-4f15-8352-5ef3e4eadafd None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:14.703893 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86d7f8-e1bc-4f15-8352-5ef3e4eadafd None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:14.704217 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86d7f8-e1bc-4f15-8352-5ef3e4eadafd None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:14.705070 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86d7f8-e1bc-4f15-8352-5ef3e4eadafd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:14.705379 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86d7f8-e1bc-4f15-8352-5ef3e4eadafd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:14.706877 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e86d7f8-e1bc-4f15-8352-5ef3e4eadafd None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:14.710347 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fdcae8-0801-405f-9519-c94a527316cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:14.711246 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdcae8-0801-405f-9519-c94a527316cf None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:14.711524 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdcae8-0801-405f-9519-c94a527316cf None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:14.711793 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdcae8-0801-405f-9519-c94a527316cf None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:14.713262 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdcae8-0801-405f-9519-c94a527316cf None admin] RBAC: Adding query filter params (name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:14.713828 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdcae8-0801-405f-9519-c94a527316cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:14.715209 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fdcae8-0801-405f-9519-c94a527316cf None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:14.727601 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 254/496] 10.222.0.24 () {56 vars in 1103 bytes} [Mon Apr 11 23:43:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:14.727601 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb03105-e131-422d-ba3c-7e94f1b1b118 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:14.727601 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb03105-e131-422d-ba3c-7e94f1b1b118 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:14.727601 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb03105-e131-422d-ba3c-7e94f1b1b118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:14.742343 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-2fb03105-e131-422d-ba3c-7e94f1b1b118 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:14.743543 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-2fb03105-e131-422d-ba3c-7e94f1b1b118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:14.750377 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 243/497] 10.222.0.24 () {56 vars in 1133 bytes} [Mon Apr 11 23:43:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:14.751502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86d7f8-e1bc-4f15-8352-5ef3e4eadafd None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:14.824857 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 255/498] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:14.824857 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb03105-e131-422d-ba3c-7e94f1b1b118 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:14.857490 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86d7f8-e1bc-4f15-8352-5ef3e4eadafd None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:14.890522 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e141108-234f-448c-b878-51819784b642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:14.891350 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e141108-234f-448c-b878-51819784b642 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:14.891630 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e141108-234f-448c-b878-51819784b642 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:14.891902 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e141108-234f-448c-b878-51819784b642 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:14.902921 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e141108-234f-448c-b878-51819784b642 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:14.904319 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e141108-234f-448c-b878-51819784b642 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:14.921376 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-6e141108-234f-448c-b878-51819784b642 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:14.927993 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 244/499] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:14.928208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb03105-e131-422d-ba3c-7e94f1b1b118 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:14.928293 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e141108-234f-448c-b878-51819784b642 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:14.961689 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ca78c-2333-4f59-b1c7-ec5ce964ab61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:14.962483 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ca78c-2333-4f59-b1c7-ec5ce964ab61 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:14.962763 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ca78c-2333-4f59-b1c7-ec5ce964ab61 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:14.963063 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ca78c-2333-4f59-b1c7-ec5ce964ab61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:14.973862 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ca78c-2333-4f59-b1c7-ec5ce964ab61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:14.975342 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ca78c-2333-4f59-b1c7-ec5ce964ab61 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:14.992660 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-ce8ca78c-2333-4f59-b1c7-ec5ce964ab61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:14.993860 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 256/500] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:14.997076 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ca78c-2333-4f59-b1c7-ec5ce964ab61 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:15.033021 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e141108-234f-448c-b878-51819784b642 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:15.067281 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfefd7-c0ca-4a7e-aa4d-eac63daea80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:15.067935 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfefd7-c0ca-4a7e-aa4d-eac63daea80c None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:15.068219 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfefd7-c0ca-4a7e-aa4d-eac63daea80c None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:15.068494 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccfefd7-c0ca-4a7e-aa4d-eac63daea80c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:15.101909 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ca78c-2333-4f59-b1c7-ec5ce964ab61 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:15.134088 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfefd7-c0ca-4a7e-aa4d-eac63daea80c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:15.135496 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dd005-c25d-4fb6-8511-ea18f777b749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:15.135653 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccfefd7-c0ca-4a7e-aa4d-eac63daea80c None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:15.136560 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dd005-c25d-4fb6-8511-ea18f777b749 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:15.136974 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dd005-c25d-4fb6-8511-ea18f777b749 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:15.137395 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3dd005-c25d-4fb6-8511-ea18f777b749 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:15.147557 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3dd005-c25d-4fb6-8511-ea18f777b749 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:15.154392 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-3f3dd005-c25d-4fb6-8511-ea18f777b749 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 23:43:15.155603 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 257/501] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:43:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:15.156354 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dd005-c25d-4fb6-8511-ea18f777b749 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:15.236526 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 245/502] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:43:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:43:15.237690 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfefd7-c0ca-4a7e-aa4d-eac63daea80c None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:15.263075 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3dd005-c25d-4fb6-8511-ea18f777b749 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:15.298925 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f7346-8e60-46c4-82af-602510080123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:15.299526 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f7346-8e60-46c4-82af-602510080123 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:15.299811 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f7346-8e60-46c4-82af-602510080123 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:15.300086 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f7346-8e60-46c4-82af-602510080123 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:15.300814 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f7346-8e60-46c4-82af-602510080123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:15.301649 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f7346-8e60-46c4-82af-602510080123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:15.303057 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f7346-8e60-46c4-82af-602510080123 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:15.314328 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 258/503] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:15.315141 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f7346-8e60-46c4-82af-602510080123 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:15.333710 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccfefd7-c0ca-4a7e-aa4d-eac63daea80c None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:15.367665 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e87cb-8720-4983-ba48-ca4ac58188a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:15.368317 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e87cb-8720-4983-ba48-ca4ac58188a0 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:15.368587 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e87cb-8720-4983-ba48-ca4ac58188a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:15.368857 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e87cb-8720-4983-ba48-ca4ac58188a0 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:15.369577 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e87cb-8720-4983-ba48-ca4ac58188a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:15.369874 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e87cb-8720-4983-ba48-ca4ac58188a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:15.371257 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e87cb-8720-4983-ba48-ca4ac58188a0 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:15.381661 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 246/504] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:15.382431 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e87cb-8720-4983-ba48-ca4ac58188a0 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:15.407627 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f7346-8e60-46c4-82af-602510080123 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:15.439659 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1889941-6b63-486d-b62b-b5611523ea8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:15.440321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1889941-6b63-486d-b62b-b5611523ea8f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:15.440595 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1889941-6b63-486d-b62b-b5611523ea8f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:15.440862 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1889941-6b63-486d-b62b-b5611523ea8f None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:15.441639 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1889941-6b63-486d-b62b-b5611523ea8f None admin] RBAC: Adding query filter params (name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:15.441939 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1889941-6b63-486d-b62b-b5611523ea8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:15.443335 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1889941-6b63-486d-b62b-b5611523ea8f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:15.450903 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 259/505] 10.222.0.24 () {56 vars in 1103 bytes} [Mon Apr 11 23:43:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:15.452107 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da243b-17f3-4cc4-b024-14254e393fd6 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:15.452389 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da243b-17f3-4cc4-b024-14254e393fd6 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:15.452661 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11da243b-17f3-4cc4-b024-14254e393fd6 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:15.454438 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 260/506] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:15.455594 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da243b-17f3-4cc4-b024-14254e393fd6 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:15.475683 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e87cb-8720-4983-ba48-ca4ac58188a0 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:15.507252 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d806c6-688b-4c1b-a001-54c21dbe4844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:15.508030 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d806c6-688b-4c1b-a001-54c21dbe4844 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:15.508315 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d806c6-688b-4c1b-a001-54c21dbe4844 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:15.508585 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d806c6-688b-4c1b-a001-54c21dbe4844 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:15.518549 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d806c6-688b-4c1b-a001-54c21dbe4844 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:15.520555 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d806c6-688b-4c1b-a001-54c21dbe4844 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:15.537260 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-19d806c6-688b-4c1b-a001-54c21dbe4844 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:15.538423 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 247/507] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:15.539216 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d806c6-688b-4c1b-a001-54c21dbe4844 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:15.550756 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11da243b-17f3-4cc4-b024-14254e393fd6 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:15.581493 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965a785-fa8a-4c05-879c-5090c463d8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:15.582799 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965a785-fa8a-4c05-879c-5090c463d8e4 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:15.583127 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965a785-fa8a-4c05-879c-5090c463d8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:15.583394 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965a785-fa8a-4c05-879c-5090c463d8e4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:15.590751 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965a785-fa8a-4c05-879c-5090c463d8e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:15.592184 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965a785-fa8a-4c05-879c-5090c463d8e4 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:15.605609 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-6965a785-fa8a-4c05-879c-5090c463d8e4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 11 23:43:15.606748 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 261/508] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:43:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:15.607522 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965a785-fa8a-4c05-879c-5090c463d8e4 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:15.633807 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d806c6-688b-4c1b-a001-54c21dbe4844 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:15.665704 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e2961-956a-422f-b754-fb3facfedc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:15.666481 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e2961-956a-422f-b754-fb3facfedc60 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:15.666759 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e2961-956a-422f-b754-fb3facfedc60 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:15.667059 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e2961-956a-422f-b754-fb3facfedc60 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:15.674201 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e2961-956a-422f-b754-fb3facfedc60 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:15.675650 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e2961-956a-422f-b754-fb3facfedc60 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:15.688614 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-e38e2961-956a-422f-b754-fb3facfedc60 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 11 23:43:15.689761 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 248/509] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:43:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:15.690902 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cbd72-2e07-4ba2-a917-631bc6ccd979 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:15.691181 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cbd72-2e07-4ba2-a917-631bc6ccd979 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:15.691450 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231cbd72-2e07-4ba2-a917-631bc6ccd979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:15.699647 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965a785-fa8a-4c05-879c-5090c463d8e4 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:15.709112 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-231cbd72-2e07-4ba2-a917-631bc6ccd979 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:15.710309 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-231cbd72-2e07-4ba2-a917-631bc6ccd979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:15.735432 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e97d3f-9172-4f83-95dd-d1c68cba0279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:15.736218 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e97d3f-9172-4f83-95dd-d1c68cba0279 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:15.736499 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e97d3f-9172-4f83-95dd-d1c68cba0279 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:15.736771 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e97d3f-9172-4f83-95dd-d1c68cba0279 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:15.747044 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e97d3f-9172-4f83-95dd-d1c68cba0279 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:15.748495 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e97d3f-9172-4f83-95dd-d1c68cba0279 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:15.765088 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-30e97d3f-9172-4f83-95dd-d1c68cba0279 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:15.767492 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 262/510] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:15.767492 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e97d3f-9172-4f83-95dd-d1c68cba0279 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:15.784569 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 249/511] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:15.785612 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cbd72-2e07-4ba2-a917-631bc6ccd979 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:15.862796 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e97d3f-9172-4f83-95dd-d1c68cba0279 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:15.877506 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231cbd72-2e07-4ba2-a917-631bc6ccd979 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:15.894259 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2106e-f126-4bb3-b341-22e13c06d74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:15.895510 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2106e-f126-4bb3-b341-22e13c06d74e None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:15.895794 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2106e-f126-4bb3-b341-22e13c06d74e None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:15.896067 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2106e-f126-4bb3-b341-22e13c06d74e None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:15.896783 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2106e-f126-4bb3-b341-22e13c06d74e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:15.897086 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2106e-f126-4bb3-b341-22e13c06d74e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:15.898451 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2106e-f126-4bb3-b341-22e13c06d74e None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:15.909679 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 263/512] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:15.914351 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb1fdc-0b84-43f7-9826-3cca10834089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:15.914464 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2106e-f126-4bb3-b341-22e13c06d74e None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:15.914547 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb1fdc-0b84-43f7-9826-3cca10834089 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:15.914547 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb1fdc-0b84-43f7-9826-3cca10834089 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:15.914547 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb1fdc-0b84-43f7-9826-3cca10834089 None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:15.914547 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb1fdc-0b84-43f7-9826-3cca10834089 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:15.914547 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb1fdc-0b84-43f7-9826-3cca10834089 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:15.914547 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb1fdc-0b84-43f7-9826-3cca10834089 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:15.930156 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 250/513] 10.222.0.24 () {56 vars in 1137 bytes} [Mon Apr 11 23:43:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:15.930963 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb1fdc-0b84-43f7-9826-3cca10834089 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:16.006055 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2106e-f126-4bb3-b341-22e13c06d74e None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:16.023454 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb1fdc-0b84-43f7-9826-3cca10834089 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:16.037668 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e970d25-0a8f-4ef6-8e50-502547de8700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:16.038325 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e970d25-0a8f-4ef6-8e50-502547de8700 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:16.038608 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e970d25-0a8f-4ef6-8e50-502547de8700 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:16.038908 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e970d25-0a8f-4ef6-8e50-502547de8700 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:16.039740 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e970d25-0a8f-4ef6-8e50-502547de8700 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:16.040047 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e970d25-0a8f-4ef6-8e50-502547de8700 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:16.041461 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e970d25-0a8f-4ef6-8e50-502547de8700 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:16.060357 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc9fce-0665-4e14-878a-4ba43883e7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:16.060357 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc9fce-0665-4e14-878a-4ba43883e7e1 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:16.060357 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc9fce-0665-4e14-878a-4ba43883e7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:16.060357 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc9fce-0665-4e14-878a-4ba43883e7e1 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:16.060796 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc9fce-0665-4e14-878a-4ba43883e7e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:16.060796 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc9fce-0665-4e14-878a-4ba43883e7e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:16.060796 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc9fce-0665-4e14-878a-4ba43883e7e1 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:16.072505 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 251/514] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:16.073325 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc9fce-0665-4e14-878a-4ba43883e7e1 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:16.083727 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 264/515] 10.222.0.24 () {56 vars in 1137 bytes} [Mon Apr 11 23:43:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:16.083727 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e970d25-0a8f-4ef6-8e50-502547de8700 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:16.166696 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc9fce-0665-4e14-878a-4ba43883e7e1 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:16.173034 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e970d25-0a8f-4ef6-8e50-502547de8700 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:16.197110 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09083131-dc3f-4689-a14c-f465b179c89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:16.197883 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09083131-dc3f-4689-a14c-f465b179c89c None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:16.198158 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09083131-dc3f-4689-a14c-f465b179c89c None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:16.198426 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09083131-dc3f-4689-a14c-f465b179c89c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:16.204218 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc5d14-b8c9-4131-bd2f-f751ad895498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:16.205057 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc5d14-b8c9-4131-bd2f-f751ad895498 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:16.205327 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc5d14-b8c9-4131-bd2f-f751ad895498 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:16.205595 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc5d14-b8c9-4131-bd2f-f751ad895498 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:16.208798 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09083131-dc3f-4689-a14c-f465b179c89c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:16.210225 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09083131-dc3f-4689-a14c-f465b179c89c None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:16.212468 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc5d14-b8c9-4131-bd2f-f751ad895498 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:16.214152 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc5d14-b8c9-4131-bd2f-f751ad895498 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:16.226843 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-09083131-dc3f-4689-a14c-f465b179c89c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:16.227333 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-64bc5d14-b8c9-4131-bd2f-f751ad895498 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:16.227997 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 252/516] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:16.233283 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 265/517] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:16.233427 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09083131-dc3f-4689-a14c-f465b179c89c None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:16.233514 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc5d14-b8c9-4131-bd2f-f751ad895498 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:16.323315 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc5d14-b8c9-4131-bd2f-f751ad895498 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:16.323994 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09083131-dc3f-4689-a14c-f465b179c89c None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:16.354901 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ea039-88e9-41ae-955d-b5dbf75be2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:16.355685 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ea039-88e9-41ae-955d-b5dbf75be2be None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:16.355890 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330b04e-ecda-49d2-b582-6b2da9461fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:16.356017 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ea039-88e9-41ae-955d-b5dbf75be2be None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:16.356226 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ea039-88e9-41ae-955d-b5dbf75be2be None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:16.356518 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330b04e-ecda-49d2-b582-6b2da9461fd2 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:16.356793 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330b04e-ecda-49d2-b582-6b2da9461fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:16.357062 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330b04e-ecda-49d2-b582-6b2da9461fd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:16.363855 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ea039-88e9-41ae-955d-b5dbf75be2be None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:16.365304 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5ea039-88e9-41ae-955d-b5dbf75be2be None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:16.378451 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-6d5ea039-88e9-41ae-955d-b5dbf75be2be None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 11 23:43:16.380291 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 266/518] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:43:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:16.381085 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ea039-88e9-41ae-955d-b5dbf75be2be None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:16.425687 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330b04e-ecda-49d2-b582-6b2da9461fd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:16.427592 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330b04e-ecda-49d2-b582-6b2da9461fd2 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:16.476991 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5ea039-88e9-41ae-955d-b5dbf75be2be None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:16.508223 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55482d47-ed81-437b-a2b7-9bf7d3568ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:16.508858 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55482d47-ed81-437b-a2b7-9bf7d3568ee8 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:16.509134 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55482d47-ed81-437b-a2b7-9bf7d3568ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:16.509402 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55482d47-ed81-437b-a2b7-9bf7d3568ee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:16.518859 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 253/519] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:43:16.519567 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330b04e-ecda-49d2-b582-6b2da9461fd2 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:16.571985 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55482d47-ed81-437b-a2b7-9bf7d3568ee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:16.573431 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55482d47-ed81-437b-a2b7-9bf7d3568ee8 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:16.610995 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330b04e-ecda-49d2-b582-6b2da9461fd2 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:16.642885 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4027b-d70f-4c0c-8a90-8103b299f771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:16.643534 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4027b-d70f-4c0c-8a90-8103b299f771 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:16.643814 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4027b-d70f-4c0c-8a90-8103b299f771 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:16.644086 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4027b-d70f-4c0c-8a90-8103b299f771 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:16.644820 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4027b-d70f-4c0c-8a90-8103b299f771 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:16.645125 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4027b-d70f-4c0c-8a90-8103b299f771 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:16.646474 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4027b-d70f-4c0c-8a90-8103b299f771 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:16.657137 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 254/520] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:16.657915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4027b-d70f-4c0c-8a90-8103b299f771 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:16.669236 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 267/521] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:43:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:43:16.669236 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55482d47-ed81-437b-a2b7-9bf7d3568ee8 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:16.753703 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4027b-d70f-4c0c-8a90-8103b299f771 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:16.757914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55482d47-ed81-437b-a2b7-9bf7d3568ee8 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:16.784814 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a399261-d8ba-4ddd-953e-bab50d682ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:16.785991 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a399261-d8ba-4ddd-953e-bab50d682ebe None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:16.786265 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a399261-d8ba-4ddd-953e-bab50d682ebe None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:16.786533 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a399261-d8ba-4ddd-953e-bab50d682ebe None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:16.787340 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a399261-d8ba-4ddd-953e-bab50d682ebe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:16.787639 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a399261-d8ba-4ddd-953e-bab50d682ebe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:16.789044 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a399261-d8ba-4ddd-953e-bab50d682ebe None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:16.790351 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a07a09-5a52-4cee-a234-2ecbcffd6339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:16.791035 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a07a09-5a52-4cee-a234-2ecbcffd6339 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:16.791318 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a07a09-5a52-4cee-a234-2ecbcffd6339 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:16.791590 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a07a09-5a52-4cee-a234-2ecbcffd6339 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:16.792426 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a07a09-5a52-4cee-a234-2ecbcffd6339 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:16.792732 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a07a09-5a52-4cee-a234-2ecbcffd6339 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:16.794155 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a07a09-5a52-4cee-a234-2ecbcffd6339 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:16.806703 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 255/522] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:16.807363 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a399261-d8ba-4ddd-953e-bab50d682ebe None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:16.811560 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 268/523] 10.222.0.24 () {56 vars in 1139 bytes} [Mon Apr 11 23:43:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:16.812419 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a07a09-5a52-4cee-a234-2ecbcffd6339 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:16.899618 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a399261-d8ba-4ddd-953e-bab50d682ebe None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:16.902571 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a07a09-5a52-4cee-a234-2ecbcffd6339 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:16.931364 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae2d04-05b0-4b7f-b905-91813e0447c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:16.932142 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae2d04-05b0-4b7f-b905-91813e0447c5 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:16.932422 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae2d04-05b0-4b7f-b905-91813e0447c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:16.932697 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bae2d04-05b0-4b7f-b905-91813e0447c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:16.934382 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf113d-43d8-4ed0-9066-9511abb1db37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:16.935066 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf113d-43d8-4ed0-9066-9511abb1db37 None admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:16.935339 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf113d-43d8-4ed0-9066-9511abb1db37 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:16.935609 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cf113d-43d8-4ed0-9066-9511abb1db37 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:16.936299 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf113d-43d8-4ed0-9066-9511abb1db37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:16.937736 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cf113d-43d8-4ed0-9066-9511abb1db37 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:16.942307 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae2d04-05b0-4b7f-b905-91813e0447c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:16.943749 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bae2d04-05b0-4b7f-b905-91813e0447c5 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:16.960561 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-4bae2d04-05b0-4b7f-b905-91813e0447c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:16.968579 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 256/524] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:16.968579 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae2d04-05b0-4b7f-b905-91813e0447c5 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:17.027079 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 269/525] 10.222.0.24 () {60 vars in 1132 bytes} [Mon Apr 11 23:43:16 2022] POST /identity/v3/users => generated 247 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:43:17.027947 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf113d-43d8-4ed0-9066-9511abb1db37 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:17.072490 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bae2d04-05b0-4b7f-b905-91813e0447c5 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:17.117539 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d07517-6aa1-4608-bb77-376f882424f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:17.118366 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d07517-6aa1-4608-bb77-376f882424f9 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:17.118631 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d07517-6aa1-4608-bb77-376f882424f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:17.118945 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d07517-6aa1-4608-bb77-376f882424f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:17.130076 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d07517-6aa1-4608-bb77-376f882424f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:17.131604 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d07517-6aa1-4608-bb77-376f882424f9 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:17.138283 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cf113d-43d8-4ed0-9066-9511abb1db37 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:17.149684 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-18d07517-6aa1-4608-bb77-376f882424f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:17.155723 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 257/526] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:17.155723 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d07517-6aa1-4608-bb77-376f882424f9 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:17.178390 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d96a0b-baed-4ae1-a60f-04863bc43bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:17.179091 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d96a0b-baed-4ae1-a60f-04863bc43bde None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:17.179365 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d96a0b-baed-4ae1-a60f-04863bc43bde None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:17.179635 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d96a0b-baed-4ae1-a60f-04863bc43bde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:17.180504 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d96a0b-baed-4ae1-a60f-04863bc43bde None admin] RBAC: Adding query filter params (role.id=f4692fa2043d468fae733095d5740686, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=a9519f49f897415a894c1121278dda9c) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:17.180812 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d96a0b-baed-4ae1-a60f-04863bc43bde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:17.182283 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d96a0b-baed-4ae1-a60f-04863bc43bde None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:17.195310 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 270/527] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:43:17 2022] GET /identity/v3/role_assignments?user.id=a9519f49f897415a894c1121278dda9c&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=f4692fa2043d468fae733095d5740686 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:17.196655 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d96a0b-baed-4ae1-a60f-04863bc43bde None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:17.278168 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d07517-6aa1-4608-bb77-376f882424f9 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:17.317556 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4984a33-df79-4c3d-9587-068b588da73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:17.318572 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4984a33-df79-4c3d-9587-068b588da73e None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:17.319165 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4984a33-df79-4c3d-9587-068b588da73e None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:17.319638 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4984a33-df79-4c3d-9587-068b588da73e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:17.328391 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d96a0b-baed-4ae1-a60f-04863bc43bde None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:17.367463 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef8762-1365-41fd-8300-038c81b05bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:17.368136 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef8762-1365-41fd-8300-038c81b05bcf None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:17.368414 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef8762-1365-41fd-8300-038c81b05bcf None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:17.368685 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ef8762-1365-41fd-8300-038c81b05bcf None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:17.369424 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef8762-1365-41fd-8300-038c81b05bcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:17.369727 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef8762-1365-41fd-8300-038c81b05bcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:17.371165 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ef8762-1365-41fd-8300-038c81b05bcf None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:17.384381 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 271/528] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:17.385407 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef8762-1365-41fd-8300-038c81b05bcf None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:17.395639 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4984a33-df79-4c3d-9587-068b588da73e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:17.397447 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4984a33-df79-4c3d-9587-068b588da73e None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:17.488860 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ef8762-1365-41fd-8300-038c81b05bcf None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:17.497592 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 258/529] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:43:17.499053 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4984a33-df79-4c3d-9587-068b588da73e None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:17.528721 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae22d9b-be92-476c-ae55-8397b2192384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:17.529322 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae22d9b-be92-476c-ae55-8397b2192384 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:17.529613 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae22d9b-be92-476c-ae55-8397b2192384 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:17.529855 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae22d9b-be92-476c-ae55-8397b2192384 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:17.530595 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae22d9b-be92-476c-ae55-8397b2192384 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:17.531057 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae22d9b-be92-476c-ae55-8397b2192384 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:17.532302 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae22d9b-be92-476c-ae55-8397b2192384 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:17.548292 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 272/530] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:17.548292 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae22d9b-be92-476c-ae55-8397b2192384 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:17.603274 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4984a33-df79-4c3d-9587-068b588da73e None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:17.637232 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279c721-ddb8-4095-9ac6-245dec8b0e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:17.638268 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279c721-ddb8-4095-9ac6-245dec8b0e3b None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:17.638694 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279c721-ddb8-4095-9ac6-245dec8b0e3b None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:17.639127 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279c721-ddb8-4095-9ac6-245dec8b0e3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:17.644134 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae22d9b-be92-476c-ae55-8397b2192384 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:17.646023 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279c721-ddb8-4095-9ac6-245dec8b0e3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:17.647622 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279c721-ddb8-4095-9ac6-245dec8b0e3b None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:17.660564 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-e279c721-ddb8-4095-9ac6-245dec8b0e3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:17.662184 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 259/531] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:17.663190 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279c721-ddb8-4095-9ac6-245dec8b0e3b None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:17.677999 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5424405-2be4-47d6-8280-96a5d31d42cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:17.678792 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5424405-2be4-47d6-8280-96a5d31d42cd None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:17.679153 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5424405-2be4-47d6-8280-96a5d31d42cd None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:17.679731 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5424405-2be4-47d6-8280-96a5d31d42cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:17.690188 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5424405-2be4-47d6-8280-96a5d31d42cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:17.691969 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5424405-2be4-47d6-8280-96a5d31d42cd None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:17.708643 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-c5424405-2be4-47d6-8280-96a5d31d42cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:17.709971 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 273/532] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:17.710585 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5424405-2be4-47d6-8280-96a5d31d42cd None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:17.766619 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279c721-ddb8-4095-9ac6-245dec8b0e3b None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:17.802097 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dde833-5736-4110-883d-a7047d523073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:17.803249 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dde833-5736-4110-883d-a7047d523073 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:17.803723 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dde833-5736-4110-883d-a7047d523073 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:17.804183 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dde833-5736-4110-883d-a7047d523073 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:17.811349 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dde833-5736-4110-883d-a7047d523073 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:17.813009 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dde833-5736-4110-883d-a7047d523073 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:17.819885 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5424405-2be4-47d6-8280-96a5d31d42cd None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:17.827518 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-01dde833-5736-4110-883d-a7047d523073 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:17.833698 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 260/533] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:17.834733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dde833-5736-4110-883d-a7047d523073 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:17.853237 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f0085-b90a-421e-8912-3e350d6d3816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:17.853895 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f0085-b90a-421e-8912-3e350d6d3816 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:17.854176 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f0085-b90a-421e-8912-3e350d6d3816 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:17.854462 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f0085-b90a-421e-8912-3e350d6d3816 None admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:17.855276 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f0085-b90a-421e-8912-3e350d6d3816 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:17.855586 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f0085-b90a-421e-8912-3e350d6d3816 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:17.857016 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f0085-b90a-421e-8912-3e350d6d3816 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:17.875325 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 274/534] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:17.876176 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f0085-b90a-421e-8912-3e350d6d3816 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:17.944063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dde833-5736-4110-883d-a7047d523073 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:17.976253 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f0085-b90a-421e-8912-3e350d6d3816 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:17.993415 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed6c76-9142-4af5-aaab-44d2668ee7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:17.994434 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed6c76-9142-4af5-aaab-44d2668ee7a1 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:17.994709 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed6c76-9142-4af5-aaab-44d2668ee7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:17.995269 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed6c76-9142-4af5-aaab-44d2668ee7a1 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:17.998277 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed6c76-9142-4af5-aaab-44d2668ee7a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:17.998277 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed6c76-9142-4af5-aaab-44d2668ee7a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:17.998277 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed6c76-9142-4af5-aaab-44d2668ee7a1 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:18.012468 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 261/535] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:18.013122 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed6c76-9142-4af5-aaab-44d2668ee7a1 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:18.020317 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c93448-05c0-4042-8bba-754867922d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:18.020987 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c93448-05c0-4042-8bba-754867922d36 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:18.021270 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c93448-05c0-4042-8bba-754867922d36 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:18.021545 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c93448-05c0-4042-8bba-754867922d36 None admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:18.022344 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c93448-05c0-4042-8bba-754867922d36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:18.026945 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c93448-05c0-4042-8bba-754867922d36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:18.026945 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c93448-05c0-4042-8bba-754867922d36 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:18.040752 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 275/536] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:18.042230 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c93448-05c0-4042-8bba-754867922d36 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:18.130133 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed6c76-9142-4af5-aaab-44d2668ee7a1 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:18.164141 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f9881-a553-449b-9e98-e5398d5e3e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:18.164908 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f9881-a553-449b-9e98-e5398d5e3e3e None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:18.165294 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f9881-a553-449b-9e98-e5398d5e3e3e None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:18.165640 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8f9881-a553-449b-9e98-e5398d5e3e3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:18.166541 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f9881-a553-449b-9e98-e5398d5e3e3e None admin] RBAC: Adding query filter params (role.id=f4692fa2043d468fae733095d5740686, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=a2ad9c7f930e426bb908237f72c04a2e) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:18.166986 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f9881-a553-449b-9e98-e5398d5e3e3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:18.168483 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8f9881-a553-449b-9e98-e5398d5e3e3e None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:18.174280 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 262/537] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:43:18 2022] GET /identity/v3/role_assignments?user.id=a2ad9c7f930e426bb908237f72c04a2e&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=f4692fa2043d468fae733095d5740686 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:18.175260 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f9881-a553-449b-9e98-e5398d5e3e3e None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:18.175720 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c93448-05c0-4042-8bba-754867922d36 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:18.211655 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b58e8-7d57-435d-9f88-34d5f7e82bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:18.212460 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b58e8-7d57-435d-9f88-34d5f7e82bd3 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:18.212742 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b58e8-7d57-435d-9f88-34d5f7e82bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:18.213015 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b58e8-7d57-435d-9f88-34d5f7e82bd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:18.220892 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b58e8-7d57-435d-9f88-34d5f7e82bd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:18.222405 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b58e8-7d57-435d-9f88-34d5f7e82bd3 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:18.237743 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-938b58e8-7d57-435d-9f88-34d5f7e82bd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:18.239790 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 276/538] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:18.252003 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b58e8-7d57-435d-9f88-34d5f7e82bd3 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:18.295534 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8f9881-a553-449b-9e98-e5398d5e3e3e None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:18.333559 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4625b67-b6a5-4e0b-a0ad-0692522c6c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:18.334542 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4625b67-b6a5-4e0b-a0ad-0692522c6c96 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:18.335048 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4625b67-b6a5-4e0b-a0ad-0692522c6c96 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:18.335502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4625b67-b6a5-4e0b-a0ad-0692522c6c96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:18.336562 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4625b67-b6a5-4e0b-a0ad-0692522c6c96 None admin] RBAC: Adding query filter params (role.id=f4692fa2043d468fae733095d5740686, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=3a09a31262e54eec84580c7259902df1) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:18.337076 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4625b67-b6a5-4e0b-a0ad-0692522c6c96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:18.339047 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4625b67-b6a5-4e0b-a0ad-0692522c6c96 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:18.345818 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 263/539] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:43:18 2022] GET /identity/v3/role_assignments?user.id=3a09a31262e54eec84580c7259902df1&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=f4692fa2043d468fae733095d5740686 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:18.420746 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b58e8-7d57-435d-9f88-34d5f7e82bd3 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:18.458524 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897a91c0-1adc-4249-98c1-e22787a1b7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:18.459219 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a91c0-1adc-4249-98c1-e22787a1b7d4 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:18.459497 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a91c0-1adc-4249-98c1-e22787a1b7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:18.459770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897a91c0-1adc-4249-98c1-e22787a1b7d4 None admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:18.460632 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a91c0-1adc-4249-98c1-e22787a1b7d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:18.460941 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a91c0-1adc-4249-98c1-e22787a1b7d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:18.462440 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897a91c0-1adc-4249-98c1-e22787a1b7d4 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:18.476088 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 277/540] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:18.481925 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4625b67-b6a5-4e0b-a0ad-0692522c6c96 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:18.607457 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4625b67-b6a5-4e0b-a0ad-0692522c6c96 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:18.642725 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93703bd1-dce0-4e03-b797-ac310fe11040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:18.643418 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93703bd1-dce0-4e03-b797-ac310fe11040 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:18.643697 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93703bd1-dce0-4e03-b797-ac310fe11040 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:18.643970 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93703bd1-dce0-4e03-b797-ac310fe11040 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:18.644836 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93703bd1-dce0-4e03-b797-ac310fe11040 None admin] RBAC: Adding query filter params (role.id=f4692fa2043d468fae733095d5740686, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=c6936272118b49a9baa19f3bd5066f9d) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:18.645147 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93703bd1-dce0-4e03-b797-ac310fe11040 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:18.646579 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93703bd1-dce0-4e03-b797-ac310fe11040 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:18.652487 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 264/541] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:43:18 2022] GET /identity/v3/role_assignments?user.id=c6936272118b49a9baa19f3bd5066f9d&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=f4692fa2043d468fae733095d5740686 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:19.781718 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b8083-380b-4e84-95dc-1eaea01777ef None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:19.782596 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b8083-380b-4e84-95dc-1eaea01777ef None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:19.783089 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8b8083-380b-4e84-95dc-1eaea01777ef None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:19.785359 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 278/542] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:19.792252 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686f114-0031-48f0-aa78-42a1df067d9f None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:19.793072 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686f114-0031-48f0-aa78-42a1df067d9f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:19.793536 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686f114-0031-48f0-aa78-42a1df067d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:19.814337 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-a686f114-0031-48f0-aa78-42a1df067d9f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:19.815811 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a686f114-0031-48f0-aa78-42a1df067d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:19.883897 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a2bc2-8cce-4373-a669-061ef8cfa4df None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:19.884552 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a2bc2-8cce-4373-a669-061ef8cfa4df None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:19.885018 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a2bc2-8cce-4373-a669-061ef8cfa4df None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:19.887254 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 279/543] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:19.891817 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace16955-e6ac-4b5f-a86c-bd3dc922241a None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:19.892342 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace16955-e6ac-4b5f-a86c-bd3dc922241a None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:19.892810 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace16955-e6ac-4b5f-a86c-bd3dc922241a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:19.912562 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-ace16955-e6ac-4b5f-a86c-bd3dc922241a None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:19.913732 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ace16955-e6ac-4b5f-a86c-bd3dc922241a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:19.925473 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 265/544] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:19.950952 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686f114-0031-48f0-aa78-42a1df067d9f None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:20.007445 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 280/545] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:20.042114 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace16955-e6ac-4b5f-a86c-bd3dc922241a None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:20.122731 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686f114-0031-48f0-aa78-42a1df067d9f None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:20.181612 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645192b7-05db-4ca1-ada0-cca6a621d0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:20.182420 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645192b7-05db-4ca1-ada0-cca6a621d0ff None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:20.182694 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645192b7-05db-4ca1-ada0-cca6a621d0ff None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:20.182995 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645192b7-05db-4ca1-ada0-cca6a621d0ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:20.185003 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace16955-e6ac-4b5f-a86c-bd3dc922241a None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:20.200613 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645192b7-05db-4ca1-ada0-cca6a621d0ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:20.208006 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-645192b7-05db-4ca1-ada0-cca6a621d0ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 23:43:20.215321 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 266/546] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:43:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:20.220300 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6faa5c-be45-41a4-9c91-d0061fbbf373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:20.220750 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645192b7-05db-4ca1-ada0-cca6a621d0ff None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:20.221092 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6faa5c-be45-41a4-9c91-d0061fbbf373 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:20.221375 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6faa5c-be45-41a4-9c91-d0061fbbf373 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:20.221767 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6faa5c-be45-41a4-9c91-d0061fbbf373 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:20.233367 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6faa5c-be45-41a4-9c91-d0061fbbf373 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:20.241383 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-ef6faa5c-be45-41a4-9c91-d0061fbbf373 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 23:43:20.242766 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 281/547] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:43:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:20.248098 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6faa5c-be45-41a4-9c91-d0061fbbf373 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:20.396977 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6faa5c-be45-41a4-9c91-d0061fbbf373 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:20.434436 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23d6f9-79e3-4992-8f16-91e11ac63da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:20.435422 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23d6f9-79e3-4992-8f16-91e11ac63da2 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:20.436263 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23d6f9-79e3-4992-8f16-91e11ac63da2 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:20.436988 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d23d6f9-79e3-4992-8f16-91e11ac63da2 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:20.437951 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23d6f9-79e3-4992-8f16-91e11ac63da2 None admin] RBAC: Adding query filter params (name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:20.438595 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23d6f9-79e3-4992-8f16-91e11ac63da2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:20.440458 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d23d6f9-79e3-4992-8f16-91e11ac63da2 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:20.448985 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645192b7-05db-4ca1-ada0-cca6a621d0ff None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:20.449704 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 282/548] 10.222.0.24 () {56 vars in 1103 bytes} [Mon Apr 11 23:43:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:20.454814 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23d6f9-79e3-4992-8f16-91e11ac63da2 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:20.544786 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb871ac-07bd-4d35-9cad-fca1040fbeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:20.545455 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb871ac-07bd-4d35-9cad-fca1040fbeeb None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:20.545732 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb871ac-07bd-4d35-9cad-fca1040fbeeb None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:20.546005 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb871ac-07bd-4d35-9cad-fca1040fbeeb None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:20.546749 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb871ac-07bd-4d35-9cad-fca1040fbeeb None admin] RBAC: Adding query filter params (name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:20.547081 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb871ac-07bd-4d35-9cad-fca1040fbeeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:20.548428 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb871ac-07bd-4d35-9cad-fca1040fbeeb None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:20.570171 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 267/549] 10.222.0.24 () {56 vars in 1103 bytes} [Mon Apr 11 23:43:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:20.570746 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d23d6f9-79e3-4992-8f16-91e11ac63da2 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:20.580327 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb871ac-07bd-4d35-9cad-fca1040fbeeb None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:20.613802 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2764c30-22b0-4394-be4a-98a5562b57f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:20.614595 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2764c30-22b0-4394-be4a-98a5562b57f3 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:20.614898 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2764c30-22b0-4394-be4a-98a5562b57f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:20.615177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2764c30-22b0-4394-be4a-98a5562b57f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:20.634192 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2764c30-22b0-4394-be4a-98a5562b57f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:20.636393 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2764c30-22b0-4394-be4a-98a5562b57f3 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:20.669746 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-e2764c30-22b0-4394-be4a-98a5562b57f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:20.671073 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 283/550] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:20.683784 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2764c30-22b0-4394-be4a-98a5562b57f3 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:20.732597 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb871ac-07bd-4d35-9cad-fca1040fbeeb None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:20.781072 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9d298-3fe7-476f-bc3c-3ee897cfb21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:20.781946 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9d298-3fe7-476f-bc3c-3ee897cfb21b None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:20.782224 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9d298-3fe7-476f-bc3c-3ee897cfb21b None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:20.782492 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e9d298-3fe7-476f-bc3c-3ee897cfb21b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:20.808142 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9d298-3fe7-476f-bc3c-3ee897cfb21b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:20.809672 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e9d298-3fe7-476f-bc3c-3ee897cfb21b None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:20.833325 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2764c30-22b0-4394-be4a-98a5562b57f3 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:20.835169 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-50e9d298-3fe7-476f-bc3c-3ee897cfb21b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:20.836859 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 268/551] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:20.844057 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9d298-3fe7-476f-bc3c-3ee897cfb21b None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:20.870288 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c9b9b-726c-4b54-94d5-9e564fde87ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:20.870886 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c9b9b-726c-4b54-94d5-9e564fde87ee None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:20.871179 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c9b9b-726c-4b54-94d5-9e564fde87ee None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:20.871449 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c9b9b-726c-4b54-94d5-9e564fde87ee None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:20.872175 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c9b9b-726c-4b54-94d5-9e564fde87ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:20.872474 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c9b9b-726c-4b54-94d5-9e564fde87ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:20.873983 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c9b9b-726c-4b54-94d5-9e564fde87ee None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:20.905420 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 284/552] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:20.906759 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee8e29-97fb-4bb9-b3ca-1a433e7a0327 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:20.911284 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee8e29-97fb-4bb9-b3ca-1a433e7a0327 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:20.911284 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ee8e29-97fb-4bb9-b3ca-1a433e7a0327 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:20.911284 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 285/553] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:20.913291 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee8e29-97fb-4bb9-b3ca-1a433e7a0327 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:20.967779 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e9d298-3fe7-476f-bc3c-3ee897cfb21b None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:21.010263 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf85039-63a2-49bb-b163-604c1de1b6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:21.010964 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf85039-63a2-49bb-b163-604c1de1b6ad None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:21.011244 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf85039-63a2-49bb-b163-604c1de1b6ad None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:21.011510 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf85039-63a2-49bb-b163-604c1de1b6ad None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:21.012277 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf85039-63a2-49bb-b163-604c1de1b6ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:21.012520 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf85039-63a2-49bb-b163-604c1de1b6ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:21.013936 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf85039-63a2-49bb-b163-604c1de1b6ad None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:21.026616 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 269/554] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:21.028054 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea135fc7-59c7-44ca-bf32-90511be6ae49 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:21.028513 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea135fc7-59c7-44ca-bf32-90511be6ae49 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:21.028790 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea135fc7-59c7-44ca-bf32-90511be6ae49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:21.037507 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ee8e29-97fb-4bb9-b3ca-1a433e7a0327 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:21.045296 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-ea135fc7-59c7-44ca-bf32-90511be6ae49 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:21.046639 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-ea135fc7-59c7-44ca-bf32-90511be6ae49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:21.099041 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6a7e8-f568-4d5d-bdd2-906e21a10892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:21.099890 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6a7e8-f568-4d5d-bdd2-906e21a10892 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:21.100168 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6a7e8-f568-4d5d-bdd2-906e21a10892 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:21.100438 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6a7e8-f568-4d5d-bdd2-906e21a10892 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:21.109330 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6a7e8-f568-4d5d-bdd2-906e21a10892 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:21.111445 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6a7e8-f568-4d5d-bdd2-906e21a10892 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:21.128828 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-46f6a7e8-f568-4d5d-bdd2-906e21a10892 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 23:43:21.130979 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 286/555] 10.222.0.24 () {56 vars in 1093 bytes} [Mon Apr 11 23:43:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:21.131790 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6a7e8-f568-4d5d-bdd2-906e21a10892 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:21.135421 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 270/556] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:21.136736 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea135fc7-59c7-44ca-bf32-90511be6ae49 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:21.238640 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea135fc7-59c7-44ca-bf32-90511be6ae49 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:21.246292 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6a7e8-f568-4d5d-bdd2-906e21a10892 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:21.274458 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39337428-0224-4263-b17b-d435b1b10ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:21.275741 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39337428-0224-4263-b17b-d435b1b10ab5 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:21.275741 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39337428-0224-4263-b17b-d435b1b10ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:21.275741 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39337428-0224-4263-b17b-d435b1b10ab5 None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:21.276491 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39337428-0224-4263-b17b-d435b1b10ab5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:21.276794 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39337428-0224-4263-b17b-d435b1b10ab5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:21.278210 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39337428-0224-4263-b17b-d435b1b10ab5 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:21.289531 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba31d9-0e1e-435b-a973-a1cb54672fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:21.290697 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba31d9-0e1e-435b-a973-a1cb54672fe7 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:21.291048 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba31d9-0e1e-435b-a973-a1cb54672fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:21.291541 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba31d9-0e1e-435b-a973-a1cb54672fe7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:21.300090 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 271/557] 10.222.0.24 () {56 vars in 1133 bytes} [Mon Apr 11 23:43:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:21.300090 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083257ac-bc57-420b-9c51-f53975f2c8be None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:21.300090 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083257ac-bc57-420b-9c51-f53975f2c8be None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:21.300090 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083257ac-bc57-420b-9c51-f53975f2c8be None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:21.300090 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 272/558] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:21.300827 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083257ac-bc57-420b-9c51-f53975f2c8be None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:21.305101 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba31d9-0e1e-435b-a973-a1cb54672fe7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:21.306552 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebba31d9-0e1e-435b-a973-a1cb54672fe7 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:21.320533 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-ebba31d9-0e1e-435b-a973-a1cb54672fe7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 23:43:21.321720 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 287/559] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:43:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:21.322991 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba31d9-0e1e-435b-a973-a1cb54672fe7 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:21.405966 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083257ac-bc57-420b-9c51-f53975f2c8be None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:21.424036 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba31d9-0e1e-435b-a973-a1cb54672fe7 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:21.439735 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e20ac-866e-40b4-b01b-89f9bd0e87aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:21.440522 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e20ac-866e-40b4-b01b-89f9bd0e87aa None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:21.440808 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e20ac-866e-40b4-b01b-89f9bd0e87aa None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:21.441076 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e20ac-866e-40b4-b01b-89f9bd0e87aa None admin] PATH_INFO: `/v3/roles/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:21.451568 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e20ac-866e-40b4-b01b-89f9bd0e87aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:21.459781 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-079e20ac-866e-40b4-b01b-89f9bd0e87aa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 23:43:21.459979 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac818039-7b02-4802-8220-681a26c25c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:21.460716 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac818039-7b02-4802-8220-681a26c25c07 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:21.460991 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac818039-7b02-4802-8220-681a26c25c07 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:21.461300 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 273/560] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:43:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:21.461392 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac818039-7b02-4802-8220-681a26c25c07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:21.462494 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2f3ff-2a7b-4a96-a3e6-5f544865501e None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:21.462782 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2f3ff-2a7b-4a96-a3e6-5f544865501e None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:21.463086 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da2f3ff-2a7b-4a96-a3e6-5f544865501e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:21.473523 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac818039-7b02-4802-8220-681a26c25c07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:21.475380 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac818039-7b02-4802-8220-681a26c25c07 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:21.480028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-2da2f3ff-2a7b-4a96-a3e6-5f544865501e None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:21.481212 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-2da2f3ff-2a7b-4a96-a3e6-5f544865501e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:21.495231 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-ac818039-7b02-4802-8220-681a26c25c07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:21.501120 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 288/561] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:21.501120 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac818039-7b02-4802-8220-681a26c25c07 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:21.545823 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 274/562] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:21.547005 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2f3ff-2a7b-4a96-a3e6-5f544865501e None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:21.610404 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac818039-7b02-4802-8220-681a26c25c07 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:21.639676 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da2f3ff-2a7b-4a96-a3e6-5f544865501e None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:21.641701 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88828b-6426-4b19-9b36-941b2bcd1aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:21.642353 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88828b-6426-4b19-9b36-941b2bcd1aa6 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:21.642627 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88828b-6426-4b19-9b36-941b2bcd1aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:21.642921 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a88828b-6426-4b19-9b36-941b2bcd1aa6 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:21.643744 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88828b-6426-4b19-9b36-941b2bcd1aa6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:21.644047 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88828b-6426-4b19-9b36-941b2bcd1aa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:21.645988 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a88828b-6426-4b19-9b36-941b2bcd1aa6 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:21.662458 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 289/563] 10.222.0.24 () {56 vars in 1135 bytes} [Mon Apr 11 23:43:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:21.663258 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88828b-6426-4b19-9b36-941b2bcd1aa6 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:21.671841 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ab4f2-9f0f-49f2-9205-636cb521905a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:21.672499 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ab4f2-9f0f-49f2-9205-636cb521905a None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:21.672772 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ab4f2-9f0f-49f2-9205-636cb521905a None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:21.673038 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ab4f2-9f0f-49f2-9205-636cb521905a None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:21.673774 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ab4f2-9f0f-49f2-9205-636cb521905a None admin] RBAC: Adding query filter params (name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:21.674080 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ab4f2-9f0f-49f2-9205-636cb521905a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:21.675455 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9ab4f2-9f0f-49f2-9205-636cb521905a None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:21.683132 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 275/564] 10.222.0.24 () {56 vars in 1103 bytes} [Mon Apr 11 23:43:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:21.684309 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18884672-e3f0-4ba3-b2b5-c5e3d77a2832 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:21.684589 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18884672-e3f0-4ba3-b2b5-c5e3d77a2832 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:21.684857 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18884672-e3f0-4ba3-b2b5-c5e3d77a2832 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:21.686459 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 276/565] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:21.687195 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18884672-e3f0-4ba3-b2b5-c5e3d77a2832 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:21.763431 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a88828b-6426-4b19-9b36-941b2bcd1aa6 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:21.783721 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18884672-e3f0-4ba3-b2b5-c5e3d77a2832 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:21.795443 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf318b-166d-4f5e-a77f-a956d0d4defa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:21.796090 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf318b-166d-4f5e-a77f-a956d0d4defa None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:21.796365 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf318b-166d-4f5e-a77f-a956d0d4defa None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:21.796633 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf318b-166d-4f5e-a77f-a956d0d4defa None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:21.797342 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf318b-166d-4f5e-a77f-a956d0d4defa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:21.797643 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf318b-166d-4f5e-a77f-a956d0d4defa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:21.799007 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf318b-166d-4f5e-a77f-a956d0d4defa None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:21.809709 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 290/566] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:21.810728 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf318b-166d-4f5e-a77f-a956d0d4defa None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:21.815578 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352dc25a-e43b-4853-aec1-537d320c78db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:21.816369 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352dc25a-e43b-4853-aec1-537d320c78db None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:21.817150 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352dc25a-e43b-4853-aec1-537d320c78db None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:21.817417 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352dc25a-e43b-4853-aec1-537d320c78db None admin] PATH_INFO: `/v3/roles/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:21.827172 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352dc25a-e43b-4853-aec1-537d320c78db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:21.834582 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-352dc25a-e43b-4853-aec1-537d320c78db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 23:43:21.835754 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 277/567] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:43:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:21.836501 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352dc25a-e43b-4853-aec1-537d320c78db None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:21.903375 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf318b-166d-4f5e-a77f-a956d0d4defa None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:21.929126 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352dc25a-e43b-4853-aec1-537d320c78db None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:21.934071 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c51ab-0bf9-4ade-80a7-aab04a439ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:21.934700 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c51ab-0bf9-4ade-80a7-aab04a439ea2 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:21.935008 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c51ab-0bf9-4ade-80a7-aab04a439ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:21.935277 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7c51ab-0bf9-4ade-80a7-aab04a439ea2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:21.960703 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d2e24-be0b-45aa-8f02-f2d5c408c3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:21.961465 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d2e24-be0b-45aa-8f02-f2d5c408c3c5 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:21.961735 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d2e24-be0b-45aa-8f02-f2d5c408c3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:21.961999 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d2e24-be0b-45aa-8f02-f2d5c408c3c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:21.972128 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d2e24-be0b-45aa-8f02-f2d5c408c3c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:21.973594 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d2e24-be0b-45aa-8f02-f2d5c408c3c5 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:21.989069 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-1f5d2e24-be0b-45aa-8f02-f2d5c408c3c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:21.990218 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 278/568] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:21.991443 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c208b9-9a3f-4491-a840-30ef9648b551 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:21.991725 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c208b9-9a3f-4491-a840-30ef9648b551 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:21.992059 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c208b9-9a3f-4491-a840-30ef9648b551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:22.003433 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c51ab-0bf9-4ade-80a7-aab04a439ea2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:22.005390 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7c51ab-0bf9-4ade-80a7-aab04a439ea2 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:22.008646 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-a9c208b9-9a3f-4491-a840-30ef9648b551 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:22.010159 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a9c208b9-9a3f-4491-a840-30ef9648b551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:22.085888 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 279/569] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:22.086629 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c208b9-9a3f-4491-a840-30ef9648b551 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:22.119082 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 291/570] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:43:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:43:22.119983 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c51ab-0bf9-4ade-80a7-aab04a439ea2 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:22.184579 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c208b9-9a3f-4491-a840-30ef9648b551 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:22.213108 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7c51ab-0bf9-4ade-80a7-aab04a439ea2 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:22.216185 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5696f18-539f-47fe-85e3-a6876a587845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:22.216959 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5696f18-539f-47fe-85e3-a6876a587845 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:22.217230 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5696f18-539f-47fe-85e3-a6876a587845 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:22.217493 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5696f18-539f-47fe-85e3-a6876a587845 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:22.224424 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5696f18-539f-47fe-85e3-a6876a587845 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:22.225834 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5696f18-539f-47fe-85e3-a6876a587845 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:22.238269 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-a5696f18-539f-47fe-85e3-a6876a587845 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:22.239653 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 280/571] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:22.240268 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5696f18-539f-47fe-85e3-a6876a587845 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:22.245802 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43af7b-a697-412e-bef4-7697fdbeaa45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:22.246467 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43af7b-a697-412e-bef4-7697fdbeaa45 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:22.246742 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43af7b-a697-412e-bef4-7697fdbeaa45 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:22.247042 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d43af7b-a697-412e-bef4-7697fdbeaa45 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:22.247793 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43af7b-a697-412e-bef4-7697fdbeaa45 None admin] RBAC: Adding query filter params (name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:22.248097 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43af7b-a697-412e-bef4-7697fdbeaa45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:22.249459 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d43af7b-a697-412e-bef4-7697fdbeaa45 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:22.257275 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 292/572] 10.222.0.24 () {56 vars in 1103 bytes} [Mon Apr 11 23:43:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:22.258053 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43af7b-a697-412e-bef4-7697fdbeaa45 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:22.337314 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5696f18-539f-47fe-85e3-a6876a587845 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:22.351023 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d43af7b-a697-412e-bef4-7697fdbeaa45 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:22.368524 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06d61a-17d4-4092-b079-c8101d238718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:22.369173 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d61a-17d4-4092-b079-c8101d238718 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:22.369447 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d61a-17d4-4092-b079-c8101d238718 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:22.369714 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06d61a-17d4-4092-b079-c8101d238718 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:22.370415 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06d61a-17d4-4092-b079-c8101d238718 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:22.370711 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06d61a-17d4-4092-b079-c8101d238718 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:22.372102 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06d61a-17d4-4092-b079-c8101d238718 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:22.381695 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fb334-70a3-4ac3-a96b-0e28e0fdffdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:22.382463 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fb334-70a3-4ac3-a96b-0e28e0fdffdf None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:22.382737 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fb334-70a3-4ac3-a96b-0e28e0fdffdf None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:22.383037 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fb334-70a3-4ac3-a96b-0e28e0fdffdf None admin] PATH_INFO: `/v3/roles/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:22.383164 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 281/573] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:22.383845 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06d61a-17d4-4092-b079-c8101d238718 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:22.393019 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16fb334-70a3-4ac3-a96b-0e28e0fdffdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:22.400487 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-a16fb334-70a3-4ac3-a96b-0e28e0fdffdf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 23:43:22.401772 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 293/574] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:43:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:22.402542 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fb334-70a3-4ac3-a96b-0e28e0fdffdf None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:22.483189 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06d61a-17d4-4092-b079-c8101d238718 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:22.498262 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16fb334-70a3-4ac3-a96b-0e28e0fdffdf None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:22.515021 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d16de5-2e48-4719-a87f-f3327b1787f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:22.515809 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d16de5-2e48-4719-a87f-f3327b1787f4 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:22.516091 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d16de5-2e48-4719-a87f-f3327b1787f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:22.516367 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d16de5-2e48-4719-a87f-f3327b1787f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:22.526454 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d16de5-2e48-4719-a87f-f3327b1787f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:22.527910 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d16de5-2e48-4719-a87f-f3327b1787f4 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:22.529827 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f9d73-c7c4-4995-87cb-1c9442789ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:22.530463 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f9d73-c7c4-4995-87cb-1c9442789ccf None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:22.530739 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f9d73-c7c4-4995-87cb-1c9442789ccf None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:22.531036 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f9d73-c7c4-4995-87cb-1c9442789ccf None admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:22.531807 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f9d73-c7c4-4995-87cb-1c9442789ccf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:22.532112 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f9d73-c7c4-4995-87cb-1c9442789ccf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:22.533495 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20f9d73-c7c4-4995-87cb-1c9442789ccf None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:22.543911 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-b2d16de5-2e48-4719-a87f-f3327b1787f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:22.544735 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 294/575] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:22.545182 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 282/576] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:22.545504 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f9d73-c7c4-4995-87cb-1c9442789ccf None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:22.545925 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d16de5-2e48-4719-a87f-f3327b1787f4 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:22.638459 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d16de5-2e48-4719-a87f-f3327b1787f4 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:22.646353 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f9d73-c7c4-4995-87cb-1c9442789ccf None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:22.673214 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bca57-8e98-4f59-b464-b7ee8efda484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:22.674002 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bca57-8e98-4f59-b464-b7ee8efda484 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:22.674281 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bca57-8e98-4f59-b464-b7ee8efda484 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:22.674592 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807bca57-8e98-4f59-b464-b7ee8efda484 None admin] PATH_INFO: `/v3/users/glance` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:22.677630 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1a5b9-3689-4fbd-a32b-8600cd28f921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:22.678399 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1a5b9-3689-4fbd-a32b-8600cd28f921 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:22.678673 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1a5b9-3689-4fbd-a32b-8600cd28f921 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:22.678970 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1a5b9-3689-4fbd-a32b-8600cd28f921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:22.681613 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bca57-8e98-4f59-b464-b7ee8efda484 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:22.683176 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807bca57-8e98-4f59-b464-b7ee8efda484 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:22.688743 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1a5b9-3689-4fbd-a32b-8600cd28f921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:22.690171 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f1a5b9-3689-4fbd-a32b-8600cd28f921 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:22.697252 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-807bca57-8e98-4f59-b464-b7ee8efda484 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 11 23:43:22.698442 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 283/577] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:43:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:22.699225 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bca57-8e98-4f59-b464-b7ee8efda484 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:22.707219 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-45f1a5b9-3689-4fbd-a32b-8600cd28f921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:22.708914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 295/578] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:22.709648 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1a5b9-3689-4fbd-a32b-8600cd28f921 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:22.799189 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807bca57-8e98-4f59-b464-b7ee8efda484 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:22.813487 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1a5b9-3689-4fbd-a32b-8600cd28f921 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:22.834140 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c6492-4f2b-4744-8e8b-7b0746418061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:22.835016 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c6492-4f2b-4744-8e8b-7b0746418061 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:22.835112 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c6492-4f2b-4744-8e8b-7b0746418061 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:22.835360 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c6492-4f2b-4744-8e8b-7b0746418061 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:22.836161 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c6492-4f2b-4744-8e8b-7b0746418061 None admin] RBAC: Adding query filter params (name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:22.836449 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c6492-4f2b-4744-8e8b-7b0746418061 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:22.837827 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c6492-4f2b-4744-8e8b-7b0746418061 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:22.851712 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 284/579] 10.222.0.24 () {56 vars in 1103 bytes} [Mon Apr 11 23:43:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:22.851712 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c6492-4f2b-4744-8e8b-7b0746418061 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:22.851964 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cc3fb-28d3-44a6-bb11-fb816aae0153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:22.852634 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cc3fb-28d3-44a6-bb11-fb816aae0153 None admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:22.852911 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cc3fb-28d3-44a6-bb11-fb816aae0153 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:22.853187 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cc3fb-28d3-44a6-bb11-fb816aae0153 None admin] PATH_INFO: `/v3/projects/3563c87e56124c688a8029b4088cb198/users/a9519f49f897415a894c1121278dda9c/roles/f4692fa2043d468fae733095d5740686` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:22.869331 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840cc3fb-28d3-44a6-bb11-fb816aae0153 None admin] RBAC: Authorizing `identity:create_grant(project_id=3563c87e56124c688a8029b4088cb198, user_id=a9519f49f897415a894c1121278dda9c, role_id=f4692fa2043d468fae733095d5740686)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:22.870776 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840cc3fb-28d3-44a6-bb11-fb816aae0153 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:22.951443 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c6492-4f2b-4744-8e8b-7b0746418061 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:22.969713 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 296/580] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:43:22 2022] PUT /identity/v3/projects/3563c87e56124c688a8029b4088cb198/users/a9519f49f897415a894c1121278dda9c/roles/f4692fa2043d468fae733095d5740686 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:43:22.970626 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cc3fb-28d3-44a6-bb11-fb816aae0153 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:22.992822 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d2d6e-9305-4153-81ba-8c0cdaee4a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:22.993511 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d2d6e-9305-4153-81ba-8c0cdaee4a75 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:22.993793 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d2d6e-9305-4153-81ba-8c0cdaee4a75 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:22.994068 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d2d6e-9305-4153-81ba-8c0cdaee4a75 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:22.994806 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d2d6e-9305-4153-81ba-8c0cdaee4a75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:22.995157 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d2d6e-9305-4153-81ba-8c0cdaee4a75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:22.996588 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d2d6e-9305-4153-81ba-8c0cdaee4a75 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:23.015119 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 285/581] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:23.016669 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d2d6e-9305-4153-81ba-8c0cdaee4a75 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:23.086664 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cc3fb-28d3-44a6-bb11-fb816aae0153 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:23.123753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc99c47-0a09-4e53-95cc-be0f31a63e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:23.124432 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc99c47-0a09-4e53-95cc-be0f31a63e09 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:23.124710 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc99c47-0a09-4e53-95cc-be0f31a63e09 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:23.124983 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc99c47-0a09-4e53-95cc-be0f31a63e09 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:23.125847 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc99c47-0a09-4e53-95cc-be0f31a63e09 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:23.126154 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc99c47-0a09-4e53-95cc-be0f31a63e09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:23.127660 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc99c47-0a09-4e53-95cc-be0f31a63e09 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:23.137406 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d2d6e-9305-4153-81ba-8c0cdaee4a75 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:23.153617 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 297/582] 10.222.0.24 () {56 vars in 1137 bytes} [Mon Apr 11 23:43:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:23.153617 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc99c47-0a09-4e53-95cc-be0f31a63e09 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:23.183927 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f44a1-956a-4d7e-9e8a-3cdac8ce5587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:23.184592 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f44a1-956a-4d7e-9e8a-3cdac8ce5587 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:23.184931 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f44a1-956a-4d7e-9e8a-3cdac8ce5587 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:23.185129 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f44a1-956a-4d7e-9e8a-3cdac8ce5587 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:23.186082 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f44a1-956a-4d7e-9e8a-3cdac8ce5587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:23.186199 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f44a1-956a-4d7e-9e8a-3cdac8ce5587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:23.187500 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f44a1-956a-4d7e-9e8a-3cdac8ce5587 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:23.199224 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 286/583] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:23.200128 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f44a1-956a-4d7e-9e8a-3cdac8ce5587 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:23.258972 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc99c47-0a09-4e53-95cc-be0f31a63e09 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:23.294599 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6d2c5-58aa-447d-b43a-979932dcdb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:23.295692 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6d2c5-58aa-447d-b43a-979932dcdb44 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:23.296137 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6d2c5-58aa-447d-b43a-979932dcdb44 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:23.296554 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6d2c5-58aa-447d-b43a-979932dcdb44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:23.310212 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6d2c5-58aa-447d-b43a-979932dcdb44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:23.312310 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6d2c5-58aa-447d-b43a-979932dcdb44 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:23.318559 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f44a1-956a-4d7e-9e8a-3cdac8ce5587 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:23.337151 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-bef6d2c5-58aa-447d-b43a-979932dcdb44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:23.343055 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 298/584] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:23.343055 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6d2c5-58aa-447d-b43a-979932dcdb44 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:23.359232 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b52462-fdc6-47fa-ae05-5336f064d79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:23.360027 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b52462-fdc6-47fa-ae05-5336f064d79e None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:23.360301 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b52462-fdc6-47fa-ae05-5336f064d79e None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:23.360564 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b52462-fdc6-47fa-ae05-5336f064d79e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:23.367642 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b52462-fdc6-47fa-ae05-5336f064d79e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:23.369155 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b52462-fdc6-47fa-ae05-5336f064d79e None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:23.383639 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-87b52462-fdc6-47fa-ae05-5336f064d79e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:23.384862 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 287/585] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:23.385644 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b52462-fdc6-47fa-ae05-5336f064d79e None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:23.443871 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6d2c5-58aa-447d-b43a-979932dcdb44 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:23.481408 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31919d91-596d-48d9-a459-d4a02cb56508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:23.482197 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31919d91-596d-48d9-a459-d4a02cb56508 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:23.482481 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31919d91-596d-48d9-a459-d4a02cb56508 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:23.482790 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31919d91-596d-48d9-a459-d4a02cb56508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:23.492739 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31919d91-596d-48d9-a459-d4a02cb56508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:23.492972 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b52462-fdc6-47fa-ae05-5336f064d79e None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:23.494373 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31919d91-596d-48d9-a459-d4a02cb56508 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:23.512636 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-31919d91-596d-48d9-a459-d4a02cb56508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:23.518298 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 299/586] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:23.518298 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31919d91-596d-48d9-a459-d4a02cb56508 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:23.529515 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68e836-6165-434a-a4da-3cad085353c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:23.530303 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68e836-6165-434a-a4da-3cad085353c1 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:23.530577 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68e836-6165-434a-a4da-3cad085353c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:23.530875 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68e836-6165-434a-a4da-3cad085353c1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:23.538521 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68e836-6165-434a-a4da-3cad085353c1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:23.540907 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68e836-6165-434a-a4da-3cad085353c1 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:23.555189 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-fe68e836-6165-434a-a4da-3cad085353c1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 11 23:43:23.560956 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 288/587] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:43:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:23.560956 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68e836-6165-434a-a4da-3cad085353c1 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:23.615701 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31919d91-596d-48d9-a459-d4a02cb56508 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:23.648016 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde404d7-86cd-4f4f-acab-edd57a5b495f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:23.648668 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde404d7-86cd-4f4f-acab-edd57a5b495f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:23.648942 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde404d7-86cd-4f4f-acab-edd57a5b495f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:23.649209 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde404d7-86cd-4f4f-acab-edd57a5b495f None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:23.649928 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde404d7-86cd-4f4f-acab-edd57a5b495f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:23.650223 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde404d7-86cd-4f4f-acab-edd57a5b495f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:23.651623 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde404d7-86cd-4f4f-acab-edd57a5b495f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:23.655322 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68e836-6165-434a-a4da-3cad085353c1 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:23.663363 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 300/588] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:23.665394 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde404d7-86cd-4f4f-acab-edd57a5b495f None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:23.689134 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97d426-9ba0-448a-840b-2b2817897d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:23.689789 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97d426-9ba0-448a-840b-2b2817897d84 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:23.690071 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97d426-9ba0-448a-840b-2b2817897d84 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:23.690338 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97d426-9ba0-448a-840b-2b2817897d84 None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:23.691145 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97d426-9ba0-448a-840b-2b2817897d84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:23.691475 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97d426-9ba0-448a-840b-2b2817897d84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:23.692884 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97d426-9ba0-448a-840b-2b2817897d84 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:23.709411 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 289/589] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:23.709411 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97d426-9ba0-448a-840b-2b2817897d84 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:23.766416 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde404d7-86cd-4f4f-acab-edd57a5b495f None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:23.801270 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781a524-450b-4058-b1ec-77611abda1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:23.801935 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781a524-450b-4058-b1ec-77611abda1a2 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:23.802217 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781a524-450b-4058-b1ec-77611abda1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:23.802490 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781a524-450b-4058-b1ec-77611abda1a2 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:23.803246 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781a524-450b-4058-b1ec-77611abda1a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:23.803551 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781a524-450b-4058-b1ec-77611abda1a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:23.804907 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781a524-450b-4058-b1ec-77611abda1a2 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:23.809099 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97d426-9ba0-448a-840b-2b2817897d84 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:23.816753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 301/590] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:23.817561 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781a524-450b-4058-b1ec-77611abda1a2 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:23.842261 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7cd53-e536-4a3c-a685-c059ce8e2a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:23.842950 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7cd53-e536-4a3c-a685-c059ce8e2a6e None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:23.843227 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7cd53-e536-4a3c-a685-c059ce8e2a6e None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:23.843491 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b7cd53-e536-4a3c-a685-c059ce8e2a6e None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:23.844345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7cd53-e536-4a3c-a685-c059ce8e2a6e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:23.844646 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7cd53-e536-4a3c-a685-c059ce8e2a6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:23.846062 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b7cd53-e536-4a3c-a685-c059ce8e2a6e None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:23.863278 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 290/591] 10.222.0.24 () {56 vars in 1137 bytes} [Mon Apr 11 23:43:23 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:23.864096 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7cd53-e536-4a3c-a685-c059ce8e2a6e None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:23.914071 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781a524-450b-4058-b1ec-77611abda1a2 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:23.949854 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67202d06-5b71-4885-8a28-5a40fd985e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:23.950933 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67202d06-5b71-4885-8a28-5a40fd985e8a None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:23.951212 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67202d06-5b71-4885-8a28-5a40fd985e8a None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:23.951478 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67202d06-5b71-4885-8a28-5a40fd985e8a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:23.959850 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67202d06-5b71-4885-8a28-5a40fd985e8a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:23.961214 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b7cd53-e536-4a3c-a685-c059ce8e2a6e None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:23.961324 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67202d06-5b71-4885-8a28-5a40fd985e8a None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:23.975728 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-67202d06-5b71-4885-8a28-5a40fd985e8a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 11 23:43:23.981530 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 302/592] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:43:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:23.981530 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67202d06-5b71-4885-8a28-5a40fd985e8a None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:23.999543 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c17438-12e3-4305-b469-8fb9bca91b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:24.000221 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c17438-12e3-4305-b469-8fb9bca91b56 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:24.000497 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c17438-12e3-4305-b469-8fb9bca91b56 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:24.000768 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c17438-12e3-4305-b469-8fb9bca91b56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:24.001584 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c17438-12e3-4305-b469-8fb9bca91b56 None admin] RBAC: Adding query filter params (role.id=f4692fa2043d468fae733095d5740686, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=189d616b38304d91bf1c7aded81205e3) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:24.001890 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c17438-12e3-4305-b469-8fb9bca91b56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:24.003368 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c17438-12e3-4305-b469-8fb9bca91b56 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:24.008729 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 291/593] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:43:23 2022] GET /identity/v3/role_assignments?user.id=189d616b38304d91bf1c7aded81205e3&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=f4692fa2043d468fae733095d5740686 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:24.009511 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c17438-12e3-4305-b469-8fb9bca91b56 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:24.115371 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67202d06-5b71-4885-8a28-5a40fd985e8a None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:24.115805 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c17438-12e3-4305-b469-8fb9bca91b56 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:24.150761 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102860f-59b1-4362-90bb-28dbc465f520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:24.151456 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102860f-59b1-4362-90bb-28dbc465f520 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:24.151731 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102860f-59b1-4362-90bb-28dbc465f520 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:24.152028 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d102860f-59b1-4362-90bb-28dbc465f520 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:24.159968 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102860f-59b1-4362-90bb-28dbc465f520 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:24.161971 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d102860f-59b1-4362-90bb-28dbc465f520 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:24.163530 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5e1fd-9c5b-4a61-b84a-f0807672f944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:24.165127 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5e1fd-9c5b-4a61-b84a-f0807672f944 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:24.165624 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5e1fd-9c5b-4a61-b84a-f0807672f944 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:24.166059 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc5e1fd-9c5b-4a61-b84a-f0807672f944 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:24.176337 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-d102860f-59b1-4362-90bb-28dbc465f520 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:24.182389 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 303/594] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:24.182389 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102860f-59b1-4362-90bb-28dbc465f520 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:24.184653 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5e1fd-9c5b-4a61-b84a-f0807672f944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:24.186346 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc5e1fd-9c5b-4a61-b84a-f0807672f944 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:24.208368 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-cbc5e1fd-9c5b-4a61-b84a-f0807672f944 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:24.210166 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 292/595] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:24.211172 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5e1fd-9c5b-4a61-b84a-f0807672f944 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:24.288866 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d102860f-59b1-4362-90bb-28dbc465f520 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:24.322856 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df5077-5c50-43bd-93e4-28f836f3ebc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:24.323769 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df5077-5c50-43bd-93e4-28f836f3ebc3 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:24.324198 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df5077-5c50-43bd-93e4-28f836f3ebc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:24.324679 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df5077-5c50-43bd-93e4-28f836f3ebc3 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:24.325653 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df5077-5c50-43bd-93e4-28f836f3ebc3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:24.326118 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df5077-5c50-43bd-93e4-28f836f3ebc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:24.327761 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df5077-5c50-43bd-93e4-28f836f3ebc3 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:24.334795 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc5e1fd-9c5b-4a61-b84a-f0807672f944 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:24.349100 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 304/596] 10.222.0.24 () {56 vars in 1139 bytes} [Mon Apr 11 23:43:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:24.350149 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df5077-5c50-43bd-93e4-28f836f3ebc3 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:24.377045 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd2a3b-6541-4ad1-bbd7-71204a1df699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:24.377627 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd2a3b-6541-4ad1-bbd7-71204a1df699 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:24.377929 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd2a3b-6541-4ad1-bbd7-71204a1df699 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:24.378189 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcd2a3b-6541-4ad1-bbd7-71204a1df699 None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:24.379048 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd2a3b-6541-4ad1-bbd7-71204a1df699 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:24.379362 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd2a3b-6541-4ad1-bbd7-71204a1df699 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:24.380802 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcd2a3b-6541-4ad1-bbd7-71204a1df699 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:24.392780 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 293/597] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:24.393576 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd2a3b-6541-4ad1-bbd7-71204a1df699 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:24.477293 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df5077-5c50-43bd-93e4-28f836f3ebc3 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:24.499328 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcd2a3b-6541-4ad1-bbd7-71204a1df699 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:24.520022 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213f52b-0642-4ff1-8281-8fbd7a21291b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:24.520938 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213f52b-0642-4ff1-8281-8fbd7a21291b None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:24.521439 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213f52b-0642-4ff1-8281-8fbd7a21291b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:24.521718 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213f52b-0642-4ff1-8281-8fbd7a21291b None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:24.522440 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213f52b-0642-4ff1-8281-8fbd7a21291b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:24.522742 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213f52b-0642-4ff1-8281-8fbd7a21291b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:24.524642 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213f52b-0642-4ff1-8281-8fbd7a21291b None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:24.534398 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadbb10-5cf9-48cd-93d3-9a51ce8a9f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:24.536053 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadbb10-5cf9-48cd-93d3-9a51ce8a9f9b None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:24.536526 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadbb10-5cf9-48cd-93d3-9a51ce8a9f9b None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:24.536971 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dadbb10-5cf9-48cd-93d3-9a51ce8a9f9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:24.537980 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 305/598] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:24.538927 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213f52b-0642-4ff1-8281-8fbd7a21291b None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:24.548499 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadbb10-5cf9-48cd-93d3-9a51ce8a9f9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:24.550210 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dadbb10-5cf9-48cd-93d3-9a51ce8a9f9b None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:24.571683 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-5dadbb10-5cf9-48cd-93d3-9a51ce8a9f9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:24.573652 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 294/599] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:24.574794 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadbb10-5cf9-48cd-93d3-9a51ce8a9f9b None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:24.650913 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213f52b-0642-4ff1-8281-8fbd7a21291b None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:24.690229 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d35fc-2299-4d2e-a355-e3facff664e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:24.691927 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d35fc-2299-4d2e-a355-e3facff664e9 None admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:24.692204 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d35fc-2299-4d2e-a355-e3facff664e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:24.692473 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d35fc-2299-4d2e-a355-e3facff664e9 None admin] PATH_INFO: `/v3/projects/3563c87e56124c688a8029b4088cb198/users/a2ad9c7f930e426bb908237f72c04a2e/roles/f4692fa2043d468fae733095d5740686` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:24.694309 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dadbb10-5cf9-48cd-93d3-9a51ce8a9f9b None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:24.709912 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d35fc-2299-4d2e-a355-e3facff664e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3563c87e56124c688a8029b4088cb198, user_id=a2ad9c7f930e426bb908237f72c04a2e, role_id=f4692fa2043d468fae733095d5740686)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:24.712012 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d35fc-2299-4d2e-a355-e3facff664e9 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:24.731930 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de31b17-620a-4441-aec6-51c47105d285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:24.732875 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de31b17-620a-4441-aec6-51c47105d285 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:24.742218 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de31b17-620a-4441-aec6-51c47105d285 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:24.742218 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de31b17-620a-4441-aec6-51c47105d285 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:24.742218 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de31b17-620a-4441-aec6-51c47105d285 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:24.742218 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de31b17-620a-4441-aec6-51c47105d285 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:24.756003 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-2de31b17-620a-4441-aec6-51c47105d285 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:24.757545 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 295/600] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:24.758395 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de31b17-620a-4441-aec6-51c47105d285 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:24.815161 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 306/601] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:43:24 2022] PUT /identity/v3/projects/3563c87e56124c688a8029b4088cb198/users/a2ad9c7f930e426bb908237f72c04a2e/roles/f4692fa2043d468fae733095d5740686 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:43:24.817278 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d35fc-2299-4d2e-a355-e3facff664e9 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:24.870660 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de31b17-620a-4441-aec6-51c47105d285 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:24.908463 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f66c3d-6c21-4846-ad01-f8120229d5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:24.909040 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f66c3d-6c21-4846-ad01-f8120229d5b3 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:24.909317 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f66c3d-6c21-4846-ad01-f8120229d5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:24.909589 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f66c3d-6c21-4846-ad01-f8120229d5b3 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:24.910360 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f66c3d-6c21-4846-ad01-f8120229d5b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:24.910667 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f66c3d-6c21-4846-ad01-f8120229d5b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:24.912112 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f66c3d-6c21-4846-ad01-f8120229d5b3 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:24.925145 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 296/602] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:24.931121 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f66c3d-6c21-4846-ad01-f8120229d5b3 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:25.036278 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d35fc-2299-4d2e-a355-e3facff664e9 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:25.112861 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a602494-917a-448c-ace6-54cc381bb5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:25.114440 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a602494-917a-448c-ace6-54cc381bb5b7 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:25.115109 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a602494-917a-448c-ace6-54cc381bb5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:25.117174 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f66c3d-6c21-4846-ad01-f8120229d5b3 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:25.117677 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a602494-917a-448c-ace6-54cc381bb5b7 None admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:25.118667 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a602494-917a-448c-ace6-54cc381bb5b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:25.120614 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a602494-917a-448c-ace6-54cc381bb5b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:25.122254 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a602494-917a-448c-ace6-54cc381bb5b7 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:25.140330 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 307/603] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:25.146248 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a602494-917a-448c-ace6-54cc381bb5b7 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:25.201049 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bdc0b-6366-48e3-9afe-6ec7acca024c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:25.201772 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bdc0b-6366-48e3-9afe-6ec7acca024c None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:25.202056 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bdc0b-6366-48e3-9afe-6ec7acca024c None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:25.202333 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771bdc0b-6366-48e3-9afe-6ec7acca024c None admin] PATH_INFO: `/v3/projects/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:25.220006 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771bdc0b-6366-48e3-9afe-6ec7acca024c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:25.221460 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771bdc0b-6366-48e3-9afe-6ec7acca024c None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:25.247192 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-771bdc0b-6366-48e3-9afe-6ec7acca024c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:25.249779 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a602494-917a-448c-ace6-54cc381bb5b7 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:25.255323 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 297/604] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:25.260445 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bdc0b-6366-48e3-9afe-6ec7acca024c None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:25.284554 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84ad35d-006a-47a9-ae4f-8633a2165fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:25.285878 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ad35d-006a-47a9-ae4f-8633a2165fe3 None admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:25.286372 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ad35d-006a-47a9-ae4f-8633a2165fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:25.286865 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84ad35d-006a-47a9-ae4f-8633a2165fe3 None admin] PATH_INFO: `/v3/projects/3563c87e56124c688a8029b4088cb198/users/3a09a31262e54eec84580c7259902df1/roles/f4692fa2043d468fae733095d5740686` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:25.303001 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ad35d-006a-47a9-ae4f-8633a2165fe3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3563c87e56124c688a8029b4088cb198, user_id=3a09a31262e54eec84580c7259902df1, role_id=f4692fa2043d468fae733095d5740686)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:25.304816 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84ad35d-006a-47a9-ae4f-8633a2165fe3 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:25.400739 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771bdc0b-6366-48e3-9afe-6ec7acca024c None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:25.413641 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 308/605] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:43:25 2022] PUT /identity/v3/projects/3563c87e56124c688a8029b4088cb198/users/3a09a31262e54eec84580c7259902df1/roles/f4692fa2043d468fae733095d5740686 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 23:43:25.415581 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5712d-8918-4bcf-8f08-24a21766828d None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:25.416112 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5712d-8918-4bcf-8f08-24a21766828d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:25.416639 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb5712d-8918-4bcf-8f08-24a21766828d None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:25.423473 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 309/606] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:25.425394 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e645586-f2e7-4906-8520-62d8c1adc871 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:25.431223 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e645586-f2e7-4906-8520-62d8c1adc871 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:25.431223 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e645586-f2e7-4906-8520-62d8c1adc871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:25.442654 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456b21c-5d29-44c2-98ec-3ff415f95d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:25.443353 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456b21c-5d29-44c2-98ec-3ff415f95d53 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:25.443635 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456b21c-5d29-44c2-98ec-3ff415f95d53 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:25.443906 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456b21c-5d29-44c2-98ec-3ff415f95d53 None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:25.444701 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456b21c-5d29-44c2-98ec-3ff415f95d53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:25.445007 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456b21c-5d29-44c2-98ec-3ff415f95d53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:25.446489 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-4e645586-f2e7-4906-8520-62d8c1adc871 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:25.446598 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456b21c-5d29-44c2-98ec-3ff415f95d53 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:25.448194 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-4e645586-f2e7-4906-8520-62d8c1adc871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:25.467017 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 298/607] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:25.471396 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456b21c-5d29-44c2-98ec-3ff415f95d53 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:25.576259 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 310/608] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:25.626235 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e645586-f2e7-4906-8520-62d8c1adc871 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:25.657398 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456b21c-5d29-44c2-98ec-3ff415f95d53 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:25.696229 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acbfef-eb37-4ff2-8cf3-4bc886831fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:25.697123 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acbfef-eb37-4ff2-8cf3-4bc886831fab None admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:25.697400 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acbfef-eb37-4ff2-8cf3-4bc886831fab None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:25.697671 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0acbfef-eb37-4ff2-8cf3-4bc886831fab None admin] PATH_INFO: `/v3/projects/3563c87e56124c688a8029b4088cb198/users/c6936272118b49a9baa19f3bd5066f9d/roles/f4692fa2043d468fae733095d5740686` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:25.716632 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0acbfef-eb37-4ff2-8cf3-4bc886831fab None admin] RBAC: Authorizing `identity:create_grant(project_id=3563c87e56124c688a8029b4088cb198, user_id=c6936272118b49a9baa19f3bd5066f9d, role_id=f4692fa2043d468fae733095d5740686)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:25.718130 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0acbfef-eb37-4ff2-8cf3-4bc886831fab None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:25.754571 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e645586-f2e7-4906-8520-62d8c1adc871 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:25.796254 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c86934-d38a-457d-b30c-73ea274683ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:25.797165 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c86934-d38a-457d-b30c-73ea274683ac None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:25.797453 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c86934-d38a-457d-b30c-73ea274683ac None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:25.797728 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c86934-d38a-457d-b30c-73ea274683ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:25.809808 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c86934-d38a-457d-b30c-73ea274683ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:25.818018 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-d0c86934-d38a-457d-b30c-73ea274683ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 23:43:25.819705 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 311/609] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:43:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:25.824945 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c86934-d38a-457d-b30c-73ea274683ac None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:25.845478 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 299/610] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:43:25 2022] PUT /identity/v3/projects/3563c87e56124c688a8029b4088cb198/users/c6936272118b49a9baa19f3bd5066f9d/roles/f4692fa2043d468fae733095d5740686 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:43:25.942327 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c86934-d38a-457d-b30c-73ea274683ac None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:25.980188 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb549a0-775c-4bdc-aac4-2dd3ca01b9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:25.980787 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb549a0-775c-4bdc-aac4-2dd3ca01b9f6 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:25.981071 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb549a0-775c-4bdc-aac4-2dd3ca01b9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:25.981346 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb549a0-775c-4bdc-aac4-2dd3ca01b9f6 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:25.982119 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb549a0-775c-4bdc-aac4-2dd3ca01b9f6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:25.982426 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb549a0-775c-4bdc-aac4-2dd3ca01b9f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:25.984088 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb549a0-775c-4bdc-aac4-2dd3ca01b9f6 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:25.994000 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 312/611] 10.222.0.24 () {56 vars in 1103 bytes} [Mon Apr 11 23:43:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:26.000733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acbfef-eb37-4ff2-8cf3-4bc886831fab None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:26.116786 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0acbfef-eb37-4ff2-8cf3-4bc886831fab None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:26.152783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b0b16-d07b-49e9-97ce-d452f9a938f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:26.153596 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b0b16-d07b-49e9-97ce-d452f9a938f6 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:26.153876 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b0b16-d07b-49e9-97ce-d452f9a938f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:26.154148 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b0b16-d07b-49e9-97ce-d452f9a938f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:26.165786 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b0b16-d07b-49e9-97ce-d452f9a938f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:26.167274 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b0b16-d07b-49e9-97ce-d452f9a938f6 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:26.184747 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-160b0b16-d07b-49e9-97ce-d452f9a938f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:26.186359 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 300/612] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:26.193234 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb549a0-775c-4bdc-aac4-2dd3ca01b9f6 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:26.301374 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb549a0-775c-4bdc-aac4-2dd3ca01b9f6 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:26.338363 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2e126-aab3-41f9-a925-cd45b73db682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:26.339367 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2e126-aab3-41f9-a925-cd45b73db682 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:26.339649 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2e126-aab3-41f9-a925-cd45b73db682 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:26.339967 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2e126-aab3-41f9-a925-cd45b73db682 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:26.340707 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2e126-aab3-41f9-a925-cd45b73db682 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:26.341013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2e126-aab3-41f9-a925-cd45b73db682 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:26.342371 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2e126-aab3-41f9-a925-cd45b73db682 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:26.356379 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 313/613] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:26.361324 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b0b16-d07b-49e9-97ce-d452f9a938f6 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:26.486458 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b0b16-d07b-49e9-97ce-d452f9a938f6 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:26.526420 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffdddc-c7cd-43e3-8df9-fa2050714dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:26.527239 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffdddc-c7cd-43e3-8df9-fa2050714dd3 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:26.527517 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffdddc-c7cd-43e3-8df9-fa2050714dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:26.527787 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffdddc-c7cd-43e3-8df9-fa2050714dd3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:26.535962 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffdddc-c7cd-43e3-8df9-fa2050714dd3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:26.537583 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffdddc-c7cd-43e3-8df9-fa2050714dd3 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:26.558945 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-c0ffdddc-c7cd-43e3-8df9-fa2050714dd3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 23:43:26.560397 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 301/614] 10.222.0.24 () {56 vars in 1093 bytes} [Mon Apr 11 23:43:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:26.565874 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2e126-aab3-41f9-a925-cd45b73db682 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:26.665942 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c858f4d-8124-4b17-a6ea-3f8a73a21705 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:26.666510 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c858f4d-8124-4b17-a6ea-3f8a73a21705 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:26.667009 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c858f4d-8124-4b17-a6ea-3f8a73a21705 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:26.669259 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 302/615] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:26.695488 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839c8b8-d0ab-482a-a785-78c10773123f None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:26.696072 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839c8b8-d0ab-482a-a785-78c10773123f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:26.696531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839c8b8-d0ab-482a-a785-78c10773123f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:26.721980 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2e126-aab3-41f9-a925-cd45b73db682 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:26.730978 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-c839c8b8-d0ab-482a-a785-78c10773123f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:26.732396 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-c839c8b8-d0ab-482a-a785-78c10773123f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:26.766402 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f25c2-d428-4e69-a48d-65ab03c578c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:26.767402 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f25c2-d428-4e69-a48d-65ab03c578c3 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:26.767851 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f25c2-d428-4e69-a48d-65ab03c578c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:26.768334 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f25c2-d428-4e69-a48d-65ab03c578c3 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:26.769341 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f25c2-d428-4e69-a48d-65ab03c578c3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:26.771739 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f25c2-d428-4e69-a48d-65ab03c578c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:26.773360 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f25c2-d428-4e69-a48d-65ab03c578c3 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:26.819102 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 314/616] 10.222.0.24 () {56 vars in 1133 bytes} [Mon Apr 11 23:43:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:26.819993 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f25c2-d428-4e69-a48d-65ab03c578c3 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:26.849522 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 303/617] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:26.869877 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839c8b8-d0ab-482a-a785-78c10773123f None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:26.969678 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839c8b8-d0ab-482a-a785-78c10773123f None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:27.011562 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac43ba2-91ed-4cd4-b62b-eaacd45be5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:27.012366 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac43ba2-91ed-4cd4-b62b-eaacd45be5f0 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:27.012642 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac43ba2-91ed-4cd4-b62b-eaacd45be5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:27.012907 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac43ba2-91ed-4cd4-b62b-eaacd45be5f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:27.033752 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac43ba2-91ed-4cd4-b62b-eaacd45be5f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:27.042300 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-2ac43ba2-91ed-4cd4-b62b-eaacd45be5f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 23:43:27.048633 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 304/618] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:43:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:27.064138 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f25c2-d428-4e69-a48d-65ab03c578c3 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:27.070496 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac43ba2-91ed-4cd4-b62b-eaacd45be5f0 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:27.150210 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c14efe-bf0c-4750-8494-dabb415d2d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:27.151280 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c14efe-bf0c-4750-8494-dabb415d2d5a None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:27.151757 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c14efe-bf0c-4750-8494-dabb415d2d5a None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:27.152220 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c14efe-bf0c-4750-8494-dabb415d2d5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:27.202050 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac43ba2-91ed-4cd4-b62b-eaacd45be5f0 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:27.237043 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a41d90-9234-4ff6-91f7-82accd8d2b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:27.237710 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a41d90-9234-4ff6-91f7-82accd8d2b6f None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:27.237989 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a41d90-9234-4ff6-91f7-82accd8d2b6f None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:27.238292 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a41d90-9234-4ff6-91f7-82accd8d2b6f None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:27.239168 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a41d90-9234-4ff6-91f7-82accd8d2b6f None admin] RBAC: Adding query filter params (name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:27.239479 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a41d90-9234-4ff6-91f7-82accd8d2b6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:27.240848 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a41d90-9234-4ff6-91f7-82accd8d2b6f None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:27.249485 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 305/619] 10.222.0.24 () {56 vars in 1103 bytes} [Mon Apr 11 23:43:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:27.255225 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a41d90-9234-4ff6-91f7-82accd8d2b6f None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:27.283147 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c14efe-bf0c-4750-8494-dabb415d2d5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:27.285195 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c14efe-bf0c-4750-8494-dabb415d2d5a None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:27.372398 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a41d90-9234-4ff6-91f7-82accd8d2b6f None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:27.409535 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31c506-85c8-4237-80e7-dec0de8005c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:27.410514 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31c506-85c8-4237-80e7-dec0de8005c4 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:27.410925 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31c506-85c8-4237-80e7-dec0de8005c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:27.411341 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb31c506-85c8-4237-80e7-dec0de8005c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:27.423150 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31c506-85c8-4237-80e7-dec0de8005c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:27.425251 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb31c506-85c8-4237-80e7-dec0de8005c4 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:27.444556 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-cb31c506-85c8-4237-80e7-dec0de8005c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:27.446253 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 306/620] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:27.451814 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31c506-85c8-4237-80e7-dec0de8005c4 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:27.487000 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 315/621] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:43:27.489060 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c14efe-bf0c-4750-8494-dabb415d2d5a None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:27.554312 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb31c506-85c8-4237-80e7-dec0de8005c4 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:27.588000 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c554af-2565-400b-b10c-a5d46f9ec829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:27.588975 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c554af-2565-400b-b10c-a5d46f9ec829 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:27.589253 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c554af-2565-400b-b10c-a5d46f9ec829 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:27.589525 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c554af-2565-400b-b10c-a5d46f9ec829 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:27.590021 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c14efe-bf0c-4750-8494-dabb415d2d5a None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:27.590245 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c554af-2565-400b-b10c-a5d46f9ec829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:27.590549 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c554af-2565-400b-b10c-a5d46f9ec829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:27.592047 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c554af-2565-400b-b10c-a5d46f9ec829 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:27.604183 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 307/622] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:27.605490 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf41b05-fdf9-4c39-9cda-8c0686ee2389 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:27.605775 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf41b05-fdf9-4c39-9cda-8c0686ee2389 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:27.606047 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf41b05-fdf9-4c39-9cda-8c0686ee2389 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:27.607984 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 308/623] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:27.616132 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71238d20-d96b-40f9-a089-ddfdf840dd33 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:27.616132 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71238d20-d96b-40f9-a089-ddfdf840dd33 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:27.616132 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71238d20-d96b-40f9-a089-ddfdf840dd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:27.630325 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e36bd8-2cee-4850-ab9d-7f639fd3f62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:27.631111 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e36bd8-2cee-4850-ab9d-7f639fd3f62f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:27.631391 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e36bd8-2cee-4850-ab9d-7f639fd3f62f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:27.631660 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e36bd8-2cee-4850-ab9d-7f639fd3f62f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:27.632520 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-71238d20-d96b-40f9-a089-ddfdf840dd33 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:27.633716 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-71238d20-d96b-40f9-a089-ddfdf840dd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:27.643579 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e36bd8-2cee-4850-ab9d-7f639fd3f62f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:27.645444 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e36bd8-2cee-4850-ab9d-7f639fd3f62f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:27.667664 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-10e36bd8-2cee-4850-ab9d-7f639fd3f62f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:27.670155 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 316/624] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:27.671017 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e36bd8-2cee-4850-ab9d-7f639fd3f62f None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:27.706983 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 309/625] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:27.707883 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71238d20-d96b-40f9-a089-ddfdf840dd33 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:27.791796 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e36bd8-2cee-4850-ab9d-7f639fd3f62f None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:27.826105 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6dc9a8-ad24-4064-b2b7-d03de4b04bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:27.826975 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dc9a8-ad24-4064-b2b7-d03de4b04bb8 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:27.827254 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dc9a8-ad24-4064-b2b7-d03de4b04bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:27.827524 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6dc9a8-ad24-4064-b2b7-d03de4b04bb8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:27.834794 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6dc9a8-ad24-4064-b2b7-d03de4b04bb8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:27.836405 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6dc9a8-ad24-4064-b2b7-d03de4b04bb8 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:27.844516 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71238d20-d96b-40f9-a089-ddfdf840dd33 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:27.851136 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-5d6dc9a8-ad24-4064-b2b7-d03de4b04bb8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 23:43:27.856997 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 317/626] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:43:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:27.858033 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6dc9a8-ad24-4064-b2b7-d03de4b04bb8 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:27.879520 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560cbb61-d121-4eac-84fb-5cbeb556cb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:27.880184 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cbb61-d121-4eac-84fb-5cbeb556cb23 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:27.880517 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cbb61-d121-4eac-84fb-5cbeb556cb23 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:27.880734 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cbb61-d121-4eac-84fb-5cbeb556cb23 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:27.881673 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560cbb61-d121-4eac-84fb-5cbeb556cb23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:27.881814 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560cbb61-d121-4eac-84fb-5cbeb556cb23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:27.883166 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560cbb61-d121-4eac-84fb-5cbeb556cb23 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:27.895106 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 310/627] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:27.895589 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560cbb61-d121-4eac-84fb-5cbeb556cb23 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:27.960390 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6dc9a8-ad24-4064-b2b7-d03de4b04bb8 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:27.997773 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560cbb61-d121-4eac-84fb-5cbeb556cb23 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:28.009103 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1aa24e-1e98-4f5a-ad02-57a84dee8879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:28.009103 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1aa24e-1e98-4f5a-ad02-57a84dee8879 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:28.009103 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1aa24e-1e98-4f5a-ad02-57a84dee8879 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:28.009103 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1aa24e-1e98-4f5a-ad02-57a84dee8879 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:28.016623 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1aa24e-1e98-4f5a-ad02-57a84dee8879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:28.026566 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-4e1aa24e-1e98-4f5a-ad02-57a84dee8879 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 23:43:28.028756 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 318/628] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:43:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:28.030999 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1aa24e-1e98-4f5a-ad02-57a84dee8879 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:28.034982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa50b0-7694-4e9f-adc4-aecafa04b507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:28.034982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa50b0-7694-4e9f-adc4-aecafa04b507 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:28.034982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa50b0-7694-4e9f-adc4-aecafa04b507 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:28.034982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa50b0-7694-4e9f-adc4-aecafa04b507 None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:28.038241 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa50b0-7694-4e9f-adc4-aecafa04b507 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:28.038241 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa50b0-7694-4e9f-adc4-aecafa04b507 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:28.038241 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa50b0-7694-4e9f-adc4-aecafa04b507 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:28.056515 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 311/629] 10.222.0.24 () {56 vars in 1135 bytes} [Mon Apr 11 23:43:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:28.061782 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa50b0-7694-4e9f-adc4-aecafa04b507 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:28.164054 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1aa24e-1e98-4f5a-ad02-57a84dee8879 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:28.176277 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa50b0-7694-4e9f-adc4-aecafa04b507 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:28.200285 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80aab29-02e9-4f81-97fe-98159609d8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:28.201224 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aab29-02e9-4f81-97fe-98159609d8be None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:28.201607 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aab29-02e9-4f81-97fe-98159609d8be None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:28.201979 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aab29-02e9-4f81-97fe-98159609d8be None admin] PATH_INFO: `/v3/projects/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:28.209444 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80aab29-02e9-4f81-97fe-98159609d8be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:28.211053 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80aab29-02e9-4f81-97fe-98159609d8be None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:28.220479 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7989586-290e-4c84-a5a3-30e56c4f3a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:28.221344 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7989586-290e-4c84-a5a3-30e56c4f3a31 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:28.221789 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7989586-290e-4c84-a5a3-30e56c4f3a31 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:28.222196 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7989586-290e-4c84-a5a3-30e56c4f3a31 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:28.223686 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7989586-290e-4c84-a5a3-30e56c4f3a31 None admin] RBAC: Adding query filter params (name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:28.224148 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7989586-290e-4c84-a5a3-30e56c4f3a31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:28.225695 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7989586-290e-4c84-a5a3-30e56c4f3a31 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:28.227305 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-d80aab29-02e9-4f81-97fe-98159609d8be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:28.228980 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 319/630] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:28.229902 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80aab29-02e9-4f81-97fe-98159609d8be None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:28.241183 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 312/631] 10.222.0.24 () {56 vars in 1103 bytes} [Mon Apr 11 23:43:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:28.241183 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7989586-290e-4c84-a5a3-30e56c4f3a31 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:28.329090 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80aab29-02e9-4f81-97fe-98159609d8be None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:28.355043 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7989586-290e-4c84-a5a3-30e56c4f3a31 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:28.366179 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3426b-8209-4fd3-a47f-ad04845c4612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:28.366999 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3426b-8209-4fd3-a47f-ad04845c4612 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:28.367275 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3426b-8209-4fd3-a47f-ad04845c4612 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:28.367543 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3426b-8209-4fd3-a47f-ad04845c4612 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:28.377592 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3426b-8209-4fd3-a47f-ad04845c4612 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:28.379095 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3426b-8209-4fd3-a47f-ad04845c4612 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:28.392127 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a9f9b-6834-4e5c-9d61-ad3f8f8a7471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:28.393014 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a9f9b-6834-4e5c-9d61-ad3f8f8a7471 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:28.393473 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a9f9b-6834-4e5c-9d61-ad3f8f8a7471 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:28.393919 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a9f9b-6834-4e5c-9d61-ad3f8f8a7471 None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:28.395425 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a9f9b-6834-4e5c-9d61-ad3f8f8a7471 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:28.395931 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a9f9b-6834-4e5c-9d61-ad3f8f8a7471 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:28.396156 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-44b3426b-8209-4fd3-a47f-ad04845c4612 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:28.397338 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 320/632] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:28.397880 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a9f9b-6834-4e5c-9d61-ad3f8f8a7471 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:28.398099 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3426b-8209-4fd3-a47f-ad04845c4612 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:28.417105 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 313/633] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:28.417105 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf901e-11bd-43c3-83a3-7443227064b9 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:28.417105 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf901e-11bd-43c3-83a3-7443227064b9 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:28.417105 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcf901e-11bd-43c3-83a3-7443227064b9 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:28.418061 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 314/634] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:28.422712 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf901e-11bd-43c3-83a3-7443227064b9 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:28.505233 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3426b-8209-4fd3-a47f-ad04845c4612 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:28.523562 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcf901e-11bd-43c3-83a3-7443227064b9 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:28.538672 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e5400-9713-4832-8bf3-3edcfded6a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:28.539487 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e5400-9713-4832-8bf3-3edcfded6a69 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:28.539763 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e5400-9713-4832-8bf3-3edcfded6a69 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:28.540039 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e5400-9713-4832-8bf3-3edcfded6a69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:28.549746 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e5400-9713-4832-8bf3-3edcfded6a69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:28.551232 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e5400-9713-4832-8bf3-3edcfded6a69 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:28.555746 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27244b35-9f9e-4306-a53a-4a607cd1e036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:28.556395 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27244b35-9f9e-4306-a53a-4a607cd1e036 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:28.556677 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27244b35-9f9e-4306-a53a-4a607cd1e036 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:28.556952 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27244b35-9f9e-4306-a53a-4a607cd1e036 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:28.557670 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27244b35-9f9e-4306-a53a-4a607cd1e036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:28.557974 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27244b35-9f9e-4306-a53a-4a607cd1e036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:28.559346 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27244b35-9f9e-4306-a53a-4a607cd1e036 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:28.568032 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-205e5400-9713-4832-8bf3-3edcfded6a69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:28.569200 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 321/635] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:28.569960 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e5400-9713-4832-8bf3-3edcfded6a69 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:28.570709 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 315/636] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:28.571790 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896cb9b-bde4-43b1-baa0-a6b3997aeda9 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:28.572088 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896cb9b-bde4-43b1-baa0-a6b3997aeda9 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:28.572366 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a896cb9b-bde4-43b1-baa0-a6b3997aeda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:28.589015 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-a896cb9b-bde4-43b1-baa0-a6b3997aeda9 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:28.590177 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a896cb9b-bde4-43b1-baa0-a6b3997aeda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:28.651487 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 316/637] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:28.652834 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4519d29-b709-4f66-b346-e55f6727b0cb None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:28.653121 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4519d29-b709-4f66-b346-e55f6727b0cb None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:28.653389 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4519d29-b709-4f66-b346-e55f6727b0cb None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:28.655067 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 317/638] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:28.655755 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4519d29-b709-4f66-b346-e55f6727b0cb None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:28.675105 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e5400-9713-4832-8bf3-3edcfded6a69 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:28.707848 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86648a-849b-4c5b-a3b5-92def044138c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:28.708488 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86648a-849b-4c5b-a3b5-92def044138c None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:28.708768 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86648a-849b-4c5b-a3b5-92def044138c None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:28.709039 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86648a-849b-4c5b-a3b5-92def044138c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:28.709865 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86648a-849b-4c5b-a3b5-92def044138c None admin] RBAC: Adding query filter params (role.id=f4692fa2043d468fae733095d5740686, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=a9519f49f897415a894c1121278dda9c) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:28.710174 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86648a-849b-4c5b-a3b5-92def044138c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:28.711611 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86648a-849b-4c5b-a3b5-92def044138c None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:28.717350 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 322/639] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:43:28 2022] GET /identity/v3/role_assignments?user.id=a9519f49f897415a894c1121278dda9c&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=f4692fa2043d468fae733095d5740686 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:28.718112 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86648a-849b-4c5b-a3b5-92def044138c None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:28.759937 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4519d29-b709-4f66-b346-e55f6727b0cb None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:28.798501 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26665b8-297e-42e4-9ace-e4dc37c5a815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:28.799365 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26665b8-297e-42e4-9ace-e4dc37c5a815 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:28.799742 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26665b8-297e-42e4-9ace-e4dc37c5a815 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:28.800171 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26665b8-297e-42e4-9ace-e4dc37c5a815 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:28.801505 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26665b8-297e-42e4-9ace-e4dc37c5a815 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:28.801879 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26665b8-297e-42e4-9ace-e4dc37c5a815 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:28.803376 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26665b8-297e-42e4-9ace-e4dc37c5a815 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:28.815435 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 318/640] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:28.817539 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7f80b-9fc2-40bd-b130-a6a86baf91b9 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:28.817923 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7f80b-9fc2-40bd-b130-a6a86baf91b9 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:28.818293 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b7f80b-9fc2-40bd-b130-a6a86baf91b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:28.831740 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86648a-849b-4c5b-a3b5-92def044138c None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:28.836214 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-13b7f80b-9fc2-40bd-b130-a6a86baf91b9 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:28.837552 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-13b7f80b-9fc2-40bd-b130-a6a86baf91b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:28.867981 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97641e2d-6ea2-49bb-8dde-591651139354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:28.868795 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97641e2d-6ea2-49bb-8dde-591651139354 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:28.869072 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97641e2d-6ea2-49bb-8dde-591651139354 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:28.869344 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97641e2d-6ea2-49bb-8dde-591651139354 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:28.876864 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97641e2d-6ea2-49bb-8dde-591651139354 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:28.878325 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97641e2d-6ea2-49bb-8dde-591651139354 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:28.892519 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-97641e2d-6ea2-49bb-8dde-591651139354 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:28.894070 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 323/641] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:28.894980 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97641e2d-6ea2-49bb-8dde-591651139354 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:28.911405 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 319/642] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:28.914942 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7f80b-9fc2-40bd-b130-a6a86baf91b9 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:29.017583 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97641e2d-6ea2-49bb-8dde-591651139354 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:29.020525 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b7f80b-9fc2-40bd-b130-a6a86baf91b9 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:29.050435 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf008d2-382e-468c-8569-ebbe1af99eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:29.051809 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf008d2-382e-468c-8569-ebbe1af99eeb None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:29.052086 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf008d2-382e-468c-8569-ebbe1af99eeb None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:29.052351 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf008d2-382e-468c-8569-ebbe1af99eeb None admin] PATH_INFO: `/v3/roles/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:29.058866 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2120f-8076-4509-bb36-fd861e5a312b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:29.060563 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2120f-8076-4509-bb36-fd861e5a312b None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:29.061016 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2120f-8076-4509-bb36-fd861e5a312b None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:29.061433 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c2120f-8076-4509-bb36-fd861e5a312b None admin] PATH_INFO: `/v3/users/glance` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:29.062949 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf008d2-382e-468c-8569-ebbe1af99eeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:29.069541 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2120f-8076-4509-bb36-fd861e5a312b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:29.070490 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-6bf008d2-382e-468c-8569-ebbe1af99eeb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 23:43:29.071335 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c2120f-8076-4509-bb36-fd861e5a312b None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:29.071713 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 324/643] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:43:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:29.072474 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf008d2-382e-468c-8569-ebbe1af99eeb None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:29.093946 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-38c2120f-8076-4509-bb36-fd861e5a312b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Apr 11 23:43:29.095983 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 320/644] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:43:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:29.096883 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2120f-8076-4509-bb36-fd861e5a312b None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:29.181795 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf008d2-382e-468c-8569-ebbe1af99eeb None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:29.206060 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c2120f-8076-4509-bb36-fd861e5a312b None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:29.218248 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc83e3-b9ec-4822-8bc6-ff091bac6f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:29.219120 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc83e3-b9ec-4822-8bc6-ff091bac6f2a None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:29.219544 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc83e3-b9ec-4822-8bc6-ff091bac6f2a None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:29.219997 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc83e3-b9ec-4822-8bc6-ff091bac6f2a None admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:29.220932 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc83e3-b9ec-4822-8bc6-ff091bac6f2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:29.221385 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc83e3-b9ec-4822-8bc6-ff091bac6f2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:29.223541 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc83e3-b9ec-4822-8bc6-ff091bac6f2a None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:29.236198 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 325/645] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:29.237305 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc83e3-b9ec-4822-8bc6-ff091bac6f2a None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:29.247507 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7e8a0-57db-411a-97a4-a86556af2b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:29.248301 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7e8a0-57db-411a-97a4-a86556af2b13 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:29.248586 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7e8a0-57db-411a-97a4-a86556af2b13 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:29.248856 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7e8a0-57db-411a-97a4-a86556af2b13 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:29.259040 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7e8a0-57db-411a-97a4-a86556af2b13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:29.265994 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-abd7e8a0-57db-411a-97a4-a86556af2b13 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 23:43:29.267194 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 321/646] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:43:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:29.267998 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7e8a0-57db-411a-97a4-a86556af2b13 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:29.338935 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc83e3-b9ec-4822-8bc6-ff091bac6f2a None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:29.367885 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7e8a0-57db-411a-97a4-a86556af2b13 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:29.373384 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d3be2-53c9-4bf8-9545-75866872d53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:29.374313 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d3be2-53c9-4bf8-9545-75866872d53d None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:29.374772 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d3be2-53c9-4bf8-9545-75866872d53d None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:29.375319 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53d3be2-53c9-4bf8-9545-75866872d53d None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:29.376076 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d3be2-53c9-4bf8-9545-75866872d53d None admin] RBAC: Adding query filter params (name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:29.376446 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d3be2-53c9-4bf8-9545-75866872d53d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:29.377824 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53d3be2-53c9-4bf8-9545-75866872d53d None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:29.390163 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 326/647] 10.222.0.24 () {56 vars in 1103 bytes} [Mon Apr 11 23:43:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:29.390163 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d3be2-53c9-4bf8-9545-75866872d53d None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:29.401036 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068362d3-0d6b-4fcd-9866-a8873044de63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:29.401700 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068362d3-0d6b-4fcd-9866-a8873044de63 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:29.401966 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068362d3-0d6b-4fcd-9866-a8873044de63 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:29.402237 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068362d3-0d6b-4fcd-9866-a8873044de63 None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:29.403075 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068362d3-0d6b-4fcd-9866-a8873044de63 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:29.403378 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068362d3-0d6b-4fcd-9866-a8873044de63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:29.404783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068362d3-0d6b-4fcd-9866-a8873044de63 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:29.421801 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 322/648] 10.222.0.24 () {56 vars in 1137 bytes} [Mon Apr 11 23:43:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:29.422598 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068362d3-0d6b-4fcd-9866-a8873044de63 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:29.492585 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53d3be2-53c9-4bf8-9545-75866872d53d None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:29.520334 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068362d3-0d6b-4fcd-9866-a8873044de63 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:29.525065 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304de59-f62d-41c4-b296-f3021c8b930d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:29.526150 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304de59-f62d-41c4-b296-f3021c8b930d None admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:29.526607 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304de59-f62d-41c4-b296-f3021c8b930d None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:29.527106 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304de59-f62d-41c4-b296-f3021c8b930d None admin] PATH_INFO: `/v3/projects/3563c87e56124c688a8029b4088cb198/users/189d616b38304d91bf1c7aded81205e3/roles/f4692fa2043d468fae733095d5740686` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:29.549008 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304de59-f62d-41c4-b296-f3021c8b930d None admin] RBAC: Authorizing `identity:create_grant(project_id=3563c87e56124c688a8029b4088cb198, user_id=189d616b38304d91bf1c7aded81205e3, role_id=f4692fa2043d468fae733095d5740686)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:29.551272 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304de59-f62d-41c4-b296-f3021c8b930d None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:29.555092 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebafb2f-ca2c-41ea-9446-6fdd9078dd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:29.555749 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebafb2f-ca2c-41ea-9446-6fdd9078dd04 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:29.556023 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebafb2f-ca2c-41ea-9446-6fdd9078dd04 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:29.556289 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebafb2f-ca2c-41ea-9446-6fdd9078dd04 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:29.557023 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebafb2f-ca2c-41ea-9446-6fdd9078dd04 None admin] RBAC: Adding query filter params (name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:29.557318 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebafb2f-ca2c-41ea-9446-6fdd9078dd04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:29.558647 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebafb2f-ca2c-41ea-9446-6fdd9078dd04 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:29.566561 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 323/649] 10.222.0.24 () {56 vars in 1103 bytes} [Mon Apr 11 23:43:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:29.567236 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebafb2f-ca2c-41ea-9446-6fdd9078dd04 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:29.620630 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 327/650] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:43:29 2022] PUT /identity/v3/projects/3563c87e56124c688a8029b4088cb198/users/189d616b38304d91bf1c7aded81205e3/roles/f4692fa2043d468fae733095d5740686 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:43:29.621762 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304de59-f62d-41c4-b296-f3021c8b930d None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:29.693675 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebafb2f-ca2c-41ea-9446-6fdd9078dd04 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:29.737270 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334a16a-f745-4604-b290-48bd6185b927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:29.739168 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334a16a-f745-4604-b290-48bd6185b927 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:29.740059 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334a16a-f745-4604-b290-48bd6185b927 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:29.740511 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334a16a-f745-4604-b290-48bd6185b927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:29.758724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334a16a-f745-4604-b290-48bd6185b927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:29.761150 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334a16a-f745-4604-b290-48bd6185b927 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:29.770172 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304de59-f62d-41c4-b296-f3021c8b930d None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:29.790023 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-9334a16a-f745-4604-b290-48bd6185b927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:29.792048 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 324/651] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:29.793623 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334a16a-f745-4604-b290-48bd6185b927 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:29.813496 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1218b8c-95d6-4f20-aff3-9cbf8fd6c090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:29.814510 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1218b8c-95d6-4f20-aff3-9cbf8fd6c090 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:29.815021 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1218b8c-95d6-4f20-aff3-9cbf8fd6c090 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:29.815616 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1218b8c-95d6-4f20-aff3-9cbf8fd6c090 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:29.885135 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1218b8c-95d6-4f20-aff3-9cbf8fd6c090 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:29.886582 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1218b8c-95d6-4f20-aff3-9cbf8fd6c090 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:29.899680 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334a16a-f745-4604-b290-48bd6185b927 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:29.935483 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bfb9a-555e-4cce-80a8-b625564d1282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:29.936425 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bfb9a-555e-4cce-80a8-b625564d1282 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:29.936719 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bfb9a-555e-4cce-80a8-b625564d1282 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:29.936981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bfb9a-555e-4cce-80a8-b625564d1282 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:29.948638 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bfb9a-555e-4cce-80a8-b625564d1282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:29.950084 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bfb9a-555e-4cce-80a8-b625564d1282 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:29.967162 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-ef4bfb9a-555e-4cce-80a8-b625564d1282 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:29.968667 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 325/652] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:29.969458 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bfb9a-555e-4cce-80a8-b625564d1282 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:29.986739 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 328/653] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:43:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:43:29.992424 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1218b8c-95d6-4f20-aff3-9cbf8fd6c090 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:30.075082 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bfb9a-555e-4cce-80a8-b625564d1282 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:30.089852 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1218b8c-95d6-4f20-aff3-9cbf8fd6c090 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:30.109159 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cd9e1-4cc2-44d2-b734-c7291f7bd7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:30.109823 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cd9e1-4cc2-44d2-b734-c7291f7bd7c1 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:30.110106 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cd9e1-4cc2-44d2-b734-c7291f7bd7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:30.110381 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cd9e1-4cc2-44d2-b734-c7291f7bd7c1 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:30.111158 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cd9e1-4cc2-44d2-b734-c7291f7bd7c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:30.111462 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cd9e1-4cc2-44d2-b734-c7291f7bd7c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:30.112821 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cd9e1-4cc2-44d2-b734-c7291f7bd7c1 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:30.123552 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae0388-1371-48c7-8c10-b171b6f33b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:30.124636 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae0388-1371-48c7-8c10-b171b6f33b68 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:30.125108 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae0388-1371-48c7-8c10-b171b6f33b68 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:30.125577 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae0388-1371-48c7-8c10-b171b6f33b68 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:30.126883 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae0388-1371-48c7-8c10-b171b6f33b68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:30.127427 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae0388-1371-48c7-8c10-b171b6f33b68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:30.129815 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 326/654] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:30.130512 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae0388-1371-48c7-8c10-b171b6f33b68 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:30.130703 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cd9e1-4cc2-44d2-b734-c7291f7bd7c1 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:30.143909 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 329/655] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:30.145290 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae0388-1371-48c7-8c10-b171b6f33b68 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:30.229377 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cd9e1-4cc2-44d2-b734-c7291f7bd7c1 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:30.244624 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae0388-1371-48c7-8c10-b171b6f33b68 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:30.263658 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878444f1-753f-48c7-b647-226946e99771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:30.264448 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878444f1-753f-48c7-b647-226946e99771 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:30.264728 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878444f1-753f-48c7-b647-226946e99771 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:30.265004 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878444f1-753f-48c7-b647-226946e99771 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:30.275735 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878444f1-753f-48c7-b647-226946e99771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:30.277193 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878444f1-753f-48c7-b647-226946e99771 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:30.277960 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b4f4c-3466-4c95-97e0-29b92d6dbda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:30.278738 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b4f4c-3466-4c95-97e0-29b92d6dbda6 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:30.279060 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b4f4c-3466-4c95-97e0-29b92d6dbda6 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:30.279329 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00b4f4c-3466-4c95-97e0-29b92d6dbda6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:30.287136 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b4f4c-3466-4c95-97e0-29b92d6dbda6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:30.288554 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00b4f4c-3466-4c95-97e0-29b92d6dbda6 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:30.295249 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-878444f1-753f-48c7-b647-226946e99771 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:30.296600 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 327/656] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:30.297208 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878444f1-753f-48c7-b647-226946e99771 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:30.306736 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-e00b4f4c-3466-4c95-97e0-29b92d6dbda6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 11 23:43:30.308240 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 330/657] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:43:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:30.309012 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b4f4c-3466-4c95-97e0-29b92d6dbda6 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:30.404468 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878444f1-753f-48c7-b647-226946e99771 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:30.407792 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00b4f4c-3466-4c95-97e0-29b92d6dbda6 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:30.439060 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e63473-b929-4ed8-b835-1770a118b4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:30.439848 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e63473-b929-4ed8-b835-1770a118b4a3 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:30.440079 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e63473-b929-4ed8-b835-1770a118b4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:30.440350 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e63473-b929-4ed8-b835-1770a118b4a3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:30.440968 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0ae7d-008b-439e-bb2c-9ec7cda80dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:30.442195 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0ae7d-008b-439e-bb2c-9ec7cda80dfe None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:30.442474 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0ae7d-008b-439e-bb2c-9ec7cda80dfe None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:30.442745 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc0ae7d-008b-439e-bb2c-9ec7cda80dfe None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:30.443493 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0ae7d-008b-439e-bb2c-9ec7cda80dfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:30.443795 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0ae7d-008b-439e-bb2c-9ec7cda80dfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:30.445151 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc0ae7d-008b-439e-bb2c-9ec7cda80dfe None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:30.448456 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e63473-b929-4ed8-b835-1770a118b4a3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:30.449895 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e63473-b929-4ed8-b835-1770a118b4a3 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:30.461736 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 331/658] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:30.462621 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0ae7d-008b-439e-bb2c-9ec7cda80dfe None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:30.464907 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-59e63473-b929-4ed8-b835-1770a118b4a3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Apr 11 23:43:30.466115 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 328/659] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:43:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:30.466883 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e63473-b929-4ed8-b835-1770a118b4a3 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:30.564498 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc0ae7d-008b-439e-bb2c-9ec7cda80dfe None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:30.566009 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e63473-b929-4ed8-b835-1770a118b4a3 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:30.601571 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1496186-326c-480d-8cbb-03399a3371af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:30.602363 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1496186-326c-480d-8cbb-03399a3371af None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:30.602645 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1496186-326c-480d-8cbb-03399a3371af None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:30.602879 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef597dcb-7385-423c-a4d5-e17a07c0e2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:30.603060 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1496186-326c-480d-8cbb-03399a3371af None admin] PATH_INFO: `/v3/projects/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:30.603541 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef597dcb-7385-423c-a4d5-e17a07c0e2e7 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:30.603816 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef597dcb-7385-423c-a4d5-e17a07c0e2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:30.604086 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef597dcb-7385-423c-a4d5-e17a07c0e2e7 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:30.604916 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef597dcb-7385-423c-a4d5-e17a07c0e2e7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:30.605218 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef597dcb-7385-423c-a4d5-e17a07c0e2e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:30.606638 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef597dcb-7385-423c-a4d5-e17a07c0e2e7 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:30.609911 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1496186-326c-480d-8cbb-03399a3371af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:30.611369 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1496186-326c-480d-8cbb-03399a3371af None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:30.624811 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-e1496186-326c-480d-8cbb-03399a3371af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:30.625092 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 332/660] 10.222.0.24 () {56 vars in 1137 bytes} [Mon Apr 11 23:43:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:30.625937 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef597dcb-7385-423c-a4d5-e17a07c0e2e7 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:30.630587 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 329/661] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:30.631467 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1496186-326c-480d-8cbb-03399a3371af None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:30.724745 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef597dcb-7385-423c-a4d5-e17a07c0e2e7 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:30.737581 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1496186-326c-480d-8cbb-03399a3371af None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:30.766880 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc2ba1-e0b7-48ee-b67d-1dc2a89d26ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:30.766880 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc2ba1-e0b7-48ee-b67d-1dc2a89d26ac None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:30.766880 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc2ba1-e0b7-48ee-b67d-1dc2a89d26ac None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:30.766880 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbc2ba1-e0b7-48ee-b67d-1dc2a89d26ac None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:30.767662 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc2ba1-e0b7-48ee-b67d-1dc2a89d26ac None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:30.767662 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc2ba1-e0b7-48ee-b67d-1dc2a89d26ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:30.767662 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbc2ba1-e0b7-48ee-b67d-1dc2a89d26ac None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:30.773040 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e9d1d-55f8-4969-a38e-333f93c8b995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:30.773724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e9d1d-55f8-4969-a38e-333f93c8b995 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:30.774011 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e9d1d-55f8-4969-a38e-333f93c8b995 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:30.775133 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e9d1d-55f8-4969-a38e-333f93c8b995 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:30.796560 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 333/662] 10.222.0.24 () {56 vars in 1139 bytes} [Mon Apr 11 23:43:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:30.797798 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc2ba1-e0b7-48ee-b67d-1dc2a89d26ac None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:30.846820 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e9d1d-55f8-4969-a38e-333f93c8b995 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:30.848254 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1e9d1d-55f8-4969-a38e-333f93c8b995 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:30.896673 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbc2ba1-e0b7-48ee-b67d-1dc2a89d26ac None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:30.929745 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128fd75-6649-4b46-a44c-e60745332cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:30.930645 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128fd75-6649-4b46-a44c-e60745332cc4 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:30.931089 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128fd75-6649-4b46-a44c-e60745332cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:30.931514 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128fd75-6649-4b46-a44c-e60745332cc4 None admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:30.932430 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128fd75-6649-4b46-a44c-e60745332cc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:30.932870 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128fd75-6649-4b46-a44c-e60745332cc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:30.934411 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128fd75-6649-4b46-a44c-e60745332cc4 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:30.946660 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 330/663] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:43:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:43:30.947015 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 334/664] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:30.947961 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128fd75-6649-4b46-a44c-e60745332cc4 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:30.956055 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e9d1d-55f8-4969-a38e-333f93c8b995 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:31.046205 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128fd75-6649-4b46-a44c-e60745332cc4 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:31.055225 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1e9d1d-55f8-4969-a38e-333f93c8b995 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:31.080415 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ceb28a-b524-4efe-812f-7d94dc82aacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:31.081269 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ceb28a-b524-4efe-812f-7d94dc82aacc None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:31.081956 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ceb28a-b524-4efe-812f-7d94dc82aacc None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:31.082372 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ceb28a-b524-4efe-812f-7d94dc82aacc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:31.090297 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56671a65-c193-4bc7-b7d6-6a9bc57ac48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:31.091137 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56671a65-c193-4bc7-b7d6-6a9bc57ac48f None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:31.091415 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56671a65-c193-4bc7-b7d6-6a9bc57ac48f None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:31.091682 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56671a65-c193-4bc7-b7d6-6a9bc57ac48f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:31.102145 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56671a65-c193-4bc7-b7d6-6a9bc57ac48f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:31.103620 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56671a65-c193-4bc7-b7d6-6a9bc57ac48f None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:31.121396 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-56671a65-c193-4bc7-b7d6-6a9bc57ac48f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:31.127184 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 331/665] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:31.128029 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56671a65-c193-4bc7-b7d6-6a9bc57ac48f None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:31.152249 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ceb28a-b524-4efe-812f-7d94dc82aacc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:31.153763 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ceb28a-b524-4efe-812f-7d94dc82aacc None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:31.230129 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56671a65-c193-4bc7-b7d6-6a9bc57ac48f None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:31.258706 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 335/666] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:43:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:43:31.258706 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ceb28a-b524-4efe-812f-7d94dc82aacc None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:31.267764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9905ff2d-a446-4c37-84a6-e69282b51c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:31.268421 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905ff2d-a446-4c37-84a6-e69282b51c4c None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:31.268700 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905ff2d-a446-4c37-84a6-e69282b51c4c None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:31.268972 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9905ff2d-a446-4c37-84a6-e69282b51c4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:31.269835 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905ff2d-a446-4c37-84a6-e69282b51c4c None admin] RBAC: Adding query filter params (role.id=f4692fa2043d468fae733095d5740686, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=a2ad9c7f930e426bb908237f72c04a2e) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:31.270144 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905ff2d-a446-4c37-84a6-e69282b51c4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:31.271651 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9905ff2d-a446-4c37-84a6-e69282b51c4c None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:31.283903 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 332/667] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:43:31 2022] GET /identity/v3/role_assignments?user.id=a2ad9c7f930e426bb908237f72c04a2e&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=f4692fa2043d468fae733095d5740686 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:31.283903 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cd1b8-7b38-479b-aebf-e1a64d096b9f None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:31.283903 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cd1b8-7b38-479b-aebf-e1a64d096b9f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:31.283903 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22cd1b8-7b38-479b-aebf-e1a64d096b9f None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:31.283903 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 333/668] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:31.283903 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cd1b8-7b38-479b-aebf-e1a64d096b9f None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:31.377210 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ceb28a-b524-4efe-812f-7d94dc82aacc None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:31.415476 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8d18a-f703-4f03-892b-4e4a2dec2e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:31.416249 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8d18a-f703-4f03-892b-4e4a2dec2e09 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:31.416411 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8d18a-f703-4f03-892b-4e4a2dec2e09 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:31.416672 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8d18a-f703-4f03-892b-4e4a2dec2e09 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:31.417398 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8d18a-f703-4f03-892b-4e4a2dec2e09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:31.417695 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8d18a-f703-4f03-892b-4e4a2dec2e09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:31.419208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8d18a-f703-4f03-892b-4e4a2dec2e09 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:31.429101 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22cd1b8-7b38-479b-aebf-e1a64d096b9f None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:31.432162 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 336/669] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:31.433540 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33fae2-3a3c-4bd0-9954-b75841f692d6 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:31.433826 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33fae2-3a3c-4bd0-9954-b75841f692d6 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:31.434097 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33fae2-3a3c-4bd0-9954-b75841f692d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:31.452341 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-8b33fae2-3a3c-4bd0-9954-b75841f692d6 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:31.453596 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-8b33fae2-3a3c-4bd0-9954-b75841f692d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:31.474067 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3af46-6bd9-49e2-acc5-aaee60392fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:31.474791 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3af46-6bd9-49e2-acc5-aaee60392fd7 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:31.475091 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3af46-6bd9-49e2-acc5-aaee60392fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:31.475360 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3af46-6bd9-49e2-acc5-aaee60392fd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:31.488808 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3af46-6bd9-49e2-acc5-aaee60392fd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:31.490602 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3af46-6bd9-49e2-acc5-aaee60392fd7 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:31.509519 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-33c3af46-6bd9-49e2-acc5-aaee60392fd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:31.511417 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 334/670] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:31.512440 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3af46-6bd9-49e2-acc5-aaee60392fd7 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:31.538055 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 337/671] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:31.538943 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33fae2-3a3c-4bd0-9954-b75841f692d6 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:31.644133 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3af46-6bd9-49e2-acc5-aaee60392fd7 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:31.658154 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33fae2-3a3c-4bd0-9954-b75841f692d6 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:31.690114 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90cfef-a896-4ae8-a01f-bbd540a4f218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:31.690941 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90cfef-a896-4ae8-a01f-bbd540a4f218 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:31.691244 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90cfef-a896-4ae8-a01f-bbd540a4f218 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:31.691579 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90cfef-a896-4ae8-a01f-bbd540a4f218 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:31.696637 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdf1f4-265c-47d1-b593-72c7fe87bf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:31.697714 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdf1f4-265c-47d1-b593-72c7fe87bf26 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:31.698472 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdf1f4-265c-47d1-b593-72c7fe87bf26 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:31.698653 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90cfef-a896-4ae8-a01f-bbd540a4f218 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:31.699123 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdf1f4-265c-47d1-b593-72c7fe87bf26 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:31.700061 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdf1f4-265c-47d1-b593-72c7fe87bf26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:31.700163 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90cfef-a896-4ae8-a01f-bbd540a4f218 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:31.700985 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdf1f4-265c-47d1-b593-72c7fe87bf26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:31.703104 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fdf1f4-265c-47d1-b593-72c7fe87bf26 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:31.714016 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-fd90cfef-a896-4ae8-a01f-bbd540a4f218 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:31.715578 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 335/672] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:31.716296 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 338/673] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:31.716423 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90cfef-a896-4ae8-a01f-bbd540a4f218 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:31.721270 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdf1f4-265c-47d1-b593-72c7fe87bf26 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:31.835806 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdf1f4-265c-47d1-b593-72c7fe87bf26 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:31.836436 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90cfef-a896-4ae8-a01f-bbd540a4f218 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:31.870106 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310fca3-042c-4b70-8138-4dcb0063b8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:31.870828 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310fca3-042c-4b70-8138-4dcb0063b8ce None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:31.871147 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310fca3-042c-4b70-8138-4dcb0063b8ce None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:31.871422 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310fca3-042c-4b70-8138-4dcb0063b8ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:31.878127 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310fca3-042c-4b70-8138-4dcb0063b8ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:31.879587 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9310fca3-042c-4b70-8138-4dcb0063b8ce None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:31.882555 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1087fd-9eff-469b-a247-2235f8d3965c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:31.883641 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1087fd-9eff-469b-a247-2235f8d3965c None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:31.884147 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1087fd-9eff-469b-a247-2235f8d3965c None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:31.884636 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1087fd-9eff-469b-a247-2235f8d3965c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:31.893314 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-9310fca3-042c-4b70-8138-4dcb0063b8ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:31.895483 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 339/674] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:31.896149 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310fca3-042c-4b70-8138-4dcb0063b8ce None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:31.896827 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1087fd-9eff-469b-a247-2235f8d3965c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:31.905686 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-fa1087fd-9eff-469b-a247-2235f8d3965c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:43:31.907834 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 336/675] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:43:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:31.909186 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1087fd-9eff-469b-a247-2235f8d3965c None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:32.000811 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9310fca3-042c-4b70-8138-4dcb0063b8ce None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:32.024214 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1087fd-9eff-469b-a247-2235f8d3965c None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:32.034058 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd94d90-2a0d-4bb1-b31d-c4b056d104be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:32.034718 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd94d90-2a0d-4bb1-b31d-c4b056d104be None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:32.035071 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd94d90-2a0d-4bb1-b31d-c4b056d104be None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:32.035852 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd94d90-2a0d-4bb1-b31d-c4b056d104be None admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:32.036760 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd94d90-2a0d-4bb1-b31d-c4b056d104be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:32.037071 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd94d90-2a0d-4bb1-b31d-c4b056d104be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:32.038509 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd94d90-2a0d-4bb1-b31d-c4b056d104be None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:32.054930 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 340/676] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:32.055583 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd94d90-2a0d-4bb1-b31d-c4b056d104be None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:32.057204 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d75463-c0eb-4ef8-a1be-469a76074891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:32.057860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d75463-c0eb-4ef8-a1be-469a76074891 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:32.058143 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d75463-c0eb-4ef8-a1be-469a76074891 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:32.058414 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d75463-c0eb-4ef8-a1be-469a76074891 None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:32.059226 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d75463-c0eb-4ef8-a1be-469a76074891 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:32.059530 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d75463-c0eb-4ef8-a1be-469a76074891 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:32.060951 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d75463-c0eb-4ef8-a1be-469a76074891 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:32.072506 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 337/677] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:32.073734 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b5262-5019-40f1-9477-b2350793c288 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:32.074016 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b5262-5019-40f1-9477-b2350793c288 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:32.074288 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b5262-5019-40f1-9477-b2350793c288 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:32.078876 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 338/678] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:32.078876 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b5262-5019-40f1-9477-b2350793c288 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:32.170607 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd94d90-2a0d-4bb1-b31d-c4b056d104be None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:32.177324 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b5262-5019-40f1-9477-b2350793c288 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:32.203264 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b622a4-b30d-4626-b4d1-3e89e4270bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:32.203917 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b622a4-b30d-4626-b4d1-3e89e4270bf0 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:32.204193 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b622a4-b30d-4626-b4d1-3e89e4270bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:32.204461 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b622a4-b30d-4626-b4d1-3e89e4270bf0 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:32.205203 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b622a4-b30d-4626-b4d1-3e89e4270bf0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:32.205506 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b622a4-b30d-4626-b4d1-3e89e4270bf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:32.207461 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b622a4-b30d-4626-b4d1-3e89e4270bf0 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:32.214776 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e60bdd-4555-44c4-924e-54487f72b6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:32.215453 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e60bdd-4555-44c4-924e-54487f72b6b1 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:32.220098 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e60bdd-4555-44c4-924e-54487f72b6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:32.220216 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 341/679] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:43:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:32.220293 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e60bdd-4555-44c4-924e-54487f72b6b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:32.220383 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b622a4-b30d-4626-b4d1-3e89e4270bf0 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:32.220455 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e60bdd-4555-44c4-924e-54487f72b6b1 None admin] RBAC: Adding query filter params (role.id=f4692fa2043d468fae733095d5740686, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=3a09a31262e54eec84580c7259902df1) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:32.220455 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e60bdd-4555-44c4-924e-54487f72b6b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:32.220455 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e60bdd-4555-44c4-924e-54487f72b6b1 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:32.225301 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 339/680] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:43:32 2022] GET /identity/v3/role_assignments?user.id=3a09a31262e54eec84580c7259902df1&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=f4692fa2043d468fae733095d5740686 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:32.235018 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9d992-a4e3-457d-b8be-874d544bd442 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:32.235018 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9d992-a4e3-457d-b8be-874d544bd442 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:32.235018 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d9d992-a4e3-457d-b8be-874d544bd442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:32.256521 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-21d9d992-a4e3-457d-b8be-874d544bd442 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:32.258061 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-21d9d992-a4e3-457d-b8be-874d544bd442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:32.342680 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b622a4-b30d-4626-b4d1-3e89e4270bf0 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:32.351013 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 340/681] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:32.351970 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9d992-a4e3-457d-b8be-874d544bd442 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:32.393844 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefe932-dd9d-4ad6-a758-b6a6fedc4402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:32.395091 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefe932-dd9d-4ad6-a758-b6a6fedc4402 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:32.395372 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefe932-dd9d-4ad6-a758-b6a6fedc4402 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:32.395675 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefe932-dd9d-4ad6-a758-b6a6fedc4402 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:32.396529 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefe932-dd9d-4ad6-a758-b6a6fedc4402 None admin] RBAC: Adding query filter params (role.id=f4692fa2043d468fae733095d5740686, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=c6936272118b49a9baa19f3bd5066f9d) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:32.396833 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefe932-dd9d-4ad6-a758-b6a6fedc4402 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:32.398311 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefe932-dd9d-4ad6-a758-b6a6fedc4402 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:32.404526 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 342/682] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:43:32 2022] GET /identity/v3/role_assignments?user.id=c6936272118b49a9baa19f3bd5066f9d&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=f4692fa2043d468fae733095d5740686 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:32.406558 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefe932-dd9d-4ad6-a758-b6a6fedc4402 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:32.483732 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d9d992-a4e3-457d-b8be-874d544bd442 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:32.520931 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa6c90-5c46-454a-a349-f285a6762109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:32.521741 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa6c90-5c46-454a-a349-f285a6762109 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:32.522026 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa6c90-5c46-454a-a349-f285a6762109 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:32.522302 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa6c90-5c46-454a-a349-f285a6762109 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:32.533704 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa6c90-5c46-454a-a349-f285a6762109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:32.535768 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa6c90-5c46-454a-a349-f285a6762109 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:32.553174 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefe932-dd9d-4ad6-a758-b6a6fedc4402 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:32.555734 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-97aa6c90-5c46-454a-a349-f285a6762109 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:32.557304 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 341/683] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:32.563310 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa6c90-5c46-454a-a349-f285a6762109 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:32.593267 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe65ba-3010-4ab4-8a0e-e0948d2ac94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:32.594547 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe65ba-3010-4ab4-8a0e-e0948d2ac94e None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:32.595086 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe65ba-3010-4ab4-8a0e-e0948d2ac94e None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:32.595627 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe65ba-3010-4ab4-8a0e-e0948d2ac94e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:32.608828 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe65ba-3010-4ab4-8a0e-e0948d2ac94e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:32.624450 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-79fe65ba-3010-4ab4-8a0e-e0948d2ac94e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 23:43:32.626408 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 343/684] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:43:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:32.636902 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe65ba-3010-4ab4-8a0e-e0948d2ac94e None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:32.690052 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa6c90-5c46-454a-a349-f285a6762109 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:32.730301 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272b5cc-2b79-463d-a805-c8560f353250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:32.731064 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272b5cc-2b79-463d-a805-c8560f353250 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:32.731346 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272b5cc-2b79-463d-a805-c8560f353250 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:32.731621 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272b5cc-2b79-463d-a805-c8560f353250 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:32.732351 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272b5cc-2b79-463d-a805-c8560f353250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:32.732657 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272b5cc-2b79-463d-a805-c8560f353250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:32.735156 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272b5cc-2b79-463d-a805-c8560f353250 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:32.745840 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe65ba-3010-4ab4-8a0e-e0948d2ac94e None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:32.747215 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 342/685] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:32.753137 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272b5cc-2b79-463d-a805-c8560f353250 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:32.791639 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4db4e-77b9-42b5-be9e-caa3c48d0eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:32.792357 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4db4e-77b9-42b5-be9e-caa3c48d0eb7 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:32.792640 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4db4e-77b9-42b5-be9e-caa3c48d0eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:32.792913 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4db4e-77b9-42b5-be9e-caa3c48d0eb7 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:32.793667 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4db4e-77b9-42b5-be9e-caa3c48d0eb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:32.793970 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4db4e-77b9-42b5-be9e-caa3c48d0eb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:32.795435 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4db4e-77b9-42b5-be9e-caa3c48d0eb7 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:32.804134 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 344/686] 10.222.0.24 () {56 vars in 1103 bytes} [Mon Apr 11 23:43:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:32.809771 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4db4e-77b9-42b5-be9e-caa3c48d0eb7 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:32.857456 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272b5cc-2b79-463d-a805-c8560f353250 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:32.890518 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c81522-a02f-49a3-9262-2380a4a4b0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:32.891340 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c81522-a02f-49a3-9262-2380a4a4b0e6 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:32.891621 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c81522-a02f-49a3-9262-2380a4a4b0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:32.891890 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c81522-a02f-49a3-9262-2380a4a4b0e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:32.900805 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c81522-a02f-49a3-9262-2380a4a4b0e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:32.902249 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c81522-a02f-49a3-9262-2380a4a4b0e6 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:32.911002 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4db4e-77b9-42b5-be9e-caa3c48d0eb7 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:32.916294 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-d6c81522-a02f-49a3-9262-2380a4a4b0e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 23:43:32.922899 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 343/687] 10.222.0.24 () {56 vars in 1093 bytes} [Mon Apr 11 23:43:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:32.923756 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c81522-a02f-49a3-9262-2380a4a4b0e6 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:32.946168 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efe585-c7f1-4524-87f6-b93415b6b2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:32.947044 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efe585-c7f1-4524-87f6-b93415b6b2a9 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:32.947347 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efe585-c7f1-4524-87f6-b93415b6b2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:32.947641 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efe585-c7f1-4524-87f6-b93415b6b2a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:32.959094 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efe585-c7f1-4524-87f6-b93415b6b2a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:32.960539 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efe585-c7f1-4524-87f6-b93415b6b2a9 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:32.977341 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-41efe585-c7f1-4524-87f6-b93415b6b2a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:32.983031 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 345/688] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:32.984509 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efe585-c7f1-4524-87f6-b93415b6b2a9 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:33.024554 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c81522-a02f-49a3-9262-2380a4a4b0e6 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:33.059285 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed805901-db3f-46cb-b9c0-d532b75a8ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:33.059966 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed805901-db3f-46cb-b9c0-d532b75a8ecc None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:33.060248 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed805901-db3f-46cb-b9c0-d532b75a8ecc None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:33.060523 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed805901-db3f-46cb-b9c0-d532b75a8ecc None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:33.061371 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed805901-db3f-46cb-b9c0-d532b75a8ecc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:33.061673 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed805901-db3f-46cb-b9c0-d532b75a8ecc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:33.063121 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed805901-db3f-46cb-b9c0-d532b75a8ecc None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:33.080828 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 344/689] 10.222.0.24 () {56 vars in 1133 bytes} [Mon Apr 11 23:43:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:33.086177 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed805901-db3f-46cb-b9c0-d532b75a8ecc None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:33.087115 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efe585-c7f1-4524-87f6-b93415b6b2a9 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:33.121846 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dff064-f62a-4de1-a3e7-4c0c1eca8e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:33.122508 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dff064-f62a-4de1-a3e7-4c0c1eca8e5f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:33.122789 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dff064-f62a-4de1-a3e7-4c0c1eca8e5f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:33.123084 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dff064-f62a-4de1-a3e7-4c0c1eca8e5f None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:33.123807 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dff064-f62a-4de1-a3e7-4c0c1eca8e5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:33.124112 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dff064-f62a-4de1-a3e7-4c0c1eca8e5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:33.125583 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dff064-f62a-4de1-a3e7-4c0c1eca8e5f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:33.138142 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 346/690] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:33.143472 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dff064-f62a-4de1-a3e7-4c0c1eca8e5f None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:33.190379 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed805901-db3f-46cb-b9c0-d532b75a8ecc None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:33.225620 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a4aac-e998-4a32-ae72-b8e64cd9237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:33.226274 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a4aac-e998-4a32-ae72-b8e64cd9237c None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:33.226555 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a4aac-e998-4a32-ae72-b8e64cd9237c None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:33.226848 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a4aac-e998-4a32-ae72-b8e64cd9237c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:33.263811 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dff064-f62a-4de1-a3e7-4c0c1eca8e5f None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:33.298456 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49d89b-30b9-4754-ad19-36b1f619c685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:33.299194 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49d89b-30b9-4754-ad19-36b1f619c685 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:33.299474 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49d89b-30b9-4754-ad19-36b1f619c685 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:33.299747 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49d89b-30b9-4754-ad19-36b1f619c685 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:33.302170 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a4aac-e998-4a32-ae72-b8e64cd9237c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:33.309862 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49d89b-30b9-4754-ad19-36b1f619c685 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:33.310169 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a4aac-e998-4a32-ae72-b8e64cd9237c None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:33.310326 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49d89b-30b9-4754-ad19-36b1f619c685 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:33.331128 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-9c49d89b-30b9-4754-ad19-36b1f619c685 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 23:43:33.332880 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 347/691] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:43:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:33.341476 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49d89b-30b9-4754-ad19-36b1f619c685 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:33.497736 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 345/692] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:43:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Apr 11 23:43:33.502679 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a4aac-e998-4a32-ae72-b8e64cd9237c None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:33.521672 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49d89b-30b9-4754-ad19-36b1f619c685 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:33.595676 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b175bdf-2e5b-4abe-a665-d7922a2eaa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:33.596369 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b175bdf-2e5b-4abe-a665-d7922a2eaa4b None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:33.596777 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b175bdf-2e5b-4abe-a665-d7922a2eaa4b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:33.597127 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b175bdf-2e5b-4abe-a665-d7922a2eaa4b None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:33.598628 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b175bdf-2e5b-4abe-a665-d7922a2eaa4b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:33.599020 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b175bdf-2e5b-4abe-a665-d7922a2eaa4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:33.600542 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b175bdf-2e5b-4abe-a665-d7922a2eaa4b None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:33.631063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a4aac-e998-4a32-ae72-b8e64cd9237c None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:33.634750 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 348/693] 10.222.0.24 () {56 vars in 1135 bytes} [Mon Apr 11 23:43:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:33.644016 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b175bdf-2e5b-4abe-a665-d7922a2eaa4b None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:33.692062 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64b161-47af-43d4-9754-583d38316c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:33.692867 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64b161-47af-43d4-9754-583d38316c5c None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:33.693152 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64b161-47af-43d4-9754-583d38316c5c None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:33.693416 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64b161-47af-43d4-9754-583d38316c5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:33.708524 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64b161-47af-43d4-9754-583d38316c5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:33.709981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f64b161-47af-43d4-9754-583d38316c5c None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:33.730040 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-5f64b161-47af-43d4-9754-583d38316c5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:33.731630 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 346/694] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:33.737205 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64b161-47af-43d4-9754-583d38316c5c None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:33.865616 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b175bdf-2e5b-4abe-a665-d7922a2eaa4b None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:33.870621 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64b161-47af-43d4-9754-583d38316c5c None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:33.906750 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d518bc-533a-4e30-a78b-c519aff084d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:33.907440 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d518bc-533a-4e30-a78b-c519aff084d7 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:33.907724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d518bc-533a-4e30-a78b-c519aff084d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:33.908158 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d518bc-533a-4e30-a78b-c519aff084d7 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:33.909184 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d518bc-533a-4e30-a78b-c519aff084d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:33.909497 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d518bc-533a-4e30-a78b-c519aff084d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:33.911418 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d518bc-533a-4e30-a78b-c519aff084d7 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:33.923629 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 347/695] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:33.929204 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d518bc-533a-4e30-a78b-c519aff084d7 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:33.963572 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f396f-a340-49b0-bd4c-acbb7cffa2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:33.964489 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f396f-a340-49b0-bd4c-acbb7cffa2b5 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:33.964765 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f396f-a340-49b0-bd4c-acbb7cffa2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:33.965029 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f396f-a340-49b0-bd4c-acbb7cffa2b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:34.033667 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d518bc-533a-4e30-a78b-c519aff084d7 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:34.069038 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b133247a-7ae9-4851-a424-b132bcd931e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:34.069987 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133247a-7ae9-4851-a424-b132bcd931e3 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:34.070275 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133247a-7ae9-4851-a424-b132bcd931e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:34.070548 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b133247a-7ae9-4851-a424-b132bcd931e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:34.073048 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f396f-a340-49b0-bd4c-acbb7cffa2b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:34.074493 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f396f-a340-49b0-bd4c-acbb7cffa2b5 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:34.079320 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133247a-7ae9-4851-a424-b132bcd931e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:34.080752 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b133247a-7ae9-4851-a424-b132bcd931e3 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:34.100195 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-b133247a-7ae9-4851-a424-b132bcd931e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:34.102116 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 348/696] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:34.103544 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b81ca-0157-49c9-ae49-c161723cbe2c None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:34.103825 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b81ca-0157-49c9-ae49-c161723cbe2c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:34.104102 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51b81ca-0157-49c9-ae49-c161723cbe2c None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:34.106241 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 349/697] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:34.106969 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b81ca-0157-49c9-ae49-c161723cbe2c None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:34.184152 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 349/698] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:43:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Apr 11 23:43:34.185412 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddd024-9311-4e48-94ae-947183f96fed None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:34.185717 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddd024-9311-4e48-94ae-947183f96fed None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:34.186064 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddd024-9311-4e48-94ae-947183f96fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:34.203111 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-beddd024-9311-4e48-94ae-947183f96fed None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:34.204319 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-beddd024-9311-4e48-94ae-947183f96fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:34.233524 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51b81ca-0157-49c9-ae49-c161723cbe2c None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:34.268299 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6aa7e-a055-4693-8bd2-53e8df4939b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:34.269894 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6aa7e-a055-4693-8bd2-53e8df4939b5 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:34.270401 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6aa7e-a055-4693-8bd2-53e8df4939b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:34.270922 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6aa7e-a055-4693-8bd2-53e8df4939b5 None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:34.271920 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6aa7e-a055-4693-8bd2-53e8df4939b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:34.272444 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6aa7e-a055-4693-8bd2-53e8df4939b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:34.274088 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a6aa7e-a055-4693-8bd2-53e8df4939b5 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:34.276660 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 350/699] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:34.277516 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddd024-9311-4e48-94ae-947183f96fed None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:34.287876 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 350/700] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:34.293703 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6aa7e-a055-4693-8bd2-53e8df4939b5 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:34.398621 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a6aa7e-a055-4693-8bd2-53e8df4939b5 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:34.404533 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddd024-9311-4e48-94ae-947183f96fed None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:34.435316 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e6c45-dc9a-416d-83c5-3eb06463dfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:34.436398 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e6c45-dc9a-416d-83c5-3eb06463dfbf None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:34.436832 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e6c45-dc9a-416d-83c5-3eb06463dfbf None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:34.437249 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0e6c45-dc9a-416d-83c5-3eb06463dfbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:34.438224 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e6c45-dc9a-416d-83c5-3eb06463dfbf None admin] RBAC: Adding query filter params (role.id=c8affbefb4c5462a921650b24b13c80f, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=a9519f49f897415a894c1121278dda9c) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:34.438679 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e6c45-dc9a-416d-83c5-3eb06463dfbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:34.440373 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0e6c45-dc9a-416d-83c5-3eb06463dfbf None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:34.446581 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bee80-dd73-413b-8037-44ddb14a68c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:34.447196 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 351/701] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:43:34 2022] GET /identity/v3/role_assignments?user.id=a9519f49f897415a894c1121278dda9c&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=c8affbefb4c5462a921650b24b13c80f => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:34.447404 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bee80-dd73-413b-8037-44ddb14a68c5 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:34.452055 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bee80-dd73-413b-8037-44ddb14a68c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:34.452055 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bee80-dd73-413b-8037-44ddb14a68c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:34.453334 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e6c45-dc9a-416d-83c5-3eb06463dfbf None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:34.462760 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bee80-dd73-413b-8037-44ddb14a68c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:34.462760 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bee80-dd73-413b-8037-44ddb14a68c5 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:34.481940 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-d91bee80-dd73-413b-8037-44ddb14a68c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:34.483709 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 351/702] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:34.490852 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bee80-dd73-413b-8037-44ddb14a68c5 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:34.635659 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bee80-dd73-413b-8037-44ddb14a68c5 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:34.671580 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0301b-1a2c-440e-808b-b365595a896a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:34.672241 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0301b-1a2c-440e-808b-b365595a896a None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:34.672520 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0301b-1a2c-440e-808b-b365595a896a None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:34.672792 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0301b-1a2c-440e-808b-b365595a896a None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:34.673530 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0301b-1a2c-440e-808b-b365595a896a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:34.673831 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0301b-1a2c-440e-808b-b365595a896a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:34.675178 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0e6c45-dc9a-416d-83c5-3eb06463dfbf None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:34.675305 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0301b-1a2c-440e-808b-b365595a896a None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:34.687399 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 352/703] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:34.693208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0301b-1a2c-440e-808b-b365595a896a None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:34.729678 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa766bc-43c2-4c48-bcf7-fe7c33fbfa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:34.730829 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa766bc-43c2-4c48-bcf7-fe7c33fbfa3a None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:34.731362 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa766bc-43c2-4c48-bcf7-fe7c33fbfa3a None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:34.731898 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa766bc-43c2-4c48-bcf7-fe7c33fbfa3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:34.746229 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa766bc-43c2-4c48-bcf7-fe7c33fbfa3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:34.748084 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa766bc-43c2-4c48-bcf7-fe7c33fbfa3a None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:34.768380 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-caa766bc-43c2-4c48-bcf7-fe7c33fbfa3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:34.771563 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 352/704] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:34.779793 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa766bc-43c2-4c48-bcf7-fe7c33fbfa3a None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:34.873621 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0301b-1a2c-440e-808b-b365595a896a None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:34.913699 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa766bc-43c2-4c48-bcf7-fe7c33fbfa3a None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:34.947641 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a64e5-699c-436c-b1b0-e940b15468df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:34.948471 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a64e5-699c-436c-b1b0-e940b15468df None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:34.948671 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a64e5-699c-436c-b1b0-e940b15468df None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:34.948948 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a64e5-699c-436c-b1b0-e940b15468df None admin] PATH_INFO: `/v3/projects/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:34.955103 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219d06e-9ed8-411f-a8b2-c355e2fc25d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:34.956334 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219d06e-9ed8-411f-a8b2-c355e2fc25d0 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:34.956849 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219d06e-9ed8-411f-a8b2-c355e2fc25d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:34.957336 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219d06e-9ed8-411f-a8b2-c355e2fc25d0 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:34.958259 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2219d06e-9ed8-411f-a8b2-c355e2fc25d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:34.958764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2219d06e-9ed8-411f-a8b2-c355e2fc25d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:34.960517 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2219d06e-9ed8-411f-a8b2-c355e2fc25d0 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:34.964404 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a64e5-699c-436c-b1b0-e940b15468df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:34.965846 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a64e5-699c-436c-b1b0-e940b15468df None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:34.974498 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 353/705] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:34.979621 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219d06e-9ed8-411f-a8b2-c355e2fc25d0 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:34.991083 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-890a64e5-699c-436c-b1b0-e940b15468df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:34.992693 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 353/706] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:35.000159 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a64e5-699c-436c-b1b0-e940b15468df None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:35.098337 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219d06e-9ed8-411f-a8b2-c355e2fc25d0 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:35.136014 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a64e5-699c-436c-b1b0-e940b15468df None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:35.142521 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361161b6-05a0-44ab-9456-c8b650f14f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:35.143982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361161b6-05a0-44ab-9456-c8b650f14f52 None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:35.144562 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361161b6-05a0-44ab-9456-c8b650f14f52 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:35.145042 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361161b6-05a0-44ab-9456-c8b650f14f52 None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:35.146321 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361161b6-05a0-44ab-9456-c8b650f14f52 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:35.148608 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361161b6-05a0-44ab-9456-c8b650f14f52 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:35.169445 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd996844-53dc-4184-ad8a-a1d087ace8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:35.170098 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd996844-53dc-4184-ad8a-a1d087ace8b2 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:35.170375 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd996844-53dc-4184-ad8a-a1d087ace8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:35.170652 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd996844-53dc-4184-ad8a-a1d087ace8b2 None admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:35.171476 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd996844-53dc-4184-ad8a-a1d087ace8b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:35.171785 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd996844-53dc-4184-ad8a-a1d087ace8b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:35.173193 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd996844-53dc-4184-ad8a-a1d087ace8b2 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:35.184933 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 354/707] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:35.189967 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f972c9-102f-4a54-b7af-0e7ab964e92a None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:35.189967 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f972c9-102f-4a54-b7af-0e7ab964e92a None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:35.189967 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f972c9-102f-4a54-b7af-0e7ab964e92a None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:35.190912 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 355/708] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:35.192467 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f972c9-102f-4a54-b7af-0e7ab964e92a None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:35.242215 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 354/709] 10.222.0.24 () {60 vars in 1132 bytes} [Mon Apr 11 23:43:34 2022] POST /identity/v3/users => generated 254 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 23:43:35.244479 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912a326-c04b-4493-ae05-f430cc6db17e None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:35.244976 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912a326-c04b-4493-ae05-f430cc6db17e None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:35.245454 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912a326-c04b-4493-ae05-f430cc6db17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:35.284070 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-1912a326-c04b-4493-ae05-f430cc6db17e None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:35.286218 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1912a326-c04b-4493-ae05-f430cc6db17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:35.318732 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f972c9-102f-4a54-b7af-0e7ab964e92a None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:35.358895 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5162ad-0d57-4695-9dd8-94d044bd28e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:35.359566 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5162ad-0d57-4695-9dd8-94d044bd28e2 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:35.359844 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5162ad-0d57-4695-9dd8-94d044bd28e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:35.360117 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5162ad-0d57-4695-9dd8-94d044bd28e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:35.361974 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5162ad-0d57-4695-9dd8-94d044bd28e2 None admin] RBAC: Adding query filter params (role.id=f4692fa2043d468fae733095d5740686, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=189d616b38304d91bf1c7aded81205e3) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:35.362288 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5162ad-0d57-4695-9dd8-94d044bd28e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:35.364415 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5162ad-0d57-4695-9dd8-94d044bd28e2 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:35.371733 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 356/710] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:43:35 2022] GET /identity/v3/role_assignments?user.id=189d616b38304d91bf1c7aded81205e3&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=f4692fa2043d468fae733095d5740686 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:35.396004 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838aba7a-c0f9-43ef-bf6f-259b0f1e7290 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:35.398026 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838aba7a-c0f9-43ef-bf6f-259b0f1e7290 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:35.398026 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838aba7a-c0f9-43ef-bf6f-259b0f1e7290 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:35.398750 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 357/711] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:43:35.404675 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41603a77-b115-4b80-9647-1550adcadf0b None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:35.404980 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41603a77-b115-4b80-9647-1550adcadf0b None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:35.405227 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41603a77-b115-4b80-9647-1550adcadf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:35.443805 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-41603a77-b115-4b80-9647-1550adcadf0b None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:35.445498 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 355/712] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:35.447168 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-41603a77-b115-4b80-9647-1550adcadf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:35.474989 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912a326-c04b-4493-ae05-f430cc6db17e None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:35.560509 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 358/713] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:35.588937 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41603a77-b115-4b80-9647-1550adcadf0b None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:35.631231 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912a326-c04b-4493-ae05-f430cc6db17e None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:35.672937 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014f84a-361d-4d5f-aff1-3dcba0467088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:35.673752 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014f84a-361d-4d5f-aff1-3dcba0467088 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:35.674026 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014f84a-361d-4d5f-aff1-3dcba0467088 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:35.674295 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014f84a-361d-4d5f-aff1-3dcba0467088 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:35.675008 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014f84a-361d-4d5f-aff1-3dcba0467088 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:35.676409 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6014f84a-361d-4d5f-aff1-3dcba0467088 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:35.690046 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-6014f84a-361d-4d5f-aff1-3dcba0467088 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 11 23:43:35.691686 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 356/714] 10.222.0.24 () {56 vars in 1129 bytes} [Mon Apr 11 23:43:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:35.697868 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014f84a-361d-4d5f-aff1-3dcba0467088 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:35.709865 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41603a77-b115-4b80-9647-1550adcadf0b None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:35.752759 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab806206-5c38-457e-9f84-3c462c99f0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:35.753949 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab806206-5c38-457e-9f84-3c462c99f0fa None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:35.753949 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab806206-5c38-457e-9f84-3c462c99f0fa None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:35.754260 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab806206-5c38-457e-9f84-3c462c99f0fa None admin] PATH_INFO: `/v3/services/network` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:35.754857 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab806206-5c38-457e-9f84-3c462c99f0fa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:35.756424 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab806206-5c38-457e-9f84-3c462c99f0fa None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:35.773526 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-ab806206-5c38-457e-9f84-3c462c99f0fa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 11 23:43:35.775931 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 359/715] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:35 2022] GET /identity/v3/services/network => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:35.781503 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab806206-5c38-457e-9f84-3c462c99f0fa None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:35.829700 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014f84a-361d-4d5f-aff1-3dcba0467088 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:35.872982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13e756-3024-4391-96a0-ffdf6d16dcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:35.873661 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13e756-3024-4391-96a0-ffdf6d16dcb4 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:35.873941 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13e756-3024-4391-96a0-ffdf6d16dcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:35.874205 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13e756-3024-4391-96a0-ffdf6d16dcb4 None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:35.874943 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13e756-3024-4391-96a0-ffdf6d16dcb4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:35.875250 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13e756-3024-4391-96a0-ffdf6d16dcb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:35.877109 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13e756-3024-4391-96a0-ffdf6d16dcb4 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:35.883719 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 357/716] 10.222.0.24 () {56 vars in 1124 bytes} [Mon Apr 11 23:43:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:35.888937 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13e756-3024-4391-96a0-ffdf6d16dcb4 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:35.893182 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab806206-5c38-457e-9f84-3c462c99f0fa None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:35.933205 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ef4e8-8ed8-4744-a673-b09959a0677c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:35.933872 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ef4e8-8ed8-4744-a673-b09959a0677c None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:35.934153 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ef4e8-8ed8-4744-a673-b09959a0677c None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:35.934422 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ef4e8-8ed8-4744-a673-b09959a0677c None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:35.935166 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ef4e8-8ed8-4744-a673-b09959a0677c None admin] RBAC: Adding query filter params (name=network) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:35.935467 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ef4e8-8ed8-4744-a673-b09959a0677c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:35.936834 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ef4e8-8ed8-4744-a673-b09959a0677c None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:35.942861 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 360/717] 10.222.0.24 () {56 vars in 1112 bytes} [Mon Apr 11 23:43:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:35.947856 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ef4e8-8ed8-4744-a673-b09959a0677c None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:36.017571 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13e756-3024-4391-96a0-ffdf6d16dcb4 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:36.054132 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd73f73-16ff-4f8e-bc0e-c108d7fcff4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:36.054798 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd73f73-16ff-4f8e-bc0e-c108d7fcff4a None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:36.055157 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd73f73-16ff-4f8e-bc0e-c108d7fcff4a None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:36.055439 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd73f73-16ff-4f8e-bc0e-c108d7fcff4a None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:36.056145 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd73f73-16ff-4f8e-bc0e-c108d7fcff4a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:36.056628 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd73f73-16ff-4f8e-bc0e-c108d7fcff4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:36.057781 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd73f73-16ff-4f8e-bc0e-c108d7fcff4a None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:36.063265 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ef4e8-8ed8-4744-a673-b09959a0677c None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:36.063545 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 358/718] 10.222.0.24 () {56 vars in 1124 bytes} [Mon Apr 11 23:43:35 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:36.126612 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0b61b2-5a18-499b-ba00-68671a64de8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:36.127549 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b61b2-5a18-499b-ba00-68671a64de8a None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:36.128082 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b61b2-5a18-499b-ba00-68671a64de8a None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:36.128501 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0b61b2-5a18-499b-ba00-68671a64de8a None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:36.129393 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b61b2-5a18-499b-ba00-68671a64de8a None admin] RBAC: Adding query filter params (type=network) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:36.129841 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b61b2-5a18-499b-ba00-68671a64de8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:36.131380 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0b61b2-5a18-499b-ba00-68671a64de8a None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:36.144324 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 361/719] 10.222.0.24 () {56 vars in 1112 bytes} [Mon Apr 11 23:43:35 2022] GET /identity/v3/services?type=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:37.134885 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bd1ea-b6e8-4c3a-b8ec-a8818085224a None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:37.135902 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bd1ea-b6e8-4c3a-b8ec-a8818085224a None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:37.136413 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44bd1ea-b6e8-4c3a-b8ec-a8818085224a None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:37.138630 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 359/720] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:37.144154 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5fe0b-38f3-44f3-b861-5e280a41898e None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:37.145479 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5fe0b-38f3-44f3-b861-5e280a41898e None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:37.145975 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5fe0b-38f3-44f3-b861-5e280a41898e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:37.163798 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-8da5fe0b-38f3-44f3-b861-5e280a41898e None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:37.165286 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-8da5fe0b-38f3-44f3-b861-5e280a41898e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:37.233967 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 362/721] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:37.256920 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bd1ea-b6e8-4c3a-b8ec-a8818085224a None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:37.362042 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44bd1ea-b6e8-4c3a-b8ec-a8818085224a None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:37.397058 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49780109-d8d3-4076-8281-fb55606e364e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:37.398191 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49780109-d8d3-4076-8281-fb55606e364e None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:37.398694 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49780109-d8d3-4076-8281-fb55606e364e None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:37.399199 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49780109-d8d3-4076-8281-fb55606e364e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:37.410118 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49780109-d8d3-4076-8281-fb55606e364e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:37.417355 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-49780109-d8d3-4076-8281-fb55606e364e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:43:37.419088 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 360/722] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:43:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:37.425016 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5fe0b-38f3-44f3-b861-5e280a41898e None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:37.540821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5fe0b-38f3-44f3-b861-5e280a41898e None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:37.580944 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b779e1-2e3d-4ae1-9d44-096534dbc0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:37.581607 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b779e1-2e3d-4ae1-9d44-096534dbc0ed None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:37.581916 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b779e1-2e3d-4ae1-9d44-096534dbc0ed None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:37.582186 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b779e1-2e3d-4ae1-9d44-096534dbc0ed None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:37.582955 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b779e1-2e3d-4ae1-9d44-096534dbc0ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:37.583258 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b779e1-2e3d-4ae1-9d44-096534dbc0ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:37.584618 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b779e1-2e3d-4ae1-9d44-096534dbc0ed None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:37.593404 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 363/723] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:43:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:37.599575 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49780109-d8d3-4076-8281-fb55606e364e None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:37.709423 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49780109-d8d3-4076-8281-fb55606e364e None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:37.744681 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72322510-40a7-42ae-a092-6be3b90dc5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:37.745705 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72322510-40a7-42ae-a092-6be3b90dc5c0 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:37.746239 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72322510-40a7-42ae-a092-6be3b90dc5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:37.746673 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72322510-40a7-42ae-a092-6be3b90dc5c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:37.757674 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72322510-40a7-42ae-a092-6be3b90dc5c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:37.759370 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72322510-40a7-42ae-a092-6be3b90dc5c0 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:37.791723 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-72322510-40a7-42ae-a092-6be3b90dc5c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:37.793140 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 361/724] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:37.798424 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b779e1-2e3d-4ae1-9d44-096534dbc0ed None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:37.932105 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b779e1-2e3d-4ae1-9d44-096534dbc0ed None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:37.969410 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd12b47-2baa-4259-8d8a-ccf46c6a1f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:37.970403 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd12b47-2baa-4259-8d8a-ccf46c6a1f95 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:37.970929 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd12b47-2baa-4259-8d8a-ccf46c6a1f95 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:37.971402 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd12b47-2baa-4259-8d8a-ccf46c6a1f95 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:37.972331 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd12b47-2baa-4259-8d8a-ccf46c6a1f95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:37.973384 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd12b47-2baa-4259-8d8a-ccf46c6a1f95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:37.974985 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd12b47-2baa-4259-8d8a-ccf46c6a1f95 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:37.994319 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 364/725] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:38.003919 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72322510-40a7-42ae-a092-6be3b90dc5c0 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:38.192708 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72322510-40a7-42ae-a092-6be3b90dc5c0 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:38.243012 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8e4bc-934c-4072-85c2-270d23d3a856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:38.243728 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8e4bc-934c-4072-85c2-270d23d3a856 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:38.244006 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8e4bc-934c-4072-85c2-270d23d3a856 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:38.244275 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8e4bc-934c-4072-85c2-270d23d3a856 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:38.258584 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8e4bc-934c-4072-85c2-270d23d3a856 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:38.260046 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8e4bc-934c-4072-85c2-270d23d3a856 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:38.277004 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-abe8e4bc-934c-4072-85c2-270d23d3a856 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 23:43:38.278634 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 362/726] 10.222.0.24 () {56 vars in 1093 bytes} [Mon Apr 11 23:43:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:38.284070 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd12b47-2baa-4259-8d8a-ccf46c6a1f95 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:38.288614 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938c8cb-fa67-4719-b192-1d6c72520ba3 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:38.288899 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938c8cb-fa67-4719-b192-1d6c72520ba3 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:38.289157 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a938c8cb-fa67-4719-b192-1d6c72520ba3 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:38.291286 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 363/727] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:43:38.301237 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43977680-5a84-4405-8fdb-78241241d009 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:38.301420 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43977680-5a84-4405-8fdb-78241241d009 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:38.301654 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43977680-5a84-4405-8fdb-78241241d009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:38.335909 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-43977680-5a84-4405-8fdb-78241241d009 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:38.337311 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-43977680-5a84-4405-8fdb-78241241d009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:38.393805 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd12b47-2baa-4259-8d8a-ccf46c6a1f95 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:38.433298 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae64f40-32b6-475f-9c18-17fc9408b0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:38.433960 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae64f40-32b6-475f-9c18-17fc9408b0bf None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:38.434232 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae64f40-32b6-475f-9c18-17fc9408b0bf None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:38.434497 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae64f40-32b6-475f-9c18-17fc9408b0bf None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:38.435357 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae64f40-32b6-475f-9c18-17fc9408b0bf None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:38.435658 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae64f40-32b6-475f-9c18-17fc9408b0bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:38.437071 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae64f40-32b6-475f-9c18-17fc9408b0bf None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:38.469386 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 365/728] 10.222.0.24 () {56 vars in 1133 bytes} [Mon Apr 11 23:43:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:38.470692 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 364/729] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Apr 11 23:43:38.478858 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae64f40-32b6-475f-9c18-17fc9408b0bf None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:38.540112 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43977680-5a84-4405-8fdb-78241241d009 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:38.647707 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae64f40-32b6-475f-9c18-17fc9408b0bf None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:38.682857 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421b412-2a20-492b-beeb-cec27d75cb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:38.684373 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421b412-2a20-492b-beeb-cec27d75cb0d None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:38.685072 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421b412-2a20-492b-beeb-cec27d75cb0d None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:38.685492 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421b412-2a20-492b-beeb-cec27d75cb0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:38.686707 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43977680-5a84-4405-8fdb-78241241d009 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:38.698480 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421b412-2a20-492b-beeb-cec27d75cb0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:38.700199 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421b412-2a20-492b-beeb-cec27d75cb0d None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:38.723080 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f439b-8bd2-4ed5-a876-f4de606eabf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:38.723710 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-7421b412-2a20-492b-beeb-cec27d75cb0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:38.724295 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f439b-8bd2-4ed5-a876-f4de606eabf2 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:38.724732 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f439b-8bd2-4ed5-a876-f4de606eabf2 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:38.725166 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f439b-8bd2-4ed5-a876-f4de606eabf2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:38.725340 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 366/730] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:38.726679 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c66f2-a583-4367-aff3-37efd1c1bb5c None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:38.726990 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c66f2-a583-4367-aff3-37efd1c1bb5c None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:38.727265 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c66f2-a583-4367-aff3-37efd1c1bb5c None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:38.733715 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 367/731] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:38.733715 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c66f2-a583-4367-aff3-37efd1c1bb5c None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:38.743471 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f439b-8bd2-4ed5-a876-f4de606eabf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:38.750870 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-817f439b-8bd2-4ed5-a876-f4de606eabf2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 23:43:38.752701 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 365/732] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:43:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:38.754880 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fd2cb-e6f9-4bb9-8fc1-df6e87aefc57 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:38.755365 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fd2cb-e6f9-4bb9-8fc1-df6e87aefc57 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:38.755807 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fd2cb-e6f9-4bb9-8fc1-df6e87aefc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:38.778202 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-f77fd2cb-e6f9-4bb9-8fc1-df6e87aefc57 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:38.780191 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-f77fd2cb-e6f9-4bb9-8fc1-df6e87aefc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:38.848023 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c66f2-a583-4367-aff3-37efd1c1bb5c None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:38.864874 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 366/733] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:38.866102 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fd2cb-e6f9-4bb9-8fc1-df6e87aefc57 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:38.903815 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20bb4f-f2c7-4155-82c1-782445c1a314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:38.904208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20bb4f-f2c7-4155-82c1-782445c1a314 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:38.904420 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20bb4f-f2c7-4155-82c1-782445c1a314 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:38.904688 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20bb4f-f2c7-4155-82c1-782445c1a314 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:38.905464 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20bb4f-f2c7-4155-82c1-782445c1a314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:38.905764 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20bb4f-f2c7-4155-82c1-782445c1a314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:38.907231 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20bb4f-f2c7-4155-82c1-782445c1a314 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:38.919520 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 368/734] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:38.920403 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20bb4f-f2c7-4155-82c1-782445c1a314 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:38.973981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fd2cb-e6f9-4bb9-8fc1-df6e87aefc57 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:39.007314 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d69ce97-6e43-4056-affa-2ae4efe8d881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:39.007976 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69ce97-6e43-4056-affa-2ae4efe8d881 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:39.008246 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69ce97-6e43-4056-affa-2ae4efe8d881 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:39.008511 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d69ce97-6e43-4056-affa-2ae4efe8d881 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:39.010492 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69ce97-6e43-4056-affa-2ae4efe8d881 None admin] RBAC: Adding query filter params (name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:39.010492 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69ce97-6e43-4056-affa-2ae4efe8d881 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:39.012541 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d69ce97-6e43-4056-affa-2ae4efe8d881 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:39.022288 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20bb4f-f2c7-4155-82c1-782445c1a314 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:39.023149 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 367/735] 10.222.0.24 () {56 vars in 1103 bytes} [Mon Apr 11 23:43:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:39.024690 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d5a1-eb40-40ab-a3ac-8d9f56d19bf5 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:39.025048 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d5a1-eb40-40ab-a3ac-8d9f56d19bf5 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:39.025390 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0d5a1-eb40-40ab-a3ac-8d9f56d19bf5 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:39.027372 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 368/736] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:39.028088 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0d5a1-eb40-40ab-a3ac-8d9f56d19bf5 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:39.060588 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c2520-0465-48f1-99be-04736fd3b69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:39.061368 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c2520-0465-48f1-99be-04736fd3b69e None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:39.061646 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c2520-0465-48f1-99be-04736fd3b69e None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:39.061915 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5c2520-0465-48f1-99be-04736fd3b69e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:39.072448 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5c2520-0465-48f1-99be-04736fd3b69e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:39.079581 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-1a5c2520-0465-48f1-99be-04736fd3b69e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:43:39.080770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 369/737] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:43:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:39.081583 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c2520-0465-48f1-99be-04736fd3b69e None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:39.126674 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0d5a1-eb40-40ab-a3ac-8d9f56d19bf5 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:39.157050 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510857a-7773-4df4-8f17-0c247d27134b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:39.157824 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510857a-7773-4df4-8f17-0c247d27134b None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:39.158095 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510857a-7773-4df4-8f17-0c247d27134b None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:39.158364 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510857a-7773-4df4-8f17-0c247d27134b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:39.165341 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510857a-7773-4df4-8f17-0c247d27134b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:39.166751 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510857a-7773-4df4-8f17-0c247d27134b None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:39.175025 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5c2520-0465-48f1-99be-04736fd3b69e None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:39.180261 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-4510857a-7773-4df4-8f17-0c247d27134b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:39.181404 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 369/738] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:39.182530 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43885b14-4507-433c-b54d-9461e5449358 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:39.182806 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43885b14-4507-433c-b54d-9461e5449358 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:39.183096 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43885b14-4507-433c-b54d-9461e5449358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:39.198673 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-43885b14-4507-433c-b54d-9461e5449358 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:39.199850 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-43885b14-4507-433c-b54d-9461e5449358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:39.207523 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661f584-e2c5-4070-8460-6c869e202fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:39.208300 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661f584-e2c5-4070-8460-6c869e202fec None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:39.208966 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661f584-e2c5-4070-8460-6c869e202fec None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:39.209246 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661f584-e2c5-4070-8460-6c869e202fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:39.219581 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661f584-e2c5-4070-8460-6c869e202fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:39.221018 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661f584-e2c5-4070-8460-6c869e202fec None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:39.237493 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-4661f584-e2c5-4070-8460-6c869e202fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:39.239282 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 370/739] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:39.240455 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ceb2f-325a-4ceb-810c-347855a1ac19 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:39.240743 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ceb2f-325a-4ceb-810c-347855a1ac19 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:39.241018 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ceb2f-325a-4ceb-810c-347855a1ac19 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:39.244230 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 371/740] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:39.244230 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ceb2f-325a-4ceb-810c-347855a1ac19 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:39.262654 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 370/741] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:39.263696 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43885b14-4507-433c-b54d-9461e5449358 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:39.361661 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ceb2f-325a-4ceb-810c-347855a1ac19 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:39.366964 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43885b14-4507-433c-b54d-9461e5449358 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:39.392758 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027bbec-224f-455a-81a8-a661262a7ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:39.393346 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027bbec-224f-455a-81a8-a661262a7ff7 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:39.393621 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027bbec-224f-455a-81a8-a661262a7ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:39.393892 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f027bbec-224f-455a-81a8-a661262a7ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:39.395196 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027bbec-224f-455a-81a8-a661262a7ff7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:39.395497 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027bbec-224f-455a-81a8-a661262a7ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:39.396866 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f027bbec-224f-455a-81a8-a661262a7ff7 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:39.399277 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b734feba-12c2-45a0-9c2c-ca4b0e0f9a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:39.399928 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734feba-12c2-45a0-9c2c-ca4b0e0f9a71 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:39.400204 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734feba-12c2-45a0-9c2c-ca4b0e0f9a71 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:39.400473 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b734feba-12c2-45a0-9c2c-ca4b0e0f9a71 None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:39.401258 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734feba-12c2-45a0-9c2c-ca4b0e0f9a71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:39.401559 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734feba-12c2-45a0-9c2c-ca4b0e0f9a71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:39.402980 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b734feba-12c2-45a0-9c2c-ca4b0e0f9a71 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:39.404871 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 372/742] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:43:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:39.405638 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027bbec-224f-455a-81a8-a661262a7ff7 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:39.414776 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 371/743] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:39.415908 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974732d-2d36-40b6-a980-689afd16a86e None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:39.416192 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974732d-2d36-40b6-a980-689afd16a86e None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:39.416464 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974732d-2d36-40b6-a980-689afd16a86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:39.436105 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-1974732d-2d36-40b6-a980-689afd16a86e None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:39.437289 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1974732d-2d36-40b6-a980-689afd16a86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:39.500025 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 372/744] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Apr 11 23:43:39.500832 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974732d-2d36-40b6-a980-689afd16a86e None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:39.504522 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f027bbec-224f-455a-81a8-a661262a7ff7 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:39.538113 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0902fd2-15de-4c35-9bc0-5aff2ceaa983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:39.538770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0902fd2-15de-4c35-9bc0-5aff2ceaa983 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:39.539083 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0902fd2-15de-4c35-9bc0-5aff2ceaa983 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:39.539361 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0902fd2-15de-4c35-9bc0-5aff2ceaa983 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:39.540086 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0902fd2-15de-4c35-9bc0-5aff2ceaa983 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:39.540391 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0902fd2-15de-4c35-9bc0-5aff2ceaa983 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:39.541744 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0902fd2-15de-4c35-9bc0-5aff2ceaa983 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:39.552471 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 373/745] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:39.553245 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0902fd2-15de-4c35-9bc0-5aff2ceaa983 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:39.599597 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974732d-2d36-40b6-a980-689afd16a86e None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:39.630532 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18a733-2670-4605-9e6e-9547d5a11287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:39.631219 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18a733-2670-4605-9e6e-9547d5a11287 None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:39.631495 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18a733-2670-4605-9e6e-9547d5a11287 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:39.631765 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a18a733-2670-4605-9e6e-9547d5a11287 None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:39.632550 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18a733-2670-4605-9e6e-9547d5a11287 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:39.633859 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a18a733-2670-4605-9e6e-9547d5a11287 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:39.645608 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0902fd2-15de-4c35-9bc0-5aff2ceaa983 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:39.677160 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95435fe-9961-4eb2-8f99-b948f6a7e249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:39.677928 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95435fe-9961-4eb2-8f99-b948f6a7e249 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:39.678208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95435fe-9961-4eb2-8f99-b948f6a7e249 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:39.678482 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95435fe-9961-4eb2-8f99-b948f6a7e249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:39.689334 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95435fe-9961-4eb2-8f99-b948f6a7e249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:39.690761 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95435fe-9961-4eb2-8f99-b948f6a7e249 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:39.707527 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-b95435fe-9961-4eb2-8f99-b948f6a7e249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:39.708662 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 374/746] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:39.709434 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95435fe-9961-4eb2-8f99-b948f6a7e249 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:39.744296 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 373/747] 10.222.0.24 () {60 vars in 1141 bytes} [Mon Apr 11 23:43:39 2022] POST /identity/v3/services => generated 251 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:43:39.745174 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18a733-2670-4605-9e6e-9547d5a11287 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:39.818424 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95435fe-9961-4eb2-8f99-b948f6a7e249 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:39.860748 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a18a733-2670-4605-9e6e-9547d5a11287 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:39.861077 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae5dfb-adba-4e96-b5c4-34e5b2cf16c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:39.861921 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae5dfb-adba-4e96-b5c4-34e5b2cf16c4 None admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:39.862196 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae5dfb-adba-4e96-b5c4-34e5b2cf16c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:39.862469 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae5dfb-adba-4e96-b5c4-34e5b2cf16c4 None admin] PATH_INFO: `/v3/projects/3563c87e56124c688a8029b4088cb198/users/a9519f49f897415a894c1121278dda9c/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:39.865300 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae5dfb-adba-4e96-b5c4-34e5b2cf16c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3563c87e56124c688a8029b4088cb198, user_id=a9519f49f897415a894c1121278dda9c, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:39.866764 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae5dfb-adba-4e96-b5c4-34e5b2cf16c4 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:39.898310 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8a306-1911-4c72-b3bf-2dbe55e44594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:39.898926 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8a306-1911-4c72-b3bf-2dbe55e44594 None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:39.899205 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8a306-1911-4c72-b3bf-2dbe55e44594 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:39.899481 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f8a306-1911-4c72-b3bf-2dbe55e44594 None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:39.900313 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8a306-1911-4c72-b3bf-2dbe55e44594 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:39.901699 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f8a306-1911-4c72-b3bf-2dbe55e44594 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:39.935215 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 375/748] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:43:39 2022] PUT /identity/v3/projects/3563c87e56124c688a8029b4088cb198/users/a9519f49f897415a894c1121278dda9c/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:43:39.936077 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae5dfb-adba-4e96-b5c4-34e5b2cf16c4 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:39.981596 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 374/749] 10.222.0.24 () {60 vars in 1141 bytes} [Mon Apr 11 23:43:39 2022] POST /identity/v3/services => generated 240 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:43:39.982776 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8a306-1911-4c72-b3bf-2dbe55e44594 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:40.067662 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae5dfb-adba-4e96-b5c4-34e5b2cf16c4 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:40.162113 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e3486-766d-4736-9a4e-1c5299adb1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:40.162889 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e3486-766d-4736-9a4e-1c5299adb1c5 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:40.163160 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e3486-766d-4736-9a4e-1c5299adb1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:40.163427 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e3486-766d-4736-9a4e-1c5299adb1c5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:40.165017 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f8a306-1911-4c72-b3bf-2dbe55e44594 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:40.179622 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e3486-766d-4736-9a4e-1c5299adb1c5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:40.181449 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72e3486-766d-4736-9a4e-1c5299adb1c5 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:40.202866 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-a72e3486-766d-4736-9a4e-1c5299adb1c5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 23:43:40.204741 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 376/750] 10.222.0.24 () {56 vars in 1117 bytes} [Mon Apr 11 23:43:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:40.207399 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2135e90-2c3e-4185-87c3-2caa35e0c944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:40.207870 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2135e90-2c3e-4185-87c3-2caa35e0c944 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:40.207946 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2135e90-2c3e-4185-87c3-2caa35e0c944 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:40.209100 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2135e90-2c3e-4185-87c3-2caa35e0c944 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:40.209100 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2135e90-2c3e-4185-87c3-2caa35e0c944 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:40.209277 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2135e90-2c3e-4185-87c3-2caa35e0c944 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:40.210821 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2135e90-2c3e-4185-87c3-2caa35e0c944 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:40.212814 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e3486-766d-4736-9a4e-1c5299adb1c5 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:40.226071 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 375/751] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:40.231313 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2135e90-2c3e-4185-87c3-2caa35e0c944 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:40.327106 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72e3486-766d-4736-9a4e-1c5299adb1c5 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:40.343794 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2135e90-2c3e-4185-87c3-2caa35e0c944 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:40.362042 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d03a2b-b9bb-4e32-ac69-1dae671da1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:40.363322 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d03a2b-b9bb-4e32-ac69-1dae671da1f0 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:40.363743 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d03a2b-b9bb-4e32-ac69-1dae671da1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:40.364178 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d03a2b-b9bb-4e32-ac69-1dae671da1f0 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:40.365169 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d03a2b-b9bb-4e32-ac69-1dae671da1f0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:40.365693 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d03a2b-b9bb-4e32-ac69-1dae671da1f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:40.367364 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d03a2b-b9bb-4e32-ac69-1dae671da1f0 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:40.380193 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fc5b2-f4d5-44c5-b58c-371bc797824a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:40.380988 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fc5b2-f4d5-44c5-b58c-371bc797824a None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:40.381268 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fc5b2-f4d5-44c5-b58c-371bc797824a None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:40.381540 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fc5b2-f4d5-44c5-b58c-371bc797824a None admin] PATH_INFO: `/v3/users/swift` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:40.387168 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 377/752] 10.222.0.24 () {56 vars in 1149 bytes} [Mon Apr 11 23:43:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:40.389013 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fc5b2-f4d5-44c5-b58c-371bc797824a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:40.390494 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fc5b2-f4d5-44c5-b58c-371bc797824a None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:40.392309 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d03a2b-b9bb-4e32-ac69-1dae671da1f0 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:40.416071 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-6f1fc5b2-f4d5-44c5-b58c-371bc797824a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 23:43:40.423260 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 376/753] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:43:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:40.428516 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fc5b2-f4d5-44c5-b58c-371bc797824a None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:40.498723 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d03a2b-b9bb-4e32-ac69-1dae671da1f0 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:40.544822 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b06769-670c-4280-baaa-793de1240441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:40.545857 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b06769-670c-4280-baaa-793de1240441 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:40.546338 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b06769-670c-4280-baaa-793de1240441 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:40.547289 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b06769-670c-4280-baaa-793de1240441 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:40.620912 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b06769-670c-4280-baaa-793de1240441 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:40.622710 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b06769-670c-4280-baaa-793de1240441 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:40.642751 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fc5b2-f4d5-44c5-b58c-371bc797824a None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:40.676364 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61113575-0f26-459a-859d-1387ce4385b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:40.676963 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61113575-0f26-459a-859d-1387ce4385b5 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:40.677212 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61113575-0f26-459a-859d-1387ce4385b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:40.677487 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61113575-0f26-459a-859d-1387ce4385b5 None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:40.678331 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61113575-0f26-459a-859d-1387ce4385b5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:40.678639 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61113575-0f26-459a-859d-1387ce4385b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:40.680402 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61113575-0f26-459a-859d-1387ce4385b5 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:40.717354 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 377/754] 10.222.0.24 () {56 vars in 1135 bytes} [Mon Apr 11 23:43:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:40.722470 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61113575-0f26-459a-859d-1387ce4385b5 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:40.738973 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 378/755] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:43:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 23:43:40.748417 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b06769-670c-4280-baaa-793de1240441 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:40.837756 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61113575-0f26-459a-859d-1387ce4385b5 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:40.876167 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cf370-7866-40ed-8ac5-e6c1b01f66ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:40.876819 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cf370-7866-40ed-8ac5-e6c1b01f66ac None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:40.877101 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cf370-7866-40ed-8ac5-e6c1b01f66ac None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:40.877375 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0cf370-7866-40ed-8ac5-e6c1b01f66ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:40.951801 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b06769-670c-4280-baaa-793de1240441 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:40.992926 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cf370-7866-40ed-8ac5-e6c1b01f66ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:40.994364 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0cf370-7866-40ed-8ac5-e6c1b01f66ac None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:41.019654 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b6f47-b28e-480e-bf11-f920db658de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:41.020831 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b6f47-b28e-480e-bf11-f920db658de9 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:41.021337 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b6f47-b28e-480e-bf11-f920db658de9 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:41.021804 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b6f47-b28e-480e-bf11-f920db658de9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:41.036965 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b6f47-b28e-480e-bf11-f920db658de9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:41.038755 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b6f47-b28e-480e-bf11-f920db658de9 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:41.068176 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-325b6f47-b28e-480e-bf11-f920db658de9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:41.075194 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 379/756] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:41.083959 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b6f47-b28e-480e-bf11-f920db658de9 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:41.149056 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 378/757] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:43:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 23:43:41.154940 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cf370-7866-40ed-8ac5-e6c1b01f66ac None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:41.264601 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b6f47-b28e-480e-bf11-f920db658de9 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:41.296301 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0cf370-7866-40ed-8ac5-e6c1b01f66ac None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:41.298369 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae93b3-4442-47e9-8a48-aa971da687a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:41.299269 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae93b3-4442-47e9-8a48-aa971da687a9 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:41.299722 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae93b3-4442-47e9-8a48-aa971da687a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:41.300190 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae93b3-4442-47e9-8a48-aa971da687a9 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:41.301657 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae93b3-4442-47e9-8a48-aa971da687a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:41.302130 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae93b3-4442-47e9-8a48-aa971da687a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:41.303690 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fae93b3-4442-47e9-8a48-aa971da687a9 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:41.322022 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 380/758] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:41.331839 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae93b3-4442-47e9-8a48-aa971da687a9 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:41.336733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ba091-45ba-4c42-a7a6-0dd395b5dab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:41.337750 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ba091-45ba-4c42-a7a6-0dd395b5dab3 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:41.338207 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ba091-45ba-4c42-a7a6-0dd395b5dab3 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:41.338673 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ba091-45ba-4c42-a7a6-0dd395b5dab3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:41.349929 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ba091-45ba-4c42-a7a6-0dd395b5dab3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:41.351636 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ba091-45ba-4c42-a7a6-0dd395b5dab3 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:41.369569 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-e03ba091-45ba-4c42-a7a6-0dd395b5dab3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:41.371307 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 379/759] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:41.376841 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ba091-45ba-4c42-a7a6-0dd395b5dab3 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:41.466037 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae93b3-4442-47e9-8a48-aa971da687a9 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:41.512562 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a8dbf-1291-4599-9f89-4d1d513fbebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:41.513363 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a8dbf-1291-4599-9f89-4d1d513fbebc None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:41.513644 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a8dbf-1291-4599-9f89-4d1d513fbebc None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:41.513918 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a8dbf-1291-4599-9f89-4d1d513fbebc None admin] PATH_INFO: `/v3/projects/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:41.527057 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a8dbf-1291-4599-9f89-4d1d513fbebc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:41.528443 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a8dbf-1291-4599-9f89-4d1d513fbebc None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:41.551733 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-1d1a8dbf-1291-4599-9f89-4d1d513fbebc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:41.565347 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 381/760] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:41.566265 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a8dbf-1291-4599-9f89-4d1d513fbebc None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:41.599513 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ba091-45ba-4c42-a7a6-0dd395b5dab3 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:41.637625 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e8cc9-c511-4a5a-a1e4-399cb2dd101e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:41.638646 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e8cc9-c511-4a5a-a1e4-399cb2dd101e None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:41.639148 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e8cc9-c511-4a5a-a1e4-399cb2dd101e None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:41.639639 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e8cc9-c511-4a5a-a1e4-399cb2dd101e None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:41.640558 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e8cc9-c511-4a5a-a1e4-399cb2dd101e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:41.641076 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e8cc9-c511-4a5a-a1e4-399cb2dd101e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:41.642617 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e8cc9-c511-4a5a-a1e4-399cb2dd101e None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:41.656229 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 380/761] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:41.662920 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e8cc9-c511-4a5a-a1e4-399cb2dd101e None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:41.682999 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a8dbf-1291-4599-9f89-4d1d513fbebc None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:41.736024 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4817fa-8e0f-433f-b05d-cb945c7749e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:41.736685 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4817fa-8e0f-433f-b05d-cb945c7749e4 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:41.736958 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4817fa-8e0f-433f-b05d-cb945c7749e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:41.737224 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4817fa-8e0f-433f-b05d-cb945c7749e4 None admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:41.740246 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4817fa-8e0f-433f-b05d-cb945c7749e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:41.740560 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4817fa-8e0f-433f-b05d-cb945c7749e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:41.741990 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4817fa-8e0f-433f-b05d-cb945c7749e4 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:41.763500 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 382/762] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:41.774366 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4817fa-8e0f-433f-b05d-cb945c7749e4 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:41.814012 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e8cc9-c511-4a5a-a1e4-399cb2dd101e None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:41.854710 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085ee2b-a088-4190-b8ba-936edb999afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:41.855914 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085ee2b-a088-4190-b8ba-936edb999afe None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:41.856394 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085ee2b-a088-4190-b8ba-936edb999afe None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:41.857270 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085ee2b-a088-4190-b8ba-936edb999afe None admin] PATH_INFO: `/v3/projects/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:41.872925 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085ee2b-a088-4190-b8ba-936edb999afe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:41.874659 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085ee2b-a088-4190-b8ba-936edb999afe None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:41.901870 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-0085ee2b-a088-4190-b8ba-936edb999afe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:41.908019 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 381/763] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:41.914340 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085ee2b-a088-4190-b8ba-936edb999afe None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:41.970312 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4817fa-8e0f-433f-b05d-cb945c7749e4 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:42.011539 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e26d7-dbdb-4417-a1a8-2d033cbb6041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:42.012557 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e26d7-dbdb-4417-a1a8-2d033cbb6041 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:42.013032 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e26d7-dbdb-4417-a1a8-2d033cbb6041 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:42.013499 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e26d7-dbdb-4417-a1a8-2d033cbb6041 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:42.014548 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e26d7-dbdb-4417-a1a8-2d033cbb6041 None admin] RBAC: Adding query filter params (role.id=f4692fa2043d468fae733095d5740686, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=5c7b25e0e29143d783553859a0583d6a) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:42.015084 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e26d7-dbdb-4417-a1a8-2d033cbb6041 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:42.016778 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663e26d7-dbdb-4417-a1a8-2d033cbb6041 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:42.023091 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 383/764] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:43:41 2022] GET /identity/v3/role_assignments?user.id=5c7b25e0e29143d783553859a0583d6a&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=f4692fa2043d468fae733095d5740686 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:42.100026 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085ee2b-a088-4190-b8ba-936edb999afe None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:42.165675 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5b03d-c55f-4dd2-bb9a-87f3ffcff2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:42.166345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5b03d-c55f-4dd2-bb9a-87f3ffcff2a5 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:42.166625 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5b03d-c55f-4dd2-bb9a-87f3ffcff2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:42.166924 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5b03d-c55f-4dd2-bb9a-87f3ffcff2a5 None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:42.167723 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5b03d-c55f-4dd2-bb9a-87f3ffcff2a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:42.168033 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5b03d-c55f-4dd2-bb9a-87f3ffcff2a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:42.169457 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca5b03d-c55f-4dd2-bb9a-87f3ffcff2a5 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:42.186783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 382/765] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:42.193155 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e26d7-dbdb-4417-a1a8-2d033cbb6041 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:42.313413 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663e26d7-dbdb-4417-a1a8-2d033cbb6041 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:42.351455 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f4a8f-c491-4125-92cd-6e718be575d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:42.352456 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f4a8f-c491-4125-92cd-6e718be575d5 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:42.352934 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f4a8f-c491-4125-92cd-6e718be575d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:42.353397 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f4a8f-c491-4125-92cd-6e718be575d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:42.354439 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f4a8f-c491-4125-92cd-6e718be575d5 None admin] RBAC: Adding query filter params (role.id=c8affbefb4c5462a921650b24b13c80f, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=189d616b38304d91bf1c7aded81205e3) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:42.355026 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f4a8f-c491-4125-92cd-6e718be575d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:42.356678 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0f4a8f-c491-4125-92cd-6e718be575d5 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:42.363518 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 384/766] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:43:42 2022] GET /identity/v3/role_assignments?user.id=189d616b38304d91bf1c7aded81205e3&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=c8affbefb4c5462a921650b24b13c80f => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:42.543058 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db1678-901c-4901-b7c6-04e5ca129265 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:42.543570 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db1678-901c-4901-b7c6-04e5ca129265 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:42.543675 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9db1678-901c-4901-b7c6-04e5ca129265 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:42.545660 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 383/767] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:42.551437 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681126a8-7f17-4304-8b2a-247c60b3765f None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:42.552348 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681126a8-7f17-4304-8b2a-247c60b3765f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:42.552821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681126a8-7f17-4304-8b2a-247c60b3765f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:42.575177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-681126a8-7f17-4304-8b2a-247c60b3765f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:42.576858 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-681126a8-7f17-4304-8b2a-247c60b3765f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:42.665922 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 385/768] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:43:42.697219 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db1678-901c-4901-b7c6-04e5ca129265 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:42.766168 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193773f3-3c21-4fb8-b837-a62e424c167c None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:42.767014 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193773f3-3c21-4fb8-b837-a62e424c167c None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:42.767592 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193773f3-3c21-4fb8-b837-a62e424c167c None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:42.770890 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 386/769] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:42.776676 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b0b28-4e79-43d7-ba93-c91ad1dae709 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:42.776962 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b0b28-4e79-43d7-ba93-c91ad1dae709 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:42.777237 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b0b28-4e79-43d7-ba93-c91ad1dae709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:42.807211 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-dd8b0b28-4e79-43d7-ba93-c91ad1dae709 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:42.808392 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-dd8b0b28-4e79-43d7-ba93-c91ad1dae709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:42.825835 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9db1678-901c-4901-b7c6-04e5ca129265 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:42.860246 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e12e7a-4258-4f3e-81d9-5b4ed4c3d226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:42.861398 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e12e7a-4258-4f3e-81d9-5b4ed4c3d226 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:42.861878 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e12e7a-4258-4f3e-81d9-5b4ed4c3d226 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:42.862356 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e12e7a-4258-4f3e-81d9-5b4ed4c3d226 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:42.863298 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e12e7a-4258-4f3e-81d9-5b4ed4c3d226 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:42.864944 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e12e7a-4258-4f3e-81d9-5b4ed4c3d226 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:42.876890 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-97e12e7a-4258-4f3e-81d9-5b4ed4c3d226 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 11 23:43:42.883662 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 384/770] 10.222.0.24 () {56 vars in 1129 bytes} [Mon Apr 11 23:43:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:42.885276 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81637f7-888e-49df-a944-204308dee6a4 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:42.885773 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81637f7-888e-49df-a944-204308dee6a4 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:42.886214 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81637f7-888e-49df-a944-204308dee6a4 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:42.887692 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 387/771] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 23:43:42.888614 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b0b28-4e79-43d7-ba93-c91ad1dae709 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:42.888916 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 385/772] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:42.893959 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c342628-63e7-4ac7-a2bc-9f401e54270c None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:42.895017 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c342628-63e7-4ac7-a2bc-9f401e54270c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:42.895498 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c342628-63e7-4ac7-a2bc-9f401e54270c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:42.918633 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-5c342628-63e7-4ac7-a2bc-9f401e54270c None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:42.924094 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-5c342628-63e7-4ac7-a2bc-9f401e54270c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:43.001250 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 386/773] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:43:43.004694 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b0b28-4e79-43d7-ba93-c91ad1dae709 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:43.007630 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c342628-63e7-4ac7-a2bc-9f401e54270c None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:43.042630 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93993942-7e8a-46ca-ba8b-51a0aa8049a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:43.047013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93993942-7e8a-46ca-ba8b-51a0aa8049a8 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:43.047013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93993942-7e8a-46ca-ba8b-51a0aa8049a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:43.047013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93993942-7e8a-46ca-ba8b-51a0aa8049a8 None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:43.047013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93993942-7e8a-46ca-ba8b-51a0aa8049a8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:43.047013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93993942-7e8a-46ca-ba8b-51a0aa8049a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:43.047395 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93993942-7e8a-46ca-ba8b-51a0aa8049a8 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:43.054941 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 388/774] 10.222.0.24 () {56 vars in 1124 bytes} [Mon Apr 11 23:43:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:43.056018 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93993942-7e8a-46ca-ba8b-51a0aa8049a8 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:43.133474 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c342628-63e7-4ac7-a2bc-9f401e54270c None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:43.179251 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fc438-2508-4a22-aad4-3a40d4e4c4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:43.180100 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fc438-2508-4a22-aad4-3a40d4e4c4fa None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:43.180439 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fc438-2508-4a22-aad4-3a40d4e4c4fa None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:43.180778 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6fc438-2508-4a22-aad4-3a40d4e4c4fa None admin] PATH_INFO: `/v3/services/network` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:43.181496 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fc438-2508-4a22-aad4-3a40d4e4c4fa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:43.182958 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6fc438-2508-4a22-aad4-3a40d4e4c4fa None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:43.192703 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93993942-7e8a-46ca-ba8b-51a0aa8049a8 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:43.194804 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-2e6fc438-2508-4a22-aad4-3a40d4e4c4fa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 11 23:43:43.196479 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 387/775] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:43 2022] GET /identity/v3/services/network => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:43.197325 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fc438-2508-4a22-aad4-3a40d4e4c4fa None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:43.234268 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3c720-589c-4073-a073-5004dce237b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:43.235382 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3c720-589c-4073-a073-5004dce237b8 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:43.235834 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3c720-589c-4073-a073-5004dce237b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:43.236298 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3c720-589c-4073-a073-5004dce237b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:43.247320 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c3c720-589c-4073-a073-5004dce237b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:43.255029 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-95c3c720-589c-4073-a073-5004dce237b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:43:43.256772 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 389/776] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:43:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:43.257817 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3c720-589c-4073-a073-5004dce237b8 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:43.323277 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6fc438-2508-4a22-aad4-3a40d4e4c4fa None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:43.360426 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efed5b-b352-4f46-9001-f20b8cabccb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:43.361629 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efed5b-b352-4f46-9001-f20b8cabccb5 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:43.362423 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efed5b-b352-4f46-9001-f20b8cabccb5 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:43.363691 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20efed5b-b352-4f46-9001-f20b8cabccb5 None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:43.364772 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efed5b-b352-4f46-9001-f20b8cabccb5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:43.365573 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efed5b-b352-4f46-9001-f20b8cabccb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:43.367579 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20efed5b-b352-4f46-9001-f20b8cabccb5 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:43.371344 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c3c720-589c-4073-a073-5004dce237b8 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:43.374661 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 388/777] 10.222.0.24 () {56 vars in 1124 bytes} [Mon Apr 11 23:43:43 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:43.375724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efed5b-b352-4f46-9001-f20b8cabccb5 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:43.411480 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee7c4d-53ea-465d-b867-8dc32f8c3f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:43.412145 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee7c4d-53ea-465d-b867-8dc32f8c3f0b None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:43.412476 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee7c4d-53ea-465d-b867-8dc32f8c3f0b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:43.412753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee7c4d-53ea-465d-b867-8dc32f8c3f0b None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:43.413629 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee7c4d-53ea-465d-b867-8dc32f8c3f0b None admin] RBAC: Adding query filter params (name=network) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:43.413934 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee7c4d-53ea-465d-b867-8dc32f8c3f0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:43.415933 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ee7c4d-53ea-465d-b867-8dc32f8c3f0b None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:43.426911 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 390/778] 10.222.0.24 () {56 vars in 1112 bytes} [Mon Apr 11 23:43:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:43.429631 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee7c4d-53ea-465d-b867-8dc32f8c3f0b None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:43.512321 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20efed5b-b352-4f46-9001-f20b8cabccb5 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:43.560103 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70392e0f-c698-4af2-b37c-11bc7f238b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:43.561378 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee7c4d-53ea-465d-b867-8dc32f8c3f0b None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:43.561981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70392e0f-c698-4af2-b37c-11bc7f238b7e None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:43.562437 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70392e0f-c698-4af2-b37c-11bc7f238b7e None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:43.563183 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70392e0f-c698-4af2-b37c-11bc7f238b7e None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:43.564946 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70392e0f-c698-4af2-b37c-11bc7f238b7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:43.565485 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70392e0f-c698-4af2-b37c-11bc7f238b7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:43.567747 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70392e0f-c698-4af2-b37c-11bc7f238b7e None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:43.579850 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 389/779] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:43:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:43.580939 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70392e0f-c698-4af2-b37c-11bc7f238b7e None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:43.597013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b0f85-5123-4ba6-8223-f3032b7de71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:43.598312 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b0f85-5123-4ba6-8223-f3032b7de71d None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:43.598662 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b0f85-5123-4ba6-8223-f3032b7de71d None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:43.599078 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b0f85-5123-4ba6-8223-f3032b7de71d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:43.599992 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b0f85-5123-4ba6-8223-f3032b7de71d None admin] RBAC: Adding query filter params (interface=public, service_id=8498ead830b0403cbcd2953aa12977e7, region_id=RegionOne) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:43.600369 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b0f85-5123-4ba6-8223-f3032b7de71d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:43.601806 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b0f85-5123-4ba6-8223-f3032b7de71d None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:43.609515 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 391/780] 10.222.0.24 () {56 vars in 1251 bytes} [Mon Apr 11 23:43:43 2022] GET /identity/v3/endpoints?service_id=8498ead830b0403cbcd2953aa12977e7&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:43.610631 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b0f85-5123-4ba6-8223-f3032b7de71d None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:43.692532 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70392e0f-c698-4af2-b37c-11bc7f238b7e None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:43.724298 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b0f85-5123-4ba6-8223-f3032b7de71d None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:43.733226 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72d85c-f08f-478a-8413-c9f07b19af70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:43.734104 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72d85c-f08f-478a-8413-c9f07b19af70 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:43.734828 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72d85c-f08f-478a-8413-c9f07b19af70 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:43.735604 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72d85c-f08f-478a-8413-c9f07b19af70 None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:43.736578 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72d85c-f08f-478a-8413-c9f07b19af70 None admin] RBAC: Adding query filter params (type=network) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:43.737220 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72d85c-f08f-478a-8413-c9f07b19af70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:43.739973 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72d85c-f08f-478a-8413-c9f07b19af70 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:43.751229 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 390/781] 10.222.0.24 () {56 vars in 1112 bytes} [Mon Apr 11 23:43:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:43.751229 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72d85c-f08f-478a-8413-c9f07b19af70 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:43.773937 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95dfc2-a329-45b9-a05a-aef1850a0c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:43.774921 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95dfc2-a329-45b9-a05a-aef1850a0c38 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:43.775219 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95dfc2-a329-45b9-a05a-aef1850a0c38 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:43.775568 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95dfc2-a329-45b9-a05a-aef1850a0c38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:43.787034 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95dfc2-a329-45b9-a05a-aef1850a0c38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:43.788532 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95dfc2-a329-45b9-a05a-aef1850a0c38 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:43.805734 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-8f95dfc2-a329-45b9-a05a-aef1850a0c38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:43.807023 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 392/782] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:43.807928 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95dfc2-a329-45b9-a05a-aef1850a0c38 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:43.859685 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72d85c-f08f-478a-8413-c9f07b19af70 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:43.893031 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e21774-bae6-497d-9d3f-087effd54c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:43.894059 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e21774-bae6-497d-9d3f-087effd54c61 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:43.895104 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e21774-bae6-497d-9d3f-087effd54c61 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:43.895595 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e21774-bae6-497d-9d3f-087effd54c61 None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:43.896487 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e21774-bae6-497d-9d3f-087effd54c61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:43.898032 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e21774-bae6-497d-9d3f-087effd54c61 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:43.903661 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 391/783] 10.222.0.24 () {56 vars in 1087 bytes} [Mon Apr 11 23:43:43 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:43.904641 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e21774-bae6-497d-9d3f-087effd54c61 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:43.908795 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95dfc2-a329-45b9-a05a-aef1850a0c38 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:43.945584 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4837a3-d1c0-4cbd-91ed-3ebd2bb22329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:43.946173 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4837a3-d1c0-4cbd-91ed-3ebd2bb22329 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:43.946452 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4837a3-d1c0-4cbd-91ed-3ebd2bb22329 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:43.946725 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4837a3-d1c0-4cbd-91ed-3ebd2bb22329 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:43.947882 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4837a3-d1c0-4cbd-91ed-3ebd2bb22329 None admin] RBAC: Adding query filter params (interface=public, service_id=9a3f7d5f17d243e99c3686f0d9e0793a, region_id=RegionOne) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:43.947882 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4837a3-d1c0-4cbd-91ed-3ebd2bb22329 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:43.949267 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4837a3-d1c0-4cbd-91ed-3ebd2bb22329 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:43.960260 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 393/784] 10.222.0.24 () {56 vars in 1251 bytes} [Mon Apr 11 23:43:43 2022] GET /identity/v3/endpoints?service_id=9a3f7d5f17d243e99c3686f0d9e0793a&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:43.963052 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4837a3-d1c0-4cbd-91ed-3ebd2bb22329 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:44.110736 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e21774-bae6-497d-9d3f-087effd54c61 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:44.130801 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4837a3-d1c0-4cbd-91ed-3ebd2bb22329 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:44.162183 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62699b8a-eab5-4620-b330-26ec28ad7187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:44.162183 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62699b8a-eab5-4620-b330-26ec28ad7187 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:44.162470 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62699b8a-eab5-4620-b330-26ec28ad7187 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:44.162707 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62699b8a-eab5-4620-b330-26ec28ad7187 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:44.163908 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62699b8a-eab5-4620-b330-26ec28ad7187 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:44.164218 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62699b8a-eab5-4620-b330-26ec28ad7187 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:44.165607 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62699b8a-eab5-4620-b330-26ec28ad7187 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:44.180785 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f040d-fd7d-4319-9186-cdde5e355e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:44.181790 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f040d-fd7d-4319-9186-cdde5e355e2e None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:44.181977 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 392/785] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:44.182396 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f040d-fd7d-4319-9186-cdde5e355e2e None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:44.182807 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f040d-fd7d-4319-9186-cdde5e355e2e None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:44.183524 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f040d-fd7d-4319-9186-cdde5e355e2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:44.184904 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f040d-fd7d-4319-9186-cdde5e355e2e None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:44.192377 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62699b8a-eab5-4620-b330-26ec28ad7187 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:44.193475 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 394/786] 10.222.0.24 () {56 vars in 1087 bytes} [Mon Apr 11 23:43:43 2022] GET /identity/v3/services => generated 772 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:44.305308 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62699b8a-eab5-4620-b330-26ec28ad7187 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:44.346451 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451afad5-f189-4b01-a5d4-3e413812d77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:44.348270 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451afad5-f189-4b01-a5d4-3e413812d77e None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:44.348759 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451afad5-f189-4b01-a5d4-3e413812d77e None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:44.349248 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451afad5-f189-4b01-a5d4-3e413812d77e None admin] PATH_INFO: `/v3/users/nova` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:44.357362 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451afad5-f189-4b01-a5d4-3e413812d77e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:44.359100 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451afad5-f189-4b01-a5d4-3e413812d77e None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:44.377557 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-451afad5-f189-4b01-a5d4-3e413812d77e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 23:43:44.383786 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 393/787] 10.222.0.24 () {56 vars in 1093 bytes} [Mon Apr 11 23:43:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:44.390029 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f040d-fd7d-4319-9186-cdde5e355e2e None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:44.575144 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f040d-fd7d-4319-9186-cdde5e355e2e None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:44.608457 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce605de-9f7c-405e-8b50-aafe8d8f7662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:44.609129 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce605de-9f7c-405e-8b50-aafe8d8f7662 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:44.609402 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce605de-9f7c-405e-8b50-aafe8d8f7662 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:44.609668 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce605de-9f7c-405e-8b50-aafe8d8f7662 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:44.610498 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce605de-9f7c-405e-8b50-aafe8d8f7662 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:44.610801 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce605de-9f7c-405e-8b50-aafe8d8f7662 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:44.612254 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce605de-9f7c-405e-8b50-aafe8d8f7662 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:44.631315 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 395/788] 10.222.0.24 () {56 vars in 1133 bytes} [Mon Apr 11 23:43:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:44.636785 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451afad5-f189-4b01-a5d4-3e413812d77e None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:44.760798 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451afad5-f189-4b01-a5d4-3e413812d77e None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:44.779958 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628582d-dc2a-4d97-8dca-2c5178388020 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:44.780247 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628582d-dc2a-4d97-8dca-2c5178388020 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:44.780516 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628582d-dc2a-4d97-8dca-2c5178388020 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:44.782577 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 396/789] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:44.800303 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8f343-79b1-44b6-885f-6a1f1ea47738 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:44.801126 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8f343-79b1-44b6-885f-6a1f1ea47738 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:44.801408 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8f343-79b1-44b6-885f-6a1f1ea47738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:44.804512 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e958d6e-b7c6-4240-a491-f7531c0bba69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:44.805379 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e958d6e-b7c6-4240-a491-f7531c0bba69 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:44.805834 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e958d6e-b7c6-4240-a491-f7531c0bba69 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:44.806291 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e958d6e-b7c6-4240-a491-f7531c0bba69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:44.835931 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-cba8f343-79b1-44b6-885f-6a1f1ea47738 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:44.837057 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-cba8f343-79b1-44b6-885f-6a1f1ea47738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:44.880914 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e958d6e-b7c6-4240-a491-f7531c0bba69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:44.883053 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e958d6e-b7c6-4240-a491-f7531c0bba69 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:44.916456 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 397/790] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:43:44.918113 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a46ede-1767-4b9c-9c6b-b4cd0e59a673 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:44.918584 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a46ede-1767-4b9c-9c6b-b4cd0e59a673 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:44.919071 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a46ede-1767-4b9c-9c6b-b4cd0e59a673 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:44.921180 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 398/791] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:44.928156 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a81146-385b-48e8-94ec-c67ecf036f58 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:44.928438 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a81146-385b-48e8-94ec-c67ecf036f58 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:44.928713 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a81146-385b-48e8-94ec-c67ecf036f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:44.956500 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-41a81146-385b-48e8-94ec-c67ecf036f58 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:44.957728 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-41a81146-385b-48e8-94ec-c67ecf036f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:44.997064 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 394/792] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:43:44 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 23:43:45.002380 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e958d6e-b7c6-4240-a491-f7531c0bba69 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:45.042925 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 399/793] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:43:45.043869 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a81146-385b-48e8-94ec-c67ecf036f58 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:45.118983 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e958d6e-b7c6-4240-a491-f7531c0bba69 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:45.153105 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd47830-712e-485b-a538-0cc2a0750f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:45.154061 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd47830-712e-485b-a538-0cc2a0750f22 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:45.154649 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd47830-712e-485b-a538-0cc2a0750f22 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:45.154957 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd47830-712e-485b-a538-0cc2a0750f22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:45.160294 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a81146-385b-48e8-94ec-c67ecf036f58 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:45.168124 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd47830-712e-485b-a538-0cc2a0750f22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:45.177591 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-8bd47830-712e-485b-a538-0cc2a0750f22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:43:45.179487 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 395/794] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:45.180273 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd47830-712e-485b-a538-0cc2a0750f22 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:45.205010 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a622ec-1bdc-4619-9369-bf9cce9d945a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:45.205811 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a622ec-1bdc-4619-9369-bf9cce9d945a None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:45.206564 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a622ec-1bdc-4619-9369-bf9cce9d945a None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:45.206886 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a622ec-1bdc-4619-9369-bf9cce9d945a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:45.221074 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a622ec-1bdc-4619-9369-bf9cce9d945a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:45.223073 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a622ec-1bdc-4619-9369-bf9cce9d945a None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:45.245486 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-a4a622ec-1bdc-4619-9369-bf9cce9d945a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:45.251998 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 400/795] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:45.252866 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a622ec-1bdc-4619-9369-bf9cce9d945a None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:45.288824 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd47830-712e-485b-a538-0cc2a0750f22 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:45.327542 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50116047-7f03-418b-b82a-0d9ab2a60703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:45.328605 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50116047-7f03-418b-b82a-0d9ab2a60703 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:45.329039 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50116047-7f03-418b-b82a-0d9ab2a60703 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:45.329322 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50116047-7f03-418b-b82a-0d9ab2a60703 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:45.342957 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50116047-7f03-418b-b82a-0d9ab2a60703 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:45.351989 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-50116047-7f03-418b-b82a-0d9ab2a60703 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 23:43:45.354017 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 396/796] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:43:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:45.354823 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50116047-7f03-418b-b82a-0d9ab2a60703 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:45.376143 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a622ec-1bdc-4619-9369-bf9cce9d945a None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:45.411898 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63fdf1-a2ba-40e2-9059-299d1c0ad08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:45.412615 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63fdf1-a2ba-40e2-9059-299d1c0ad08d None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:45.412889 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63fdf1-a2ba-40e2-9059-299d1c0ad08d None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:45.413158 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d63fdf1-a2ba-40e2-9059-299d1c0ad08d None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:45.413945 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63fdf1-a2ba-40e2-9059-299d1c0ad08d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:45.414245 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63fdf1-a2ba-40e2-9059-299d1c0ad08d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:45.416147 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d63fdf1-a2ba-40e2-9059-299d1c0ad08d None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:45.429311 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 401/797] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:43:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:45.430180 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63fdf1-a2ba-40e2-9059-299d1c0ad08d None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:45.469635 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50116047-7f03-418b-b82a-0d9ab2a60703 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:45.503083 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2820f84-ec9b-4520-816b-319a9b266100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:45.503776 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2820f84-ec9b-4520-816b-319a9b266100 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:45.504057 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2820f84-ec9b-4520-816b-319a9b266100 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:45.504329 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2820f84-ec9b-4520-816b-319a9b266100 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:45.505058 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2820f84-ec9b-4520-816b-319a9b266100 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:45.505357 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2820f84-ec9b-4520-816b-319a9b266100 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:45.506710 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2820f84-ec9b-4520-816b-319a9b266100 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:45.522958 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 397/798] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:45.523866 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2820f84-ec9b-4520-816b-319a9b266100 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:45.533886 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d63fdf1-a2ba-40e2-9059-299d1c0ad08d None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:45.568926 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362f377-3564-43a6-bf50-5b728df46f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:45.569629 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362f377-3564-43a6-bf50-5b728df46f19 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:45.569907 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362f377-3564-43a6-bf50-5b728df46f19 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:45.570175 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0362f377-3564-43a6-bf50-5b728df46f19 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:45.570940 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362f377-3564-43a6-bf50-5b728df46f19 None admin] RBAC: Adding query filter params (name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:45.571243 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362f377-3564-43a6-bf50-5b728df46f19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:45.572657 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0362f377-3564-43a6-bf50-5b728df46f19 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:45.585903 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 402/799] 10.222.0.24 () {56 vars in 1103 bytes} [Mon Apr 11 23:43:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:45.586777 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362f377-3564-43a6-bf50-5b728df46f19 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:45.625567 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2820f84-ec9b-4520-816b-319a9b266100 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:45.659402 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef46c1-a8d3-4f5a-91df-92fa648a7cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:45.660732 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef46c1-a8d3-4f5a-91df-92fa648a7cb7 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:45.666858 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef46c1-a8d3-4f5a-91df-92fa648a7cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:45.666858 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef46c1-a8d3-4f5a-91df-92fa648a7cb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:45.671363 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef46c1-a8d3-4f5a-91df-92fa648a7cb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:45.672809 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef46c1-a8d3-4f5a-91df-92fa648a7cb7 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:45.686413 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0362f377-3564-43a6-bf50-5b728df46f19 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:45.689759 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-46ef46c1-a8d3-4f5a-91df-92fa648a7cb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:45.691816 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 398/800] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:45.692600 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef46c1-a8d3-4f5a-91df-92fa648a7cb7 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:45.729866 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96072e-df76-4ef4-ba41-2f24f7db6f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:45.730658 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96072e-df76-4ef4-ba41-2f24f7db6f36 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:45.730975 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96072e-df76-4ef4-ba41-2f24f7db6f36 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:45.731244 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd96072e-df76-4ef4-ba41-2f24f7db6f36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:45.738499 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96072e-df76-4ef4-ba41-2f24f7db6f36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:45.739909 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd96072e-df76-4ef4-ba41-2f24f7db6f36 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:45.754824 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-cd96072e-df76-4ef4-ba41-2f24f7db6f36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:45.762961 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 403/801] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:45.764451 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96072e-df76-4ef4-ba41-2f24f7db6f36 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:45.800179 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef46c1-a8d3-4f5a-91df-92fa648a7cb7 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:45.835332 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69bf51-4a02-4273-8307-9fa98356db93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:45.836478 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69bf51-4a02-4273-8307-9fa98356db93 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:45.836958 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69bf51-4a02-4273-8307-9fa98356db93 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:45.837428 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69bf51-4a02-4273-8307-9fa98356db93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:45.848204 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69bf51-4a02-4273-8307-9fa98356db93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:45.849888 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69bf51-4a02-4273-8307-9fa98356db93 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:45.865513 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd96072e-df76-4ef4-ba41-2f24f7db6f36 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:45.867653 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-2d69bf51-4a02-4273-8307-9fa98356db93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:45.869351 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 399/802] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:45.870314 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69bf51-4a02-4273-8307-9fa98356db93 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:45.904689 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a99a09-ea80-4186-9c99-d85b4281118b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:45.905339 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a99a09-ea80-4186-9c99-d85b4281118b None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:45.905617 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a99a09-ea80-4186-9c99-d85b4281118b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:45.905887 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a99a09-ea80-4186-9c99-d85b4281118b None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:45.906614 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a99a09-ea80-4186-9c99-d85b4281118b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:45.906927 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a99a09-ea80-4186-9c99-d85b4281118b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:45.908278 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a99a09-ea80-4186-9c99-d85b4281118b None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:45.924290 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 404/803] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:45.925090 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a99a09-ea80-4186-9c99-d85b4281118b None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:45.973477 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69bf51-4a02-4273-8307-9fa98356db93 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:46.007706 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32721d11-3370-4c3c-8341-5a90654e57f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:46.010168 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32721d11-3370-4c3c-8341-5a90654e57f4 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:46.010168 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32721d11-3370-4c3c-8341-5a90654e57f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:46.010168 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32721d11-3370-4c3c-8341-5a90654e57f4 None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:46.010168 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32721d11-3370-4c3c-8341-5a90654e57f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:46.010850 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32721d11-3370-4c3c-8341-5a90654e57f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:46.012552 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32721d11-3370-4c3c-8341-5a90654e57f4 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:46.024668 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a99a09-ea80-4186-9c99-d85b4281118b None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:46.025689 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 400/804] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:46.026757 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32721d11-3370-4c3c-8341-5a90654e57f4 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:46.065069 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff6cf9-aecd-47f0-9ddc-75e47e826c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:46.065835 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff6cf9-aecd-47f0-9ddc-75e47e826c5d None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:46.066816 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff6cf9-aecd-47f0-9ddc-75e47e826c5d None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:46.067187 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff6cf9-aecd-47f0-9ddc-75e47e826c5d None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:46.068028 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff6cf9-aecd-47f0-9ddc-75e47e826c5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:46.068395 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff6cf9-aecd-47f0-9ddc-75e47e826c5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:46.069821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff6cf9-aecd-47f0-9ddc-75e47e826c5d None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:46.082063 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 405/805] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:46.087478 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff6cf9-aecd-47f0-9ddc-75e47e826c5d None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:46.132928 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32721d11-3370-4c3c-8341-5a90654e57f4 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:46.167041 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef7fe4-c3fb-4866-8c74-be1434bfc1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:46.168170 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef7fe4-c3fb-4866-8c74-be1434bfc1c7 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:46.168637 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef7fe4-c3fb-4866-8c74-be1434bfc1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:46.169079 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bef7fe4-c3fb-4866-8c74-be1434bfc1c7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:46.177737 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef7fe4-c3fb-4866-8c74-be1434bfc1c7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:46.179426 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bef7fe4-c3fb-4866-8c74-be1434bfc1c7 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:46.190444 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff6cf9-aecd-47f0-9ddc-75e47e826c5d None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:46.193822 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-3bef7fe4-c3fb-4866-8c74-be1434bfc1c7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 23:43:46.195523 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 401/806] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:43:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:46.203532 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef7fe4-c3fb-4866-8c74-be1434bfc1c7 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:46.231056 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43501c7-37f5-4bb1-9edc-8bf3f451ccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:46.231712 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43501c7-37f5-4bb1-9edc-8bf3f451ccbc None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:46.232112 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43501c7-37f5-4bb1-9edc-8bf3f451ccbc None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:46.232335 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43501c7-37f5-4bb1-9edc-8bf3f451ccbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:46.233343 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43501c7-37f5-4bb1-9edc-8bf3f451ccbc None admin] RBAC: Adding query filter params (role.id=c8affbefb4c5462a921650b24b13c80f, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=a9519f49f897415a894c1121278dda9c) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:46.233465 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43501c7-37f5-4bb1-9edc-8bf3f451ccbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:46.234888 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43501c7-37f5-4bb1-9edc-8bf3f451ccbc None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:46.246996 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 406/807] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:43:46 2022] GET /identity/v3/role_assignments?user.id=a9519f49f897415a894c1121278dda9c&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=c8affbefb4c5462a921650b24b13c80f => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:46.248066 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43501c7-37f5-4bb1-9edc-8bf3f451ccbc None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:46.307473 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bef7fe4-c3fb-4866-8c74-be1434bfc1c7 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:46.343736 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37108060-61e1-49e2-afaf-16b6c1e579bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:46.344959 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37108060-61e1-49e2-afaf-16b6c1e579bf None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:46.345437 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37108060-61e1-49e2-afaf-16b6c1e579bf None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:46.345900 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37108060-61e1-49e2-afaf-16b6c1e579bf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:46.354456 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37108060-61e1-49e2-afaf-16b6c1e579bf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:46.356309 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37108060-61e1-49e2-afaf-16b6c1e579bf None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:46.379128 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43501c7-37f5-4bb1-9edc-8bf3f451ccbc None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:46.380060 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-37108060-61e1-49e2-afaf-16b6c1e579bf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 23:43:46.381831 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 402/808] 10.222.0.24 () {56 vars in 1117 bytes} [Mon Apr 11 23:43:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:46.403888 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37108060-61e1-49e2-afaf-16b6c1e579bf None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:46.422914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da5d16-8195-4106-b1ef-14f96a604098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:46.423584 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da5d16-8195-4106-b1ef-14f96a604098 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:46.423916 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da5d16-8195-4106-b1ef-14f96a604098 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:46.424382 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da5d16-8195-4106-b1ef-14f96a604098 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:46.425057 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da5d16-8195-4106-b1ef-14f96a604098 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:46.425359 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da5d16-8195-4106-b1ef-14f96a604098 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:46.435043 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24da5d16-8195-4106-b1ef-14f96a604098 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:46.451142 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 407/809] 10.222.0.24 () {56 vars in 1135 bytes} [Mon Apr 11 23:43:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:46.452691 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da5d16-8195-4106-b1ef-14f96a604098 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:46.545129 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37108060-61e1-49e2-afaf-16b6c1e579bf None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:46.577569 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da5d16-8195-4106-b1ef-14f96a604098 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:46.589754 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048baa7-e9a6-419a-aebd-34ec2d00204a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:46.590426 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048baa7-e9a6-419a-aebd-34ec2d00204a None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:46.590700 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048baa7-e9a6-419a-aebd-34ec2d00204a None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:46.591219 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048baa7-e9a6-419a-aebd-34ec2d00204a None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:46.591833 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048baa7-e9a6-419a-aebd-34ec2d00204a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:46.592139 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048baa7-e9a6-419a-aebd-34ec2d00204a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:46.593558 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048baa7-e9a6-419a-aebd-34ec2d00204a None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:46.622235 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 403/810] 10.222.0.24 () {56 vars in 1149 bytes} [Mon Apr 11 23:43:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:46.623472 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c66857-990b-4df8-b2dc-452e0c0ace7c None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:46.623472 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c66857-990b-4df8-b2dc-452e0c0ace7c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:46.623676 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c66857-990b-4df8-b2dc-452e0c0ace7c None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:46.625374 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 404/811] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:46.630639 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c66857-990b-4df8-b2dc-452e0c0ace7c None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:46.630979 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dafd24-50f6-446d-8fb0-ebf4763b60b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:46.631884 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dafd24-50f6-446d-8fb0-ebf4763b60b9 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:46.632161 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dafd24-50f6-446d-8fb0-ebf4763b60b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:46.632430 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dafd24-50f6-446d-8fb0-ebf4763b60b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:46.645215 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dafd24-50f6-446d-8fb0-ebf4763b60b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:46.646677 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2dafd24-50f6-446d-8fb0-ebf4763b60b9 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:46.665159 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-b2dafd24-50f6-446d-8fb0-ebf4763b60b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:46.666670 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 408/812] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:46.667953 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda0f6c-ad6a-4f83-96c1-3b1ac8d4be74 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:46.668231 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda0f6c-ad6a-4f83-96c1-3b1ac8d4be74 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:46.668497 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda0f6c-ad6a-4f83-96c1-3b1ac8d4be74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:46.686989 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-8dda0f6c-ad6a-4f83-96c1-3b1ac8d4be74 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:46.688113 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-8dda0f6c-ad6a-4f83-96c1-3b1ac8d4be74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:46.740987 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c66857-990b-4df8-b2dc-452e0c0ace7c None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:46.774473 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 409/813] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:43:46.775640 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda0f6c-ad6a-4f83-96c1-3b1ac8d4be74 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:46.786274 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c6e9d-2dba-4359-b343-674e48bf0663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:46.787148 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c6e9d-2dba-4359-b343-674e48bf0663 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:46.788980 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c6e9d-2dba-4359-b343-674e48bf0663 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:46.790660 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218c6e9d-2dba-4359-b343-674e48bf0663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:46.806145 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c6e9d-2dba-4359-b343-674e48bf0663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:46.807605 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218c6e9d-2dba-4359-b343-674e48bf0663 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:46.824427 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-218c6e9d-2dba-4359-b343-674e48bf0663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:46.825909 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 405/814] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:46.826689 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c6e9d-2dba-4359-b343-674e48bf0663 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:46.925087 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda0f6c-ad6a-4f83-96c1-3b1ac8d4be74 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:46.929878 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218c6e9d-2dba-4359-b343-674e48bf0663 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:46.965320 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfaf465-0e49-4082-8c9d-9b3d1d386fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:46.965649 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d0c5c-e09a-4a15-8498-2c40914b666c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:46.965908 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaf465-0e49-4082-8c9d-9b3d1d386fb6 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:46.966190 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaf465-0e49-4082-8c9d-9b3d1d386fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:46.966446 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d0c5c-e09a-4a15-8498-2c40914b666c None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:46.966547 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaf465-0e49-4082-8c9d-9b3d1d386fb6 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:46.966715 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d0c5c-e09a-4a15-8498-2c40914b666c None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:46.967033 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d0c5c-e09a-4a15-8498-2c40914b666c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:46.967213 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfaf465-0e49-4082-8c9d-9b3d1d386fb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:46.967509 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfaf465-0e49-4082-8c9d-9b3d1d386fb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:46.967684 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d0c5c-e09a-4a15-8498-2c40914b666c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:46.968881 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfaf465-0e49-4082-8c9d-9b3d1d386fb6 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:46.969056 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d0c5c-e09a-4a15-8498-2c40914b666c None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:46.981065 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-a60d0c5c-e09a-4a15-8498-2c40914b666c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Apr 11 23:43:46.981580 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 410/815] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:46.982439 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfaf465-0e49-4082-8c9d-9b3d1d386fb6 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:46.982556 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 406/816] 10.222.0.24 () {56 vars in 1129 bytes} [Mon Apr 11 23:43:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:46.987299 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d0c5c-e09a-4a15-8498-2c40914b666c None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:47.083335 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d0c5c-e09a-4a15-8498-2c40914b666c None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:47.083560 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfaf465-0e49-4082-8c9d-9b3d1d386fb6 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:47.115399 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cdcda-bfa8-4e33-93d7-b79b24ce1eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:47.115842 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b300f2-010d-44a4-821b-50c49e8911d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:47.116179 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cdcda-bfa8-4e33-93d7-b79b24ce1eac None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:47.116461 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cdcda-bfa8-4e33-93d7-b79b24ce1eac None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:47.116570 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b300f2-010d-44a4-821b-50c49e8911d9 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:47.116723 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cdcda-bfa8-4e33-93d7-b79b24ce1eac None admin] PATH_INFO: `/v3/projects/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:47.116816 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b300f2-010d-44a4-821b-50c49e8911d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:47.117021 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b300f2-010d-44a4-821b-50c49e8911d9 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:47.117731 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b300f2-010d-44a4-821b-50c49e8911d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:47.118033 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b300f2-010d-44a4-821b-50c49e8911d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:47.119417 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b300f2-010d-44a4-821b-50c49e8911d9 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:47.123223 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cdcda-bfa8-4e33-93d7-b79b24ce1eac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:47.124621 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746cdcda-bfa8-4e33-93d7-b79b24ce1eac None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:47.130605 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 411/817] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:47.131422 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b300f2-010d-44a4-821b-50c49e8911d9 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:47.142535 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-746cdcda-bfa8-4e33-93d7-b79b24ce1eac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:47.148668 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 407/818] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:47.148668 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78dd2c-aa5f-4672-90a2-61cde131afc7 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:47.148668 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78dd2c-aa5f-4672-90a2-61cde131afc7 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:47.148668 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78dd2c-aa5f-4672-90a2-61cde131afc7 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:47.148668 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 408/819] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:47.148668 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78dd2c-aa5f-4672-90a2-61cde131afc7 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:47.241435 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b300f2-010d-44a4-821b-50c49e8911d9 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:47.258499 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78dd2c-aa5f-4672-90a2-61cde131afc7 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:47.280374 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bde87-faed-4beb-aaf6-87f66a37d050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:47.281034 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bde87-faed-4beb-aaf6-87f66a37d050 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:47.281361 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bde87-faed-4beb-aaf6-87f66a37d050 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:47.281633 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bde87-faed-4beb-aaf6-87f66a37d050 None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:47.282366 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bde87-faed-4beb-aaf6-87f66a37d050 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:47.282795 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bde87-faed-4beb-aaf6-87f66a37d050 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:47.284185 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bde87-faed-4beb-aaf6-87f66a37d050 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:47.293840 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 412/820] 10.222.0.24 () {56 vars in 1124 bytes} [Mon Apr 11 23:43:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:47.293840 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bde87-faed-4beb-aaf6-87f66a37d050 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:47.299234 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08b9b6-1e68-4656-9ca6-9a39bbe21d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:47.300032 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08b9b6-1e68-4656-9ca6-9a39bbe21d05 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:47.300312 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08b9b6-1e68-4656-9ca6-9a39bbe21d05 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:47.301137 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08b9b6-1e68-4656-9ca6-9a39bbe21d05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:47.308094 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08b9b6-1e68-4656-9ca6-9a39bbe21d05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:47.309525 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e08b9b6-1e68-4656-9ca6-9a39bbe21d05 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:47.322727 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-6e08b9b6-1e68-4656-9ca6-9a39bbe21d05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:47.323944 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 409/821] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:47.328661 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd007f9-70e9-4999-90bc-6a2cf259d188 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:47.328661 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd007f9-70e9-4999-90bc-6a2cf259d188 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:47.328661 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd007f9-70e9-4999-90bc-6a2cf259d188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:47.342102 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-1fd007f9-70e9-4999-90bc-6a2cf259d188 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:47.343310 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1fd007f9-70e9-4999-90bc-6a2cf259d188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:47.406139 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bde87-faed-4beb-aaf6-87f66a37d050 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:47.423001 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 410/822] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:43:47.423001 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd007f9-70e9-4999-90bc-6a2cf259d188 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:47.448051 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcef862-fa49-40fe-8e00-acce1e62112b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:47.448702 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcef862-fa49-40fe-8e00-acce1e62112b None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:47.448982 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcef862-fa49-40fe-8e00-acce1e62112b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:47.449251 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcef862-fa49-40fe-8e00-acce1e62112b None admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:47.450023 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcef862-fa49-40fe-8e00-acce1e62112b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:47.450330 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcef862-fa49-40fe-8e00-acce1e62112b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:47.451785 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcef862-fa49-40fe-8e00-acce1e62112b None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:47.463058 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 413/823] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:47.463761 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcef862-fa49-40fe-8e00-acce1e62112b None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:47.523574 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd007f9-70e9-4999-90bc-6a2cf259d188 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:47.563503 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8deba-1a5c-4a81-92d1-6a860b517bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:47.564181 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8deba-1a5c-4a81-92d1-6a860b517bac None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:47.564462 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8deba-1a5c-4a81-92d1-6a860b517bac None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:47.564741 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8deba-1a5c-4a81-92d1-6a860b517bac None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:47.565568 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8deba-1a5c-4a81-92d1-6a860b517bac None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:47.565880 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8deba-1a5c-4a81-92d1-6a860b517bac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:47.567482 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcef862-fa49-40fe-8e00-acce1e62112b None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:47.576192 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8deba-1a5c-4a81-92d1-6a860b517bac None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:47.586684 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 411/824] 10.222.0.24 () {56 vars in 1124 bytes} [Mon Apr 11 23:43:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:47.586684 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8deba-1a5c-4a81-92d1-6a860b517bac None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:47.609346 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453298c-332d-4815-8d35-a99074cd54ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:47.610000 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453298c-332d-4815-8d35-a99074cd54ea None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:47.610275 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453298c-332d-4815-8d35-a99074cd54ea None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:47.610546 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453298c-332d-4815-8d35-a99074cd54ea None admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:47.611375 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453298c-332d-4815-8d35-a99074cd54ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:47.611680 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453298c-332d-4815-8d35-a99074cd54ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:47.613133 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453298c-332d-4815-8d35-a99074cd54ea None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:47.624806 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 414/825] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:47.625585 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453298c-332d-4815-8d35-a99074cd54ea None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:47.687817 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8deba-1a5c-4a81-92d1-6a860b517bac None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:47.722018 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675df8a-a6e5-4df1-8310-31577a006254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:47.723410 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675df8a-a6e5-4df1-8310-31577a006254 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:47.723693 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675df8a-a6e5-4df1-8310-31577a006254 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:47.723963 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d675df8a-a6e5-4df1-8310-31577a006254 None admin] PATH_INFO: `/v3/services/network` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:47.724626 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675df8a-a6e5-4df1-8310-31577a006254 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:47.725969 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d675df8a-a6e5-4df1-8310-31577a006254 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:47.727725 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453298c-332d-4815-8d35-a99074cd54ea None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:47.738606 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-d675df8a-a6e5-4df1-8310-31577a006254 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Apr 11 23:43:47.739995 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 412/826] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:47 2022] GET /identity/v3/services/network => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:47.740873 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675df8a-a6e5-4df1-8310-31577a006254 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:47.771622 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa01d83-d2cc-4ec3-85d0-20c27da87aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:47.772505 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa01d83-d2cc-4ec3-85d0-20c27da87aab None admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:47.772789 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa01d83-d2cc-4ec3-85d0-20c27da87aab None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:47.773058 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa01d83-d2cc-4ec3-85d0-20c27da87aab None admin] PATH_INFO: `/v3/projects/3563c87e56124c688a8029b4088cb198/users/189d616b38304d91bf1c7aded81205e3/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:47.775120 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa01d83-d2cc-4ec3-85d0-20c27da87aab None admin] RBAC: Authorizing `identity:create_grant(project_id=3563c87e56124c688a8029b4088cb198, user_id=189d616b38304d91bf1c7aded81205e3, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:47.776485 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa01d83-d2cc-4ec3-85d0-20c27da87aab None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:47.839390 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d675df8a-a6e5-4df1-8310-31577a006254 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:47.863365 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 415/827] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:43:47 2022] PUT /identity/v3/projects/3563c87e56124c688a8029b4088cb198/users/189d616b38304d91bf1c7aded81205e3/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:43:47.863365 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa01d83-d2cc-4ec3-85d0-20c27da87aab None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:47.889311 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36aef5-16b9-4b79-87ef-590d57fa411e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:47.890140 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36aef5-16b9-4b79-87ef-590d57fa411e None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:47.890492 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36aef5-16b9-4b79-87ef-590d57fa411e None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:47.890883 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc36aef5-16b9-4b79-87ef-590d57fa411e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:47.891795 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36aef5-16b9-4b79-87ef-590d57fa411e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:47.893328 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc36aef5-16b9-4b79-87ef-590d57fa411e None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:47.968425 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa01d83-d2cc-4ec3-85d0-20c27da87aab None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:48.006886 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f415e-1806-4b0d-a3d5-e63462133a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:48.008211 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f415e-1806-4b0d-a3d5-e63462133a9b None admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:48.008718 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f415e-1806-4b0d-a3d5-e63462133a9b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:48.009194 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f415e-1806-4b0d-a3d5-e63462133a9b None admin] PATH_INFO: `/v3/projects/3563c87e56124c688a8029b4088cb198/users/5c7b25e0e29143d783553859a0583d6a/roles/f4692fa2043d468fae733095d5740686` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:48.012964 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 413/828] 10.222.0.24 () {60 vars in 1144 bytes} [Mon Apr 11 23:43:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:43:48.015025 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36aef5-16b9-4b79-87ef-590d57fa411e None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:48.028301 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f415e-1806-4b0d-a3d5-e63462133a9b None admin] RBAC: Authorizing `identity:create_grant(project_id=3563c87e56124c688a8029b4088cb198, user_id=5c7b25e0e29143d783553859a0583d6a, role_id=f4692fa2043d468fae733095d5740686)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:48.030088 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f415e-1806-4b0d-a3d5-e63462133a9b None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:48.102043 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 416/829] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:43:47 2022] PUT /identity/v3/projects/3563c87e56124c688a8029b4088cb198/users/5c7b25e0e29143d783553859a0583d6a/roles/f4692fa2043d468fae733095d5740686 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:43:48.192964 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc36aef5-16b9-4b79-87ef-590d57fa411e None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:48.236103 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31737f-088d-438d-b2b4-4f05c480b778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:48.237035 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31737f-088d-438d-b2b4-4f05c480b778 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:48.237313 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31737f-088d-438d-b2b4-4f05c480b778 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:48.237583 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31737f-088d-438d-b2b4-4f05c480b778 None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:48.238933 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31737f-088d-438d-b2b4-4f05c480b778 None admin] RBAC: Adding query filter params (name=network) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:48.239309 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31737f-088d-438d-b2b4-4f05c480b778 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:48.240733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31737f-088d-438d-b2b4-4f05c480b778 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:48.246393 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 414/830] 10.222.0.24 () {56 vars in 1112 bytes} [Mon Apr 11 23:43:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:48.252289 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f415e-1806-4b0d-a3d5-e63462133a9b None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:48.360083 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f415e-1806-4b0d-a3d5-e63462133a9b None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:48.395161 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d3ace-e493-45e3-a8c2-6d2f71007740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:48.395829 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d3ace-e493-45e3-a8c2-6d2f71007740 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:48.396107 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d3ace-e493-45e3-a8c2-6d2f71007740 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:48.396373 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d3ace-e493-45e3-a8c2-6d2f71007740 None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:48.397080 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d3ace-e493-45e3-a8c2-6d2f71007740 None admin] RBAC: Adding query filter params (type=network) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:48.397379 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d3ace-e493-45e3-a8c2-6d2f71007740 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:48.398740 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d3ace-e493-45e3-a8c2-6d2f71007740 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:48.404058 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 417/831] 10.222.0.24 () {56 vars in 1112 bytes} [Mon Apr 11 23:43:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:48.410428 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31737f-088d-438d-b2b4-4f05c480b778 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:48.511374 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31737f-088d-438d-b2b4-4f05c480b778 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:48.545204 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf689c0-c3de-4f86-b63d-454fe469cf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:48.546157 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf689c0-c3de-4f86-b63d-454fe469cf9a None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:48.546641 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf689c0-c3de-4f86-b63d-454fe469cf9a None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:48.547115 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf689c0-c3de-4f86-b63d-454fe469cf9a None admin] PATH_INFO: `/v3/endpoints` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:48.548047 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf689c0-c3de-4f86-b63d-454fe469cf9a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:48.549650 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf689c0-c3de-4f86-b63d-454fe469cf9a None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:48.641996 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 415/832] 10.222.0.24 () {60 vars in 1144 bytes} [Mon Apr 11 23:43:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 23:43:49.009543 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc8213-6966-4306-8095-290a7f57fa8e None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:49.010029 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc8213-6966-4306-8095-290a7f57fa8e None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:49.010029 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc8213-6966-4306-8095-290a7f57fa8e None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:49.012096 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 418/833] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:49.017063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d148af9-dc86-4ae4-a53f-2a41a0133963 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:49.017478 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d148af9-dc86-4ae4-a53f-2a41a0133963 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:49.017650 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d148af9-dc86-4ae4-a53f-2a41a0133963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:49.037256 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-0d148af9-dc86-4ae4-a53f-2a41a0133963 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:49.038463 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-0d148af9-dc86-4ae4-a53f-2a41a0133963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:49.131777 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 416/834] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:43:49.154263 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc8213-6966-4306-8095-290a7f57fa8e None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:49.266094 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc8213-6966-4306-8095-290a7f57fa8e None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:49.304103 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa66ae-d6a0-453c-bc7c-f3142d84cb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:49.304961 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa66ae-d6a0-453c-bc7c-f3142d84cb45 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:49.305233 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa66ae-d6a0-453c-bc7c-f3142d84cb45 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:49.305547 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa66ae-d6a0-453c-bc7c-f3142d84cb45 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:49.306200 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa66ae-d6a0-453c-bc7c-f3142d84cb45 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:49.307579 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa66ae-d6a0-453c-bc7c-f3142d84cb45 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:49.318969 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-08aa66ae-d6a0-453c-bc7c-f3142d84cb45 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 11 23:43:49.320536 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 419/835] 10.222.0.24 () {56 vars in 1132 bytes} [Mon Apr 11 23:43:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:49.326076 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d148af9-dc86-4ae4-a53f-2a41a0133963 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:49.430063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d148af9-dc86-4ae4-a53f-2a41a0133963 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:49.465884 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eebeba-07b0-4b40-a1b6-276024c656a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:49.466572 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eebeba-07b0-4b40-a1b6-276024c656a6 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:49.466866 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eebeba-07b0-4b40-a1b6-276024c656a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:49.467144 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eebeba-07b0-4b40-a1b6-276024c656a6 None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:49.467861 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eebeba-07b0-4b40-a1b6-276024c656a6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:49.468163 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eebeba-07b0-4b40-a1b6-276024c656a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:49.469533 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eebeba-07b0-4b40-a1b6-276024c656a6 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:49.474887 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 417/836] 10.222.0.24 () {56 vars in 1126 bytes} [Mon Apr 11 23:43:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:49.483900 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa66ae-d6a0-453c-bc7c-f3142d84cb45 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:49.588429 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa66ae-d6a0-453c-bc7c-f3142d84cb45 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:49.623699 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e23b6-d4f6-4cae-9980-27092139933b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:49.624368 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e23b6-d4f6-4cae-9980-27092139933b None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:49.624645 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e23b6-d4f6-4cae-9980-27092139933b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:49.624913 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e23b6-d4f6-4cae-9980-27092139933b None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:49.625623 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e23b6-d4f6-4cae-9980-27092139933b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:49.625923 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e23b6-d4f6-4cae-9980-27092139933b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:49.627322 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e23b6-d4f6-4cae-9980-27092139933b None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:49.632309 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 420/837] 10.222.0.24 () {56 vars in 1126 bytes} [Mon Apr 11 23:43:49 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:50.338320 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee06136-35cf-4ac0-9845-0c295ccec4b1 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:50.338856 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee06136-35cf-4ac0-9845-0c295ccec4b1 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:50.338856 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee06136-35cf-4ac0-9845-0c295ccec4b1 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:50.341258 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 418/838] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:50.346479 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a941a93-09ef-4729-b54a-07a52f92c379 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:50.346889 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a941a93-09ef-4729-b54a-07a52f92c379 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:50.347053 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a941a93-09ef-4729-b54a-07a52f92c379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:50.369041 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-0a941a93-09ef-4729-b54a-07a52f92c379 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:50.370202 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-0a941a93-09ef-4729-b54a-07a52f92c379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:50.446993 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 421/839] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:43:50.463049 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee06136-35cf-4ac0-9845-0c295ccec4b1 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:50.566302 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee06136-35cf-4ac0-9845-0c295ccec4b1 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:50.601486 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb765f79-bb25-4fbb-bb58-cc673f5af604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:50.602274 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb765f79-bb25-4fbb-bb58-cc673f5af604 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:50.602549 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb765f79-bb25-4fbb-bb58-cc673f5af604 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:50.602820 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb765f79-bb25-4fbb-bb58-cc673f5af604 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:50.613186 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb765f79-bb25-4fbb-bb58-cc673f5af604 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:50.620034 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-cb765f79-bb25-4fbb-bb58-cc673f5af604 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:43:50.621515 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 419/840] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:43:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:50.627255 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a941a93-09ef-4729-b54a-07a52f92c379 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:50.645227 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602dab3-18dd-401e-abc8-c70374028c57 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:50.645853 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602dab3-18dd-401e-abc8-c70374028c57 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:50.646320 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602dab3-18dd-401e-abc8-c70374028c57 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:50.648556 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 420/841] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:43:50.655676 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2ee0c-5901-4a24-b918-07633db7b2b0 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:50.655971 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2ee0c-5901-4a24-b918-07633db7b2b0 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:50.656221 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2ee0c-5901-4a24-b918-07633db7b2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:50.678035 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-15e2ee0c-5901-4a24-b918-07633db7b2b0 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:50.679686 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-15e2ee0c-5901-4a24-b918-07633db7b2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:50.733163 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a941a93-09ef-4729-b54a-07a52f92c379 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:50.768085 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 421/842] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 23:43:50.772030 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664c7cd-6dfe-4eb6-8133-21b6a222beac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:50.773580 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664c7cd-6dfe-4eb6-8133-21b6a222beac None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:50.774069 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664c7cd-6dfe-4eb6-8133-21b6a222beac None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:50.774532 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664c7cd-6dfe-4eb6-8133-21b6a222beac None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:50.775543 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664c7cd-6dfe-4eb6-8133-21b6a222beac None admin] RBAC: Adding query filter params (name=admin) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:50.776038 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664c7cd-6dfe-4eb6-8133-21b6a222beac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:50.777581 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664c7cd-6dfe-4eb6-8133-21b6a222beac None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:50.787001 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2ee0c-5901-4a24-b918-07633db7b2b0 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:50.791052 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 422/843] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:43:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:50.793045 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664c7cd-6dfe-4eb6-8133-21b6a222beac None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:50.888294 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2ee0c-5901-4a24-b918-07633db7b2b0 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:50.889562 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664c7cd-6dfe-4eb6-8133-21b6a222beac None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:50.921132 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f565bcc-d8fd-4732-85eb-9b0e49399875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:50.921914 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f565bcc-d8fd-4732-85eb-9b0e49399875 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:50.922188 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f565bcc-d8fd-4732-85eb-9b0e49399875 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:50.922456 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f565bcc-d8fd-4732-85eb-9b0e49399875 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:50.923207 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e4c3d8-46ea-42ac-9abb-88dacad9d55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:50.923984 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4c3d8-46ea-42ac-9abb-88dacad9d55f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:50.924425 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4c3d8-46ea-42ac-9abb-88dacad9d55f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:50.924695 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e4c3d8-46ea-42ac-9abb-88dacad9d55f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:50.932259 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f565bcc-d8fd-4732-85eb-9b0e49399875 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:50.936006 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4c3d8-46ea-42ac-9abb-88dacad9d55f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:50.937425 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e4c3d8-46ea-42ac-9abb-88dacad9d55f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:50.939150 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-9f565bcc-d8fd-4732-85eb-9b0e49399875 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 23:43:50.940619 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 422/844] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:43:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:50.942044 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd63fb-00dd-44a3-8ac8-134c047ece41 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:50.942326 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd63fb-00dd-44a3-8ac8-134c047ece41 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:50.942597 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd63fb-00dd-44a3-8ac8-134c047ece41 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:50.944415 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 423/845] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:50.948749 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd63fb-00dd-44a3-8ac8-134c047ece41 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:50.959280 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-32e4c3d8-46ea-42ac-9abb-88dacad9d55f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:50.960945 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 423/846] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:50.962355 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d0657-d513-4d6e-9182-7cdf5ef6fbe7 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:50.962635 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d0657-d513-4d6e-9182-7cdf5ef6fbe7 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:50.962933 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d0657-d513-4d6e-9182-7cdf5ef6fbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:50.979635 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-e82d0657-d513-4d6e-9182-7cdf5ef6fbe7 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:50.980809 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-e82d0657-d513-4d6e-9182-7cdf5ef6fbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:51.045620 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 424/847] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:43:51.046553 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d0657-d513-4d6e-9182-7cdf5ef6fbe7 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:51.059585 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd63fb-00dd-44a3-8ac8-134c047ece41 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:51.093078 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2e523-0601-44f4-8ad4-45862ce224d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:51.093741 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2e523-0601-44f4-8ad4-45862ce224d8 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:51.094017 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2e523-0601-44f4-8ad4-45862ce224d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:51.094290 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca2e523-0601-44f4-8ad4-45862ce224d8 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:51.095061 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2e523-0601-44f4-8ad4-45862ce224d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:51.095361 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2e523-0601-44f4-8ad4-45862ce224d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:51.096711 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca2e523-0601-44f4-8ad4-45862ce224d8 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:51.105020 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 424/848] 10.222.0.24 () {56 vars in 1103 bytes} [Mon Apr 11 23:43:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:51.105791 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2e523-0601-44f4-8ad4-45862ce224d8 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:51.159793 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d0657-d513-4d6e-9182-7cdf5ef6fbe7 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:51.192774 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720f26e-10c4-44a7-9612-809604be5377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:51.193433 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720f26e-10c4-44a7-9612-809604be5377 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:51.193713 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720f26e-10c4-44a7-9612-809604be5377 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:51.193991 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720f26e-10c4-44a7-9612-809604be5377 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:51.194750 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720f26e-10c4-44a7-9612-809604be5377 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:51.195116 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720f26e-10c4-44a7-9612-809604be5377 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:51.196441 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720f26e-10c4-44a7-9612-809604be5377 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:51.202531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca2e523-0601-44f4-8ad4-45862ce224d8 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:51.213458 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 425/849] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:51.213458 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720f26e-10c4-44a7-9612-809604be5377 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:51.237673 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f993250-df63-41a1-a70d-45f7d43d2b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:51.238483 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f993250-df63-41a1-a70d-45f7d43d2b80 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:51.238757 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f993250-df63-41a1-a70d-45f7d43d2b80 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:51.239058 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f993250-df63-41a1-a70d-45f7d43d2b80 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:51.239703 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f993250-df63-41a1-a70d-45f7d43d2b80 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:51.241083 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f993250-df63-41a1-a70d-45f7d43d2b80 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:51.251946 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-8f993250-df63-41a1-a70d-45f7d43d2b80 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 11 23:43:51.258604 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 425/850] 10.222.0.24 () {56 vars in 1114 bytes} [Mon Apr 11 23:43:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:51.258604 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f993250-df63-41a1-a70d-45f7d43d2b80 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:51.313746 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720f26e-10c4-44a7-9612-809604be5377 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:51.346036 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b30e68-912f-4366-8dd6-770b829c9034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:51.346819 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b30e68-912f-4366-8dd6-770b829c9034 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:51.347943 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b30e68-912f-4366-8dd6-770b829c9034 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:51.347943 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b30e68-912f-4366-8dd6-770b829c9034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:51.354472 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f993250-df63-41a1-a70d-45f7d43d2b80 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:51.358457 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b30e68-912f-4366-8dd6-770b829c9034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:51.359907 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b30e68-912f-4366-8dd6-770b829c9034 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:51.375874 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-11b30e68-912f-4366-8dd6-770b829c9034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:51.381400 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 426/851] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:51.381400 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b30e68-912f-4366-8dd6-770b829c9034 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:51.386851 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98e296-b214-4fcb-a72c-00f4a5830545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:51.387645 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98e296-b214-4fcb-a72c-00f4a5830545 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:51.387924 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98e296-b214-4fcb-a72c-00f4a5830545 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:51.388196 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98e296-b214-4fcb-a72c-00f4a5830545 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:51.400502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98e296-b214-4fcb-a72c-00f4a5830545 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:51.403088 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98e296-b214-4fcb-a72c-00f4a5830545 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:51.417906 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-de98e296-b214-4fcb-a72c-00f4a5830545 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Apr 11 23:43:51.423668 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 426/852] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:43:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:51.423668 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98e296-b214-4fcb-a72c-00f4a5830545 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:51.483115 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b30e68-912f-4366-8dd6-770b829c9034 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:51.516003 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af3f7d-878d-46c8-9cb1-be430800ff0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:51.516648 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af3f7d-878d-46c8-9cb1-be430800ff0d None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:51.516920 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af3f7d-878d-46c8-9cb1-be430800ff0d None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:51.517186 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46af3f7d-878d-46c8-9cb1-be430800ff0d None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:51.517799 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98e296-b214-4fcb-a72c-00f4a5830545 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:51.517900 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af3f7d-878d-46c8-9cb1-be430800ff0d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:51.518172 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af3f7d-878d-46c8-9cb1-be430800ff0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:51.520140 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46af3f7d-878d-46c8-9cb1-be430800ff0d None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:51.528892 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 427/853] 10.222.0.24 () {56 vars in 1114 bytes} [Mon Apr 11 23:43:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:51.528892 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af3f7d-878d-46c8-9cb1-be430800ff0d None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:51.551967 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270e8e0-63cc-4c1e-a7c7-e6684fafa6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:51.552631 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270e8e0-63cc-4c1e-a7c7-e6684fafa6e8 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:51.552909 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270e8e0-63cc-4c1e-a7c7-e6684fafa6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:51.553185 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270e8e0-63cc-4c1e-a7c7-e6684fafa6e8 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:51.553903 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270e8e0-63cc-4c1e-a7c7-e6684fafa6e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:51.554203 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270e8e0-63cc-4c1e-a7c7-e6684fafa6e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:51.555622 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270e8e0-63cc-4c1e-a7c7-e6684fafa6e8 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:51.567560 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 427/854] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:51.568726 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270e8e0-63cc-4c1e-a7c7-e6684fafa6e8 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:51.638504 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46af3f7d-878d-46c8-9cb1-be430800ff0d None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:51.670712 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270e8e0-63cc-4c1e-a7c7-e6684fafa6e8 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:51.672137 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a18cd-12cf-43cd-ac2f-ebaf81726618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:51.672797 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a18cd-12cf-43cd-ac2f-ebaf81726618 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:51.673076 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a18cd-12cf-43cd-ac2f-ebaf81726618 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:51.673347 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a18cd-12cf-43cd-ac2f-ebaf81726618 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:51.674171 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a18cd-12cf-43cd-ac2f-ebaf81726618 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:51.674478 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a18cd-12cf-43cd-ac2f-ebaf81726618 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:51.675978 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292a18cd-12cf-43cd-ac2f-ebaf81726618 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:51.694267 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 428/855] 10.222.0.24 () {56 vars in 1135 bytes} [Mon Apr 11 23:43:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:51.695140 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a18cd-12cf-43cd-ac2f-ebaf81726618 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:51.714855 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4205c49-5530-4cff-8b57-1ec115f99252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:51.715546 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4205c49-5530-4cff-8b57-1ec115f99252 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:51.715824 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4205c49-5530-4cff-8b57-1ec115f99252 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:51.716430 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4205c49-5530-4cff-8b57-1ec115f99252 None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:51.716790 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4205c49-5530-4cff-8b57-1ec115f99252 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:51.717090 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4205c49-5530-4cff-8b57-1ec115f99252 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:51.718435 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4205c49-5530-4cff-8b57-1ec115f99252 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:51.723398 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 428/856] 10.222.0.24 () {56 vars in 1114 bytes} [Mon Apr 11 23:43:51 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:51.724154 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4205c49-5530-4cff-8b57-1ec115f99252 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:51.802194 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292a18cd-12cf-43cd-ac2f-ebaf81726618 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:51.839575 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6d255-5a76-430c-a729-990a6bc21df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:51.840689 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6d255-5a76-430c-a729-990a6bc21df4 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:51.841118 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6d255-5a76-430c-a729-990a6bc21df4 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:51.841546 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6d255-5a76-430c-a729-990a6bc21df4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:51.849957 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6d255-5a76-430c-a729-990a6bc21df4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:51.851687 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a6d255-5a76-430c-a729-990a6bc21df4 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:51.856856 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4205c49-5530-4cff-8b57-1ec115f99252 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:51.867419 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-a8a6d255-5a76-430c-a729-990a6bc21df4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 23:43:51.873921 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 429/857] 10.222.0.24 () {56 vars in 1117 bytes} [Mon Apr 11 23:43:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:51.875085 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6d255-5a76-430c-a729-990a6bc21df4 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:51.899169 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c70ab5-24db-4095-91ac-a4de012c0187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:51.899829 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c70ab5-24db-4095-91ac-a4de012c0187 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:51.900105 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c70ab5-24db-4095-91ac-a4de012c0187 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:51.900643 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c70ab5-24db-4095-91ac-a4de012c0187 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:51.980386 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6d255-5a76-430c-a729-990a6bc21df4 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:51.981276 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c70ab5-24db-4095-91ac-a4de012c0187 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:51.982708 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c70ab5-24db-4095-91ac-a4de012c0187 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:52.014233 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cf11d4-6eb8-421b-abbd-bb34ea499994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:52.014919 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf11d4-6eb8-421b-abbd-bb34ea499994 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:52.015195 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf11d4-6eb8-421b-abbd-bb34ea499994 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:52.015466 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cf11d4-6eb8-421b-abbd-bb34ea499994 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:52.016290 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf11d4-6eb8-421b-abbd-bb34ea499994 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:52.016590 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf11d4-6eb8-421b-abbd-bb34ea499994 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:52.017997 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cf11d4-6eb8-421b-abbd-bb34ea499994 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:52.040051 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 430/858] 10.222.0.24 () {56 vars in 1149 bytes} [Mon Apr 11 23:43:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:52.040051 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5246357-b1e2-4c83-9769-ab179e1b391f None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:52.040051 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5246357-b1e2-4c83-9769-ab179e1b391f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:52.040051 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5246357-b1e2-4c83-9769-ab179e1b391f None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:52.040051 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 431/859] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:52.044133 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5246357-b1e2-4c83-9769-ab179e1b391f None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:52.084426 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 429/860] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:43:51 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 23:43:52.086512 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84722b-d535-485c-a33a-6f9240f80a6a None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:52.086801 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84722b-d535-485c-a33a-6f9240f80a6a None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:52.087120 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c84722b-d535-485c-a33a-6f9240f80a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:52.106200 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-3c84722b-d535-485c-a33a-6f9240f80a6a None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:52.107061 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-3c84722b-d535-485c-a33a-6f9240f80a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:52.152946 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5246357-b1e2-4c83-9769-ab179e1b391f None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:52.182858 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 430/861] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:43:52.182858 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84722b-d535-485c-a33a-6f9240f80a6a None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:52.201255 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a0b14-d064-455d-ac9b-d2b7f2b75b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:52.201986 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a0b14-d064-455d-ac9b-d2b7f2b75b3e None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:52.202268 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a0b14-d064-455d-ac9b-d2b7f2b75b3e None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:52.202545 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a0b14-d064-455d-ac9b-d2b7f2b75b3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:52.270960 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c84722b-d535-485c-a33a-6f9240f80a6a None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:52.272195 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a0b14-d064-455d-ac9b-d2b7f2b75b3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:52.273741 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a0b14-d064-455d-ac9b-d2b7f2b75b3e None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:52.304548 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fefcca-3d9d-481f-8c02-11f6696e3c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:52.305537 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fefcca-3d9d-481f-8c02-11f6696e3c13 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:52.305810 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fefcca-3d9d-481f-8c02-11f6696e3c13 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:52.306079 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fefcca-3d9d-481f-8c02-11f6696e3c13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:52.316592 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fefcca-3d9d-481f-8c02-11f6696e3c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:52.318023 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fefcca-3d9d-481f-8c02-11f6696e3c13 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:52.338666 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-84fefcca-3d9d-481f-8c02-11f6696e3c13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:52.342975 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 431/862] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:52.343914 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fefcca-3d9d-481f-8c02-11f6696e3c13 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:52.381352 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 432/863] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:43:52 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 23:43:52.382813 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a0b14-d064-455d-ac9b-d2b7f2b75b3e None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:52.452976 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fefcca-3d9d-481f-8c02-11f6696e3c13 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:52.487369 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad53ed-263f-4c1b-b255-f6aa97734c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:52.488657 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad53ed-263f-4c1b-b255-f6aa97734c55 None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:52.488925 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad53ed-263f-4c1b-b255-f6aa97734c55 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:52.489242 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad53ed-263f-4c1b-b255-f6aa97734c55 None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:52.489914 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad53ed-263f-4c1b-b255-f6aa97734c55 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:52.491301 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad53ed-263f-4c1b-b255-f6aa97734c55 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:52.491398 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a0b14-d064-455d-ac9b-d2b7f2b75b3e None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:52.523339 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4272de8-8fc9-4268-9789-003f2354e9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:52.523905 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4272de8-8fc9-4268-9789-003f2354e9b5 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:52.524177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4272de8-8fc9-4268-9789-003f2354e9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:52.524439 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4272de8-8fc9-4268-9789-003f2354e9b5 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:52.525148 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4272de8-8fc9-4268-9789-003f2354e9b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:52.525462 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4272de8-8fc9-4268-9789-003f2354e9b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:52.526788 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4272de8-8fc9-4268-9789-003f2354e9b5 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:52.538048 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 433/864] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:52.538824 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4272de8-8fc9-4268-9789-003f2354e9b5 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:52.558484 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 432/865] 10.222.0.24 () {60 vars in 1141 bytes} [Mon Apr 11 23:43:52 2022] POST /identity/v3/services => generated 269 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:43:52.559610 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad53ed-263f-4c1b-b255-f6aa97734c55 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:52.676613 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4272de8-8fc9-4268-9789-003f2354e9b5 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:52.686872 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad53ed-263f-4c1b-b255-f6aa97734c55 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:52.713043 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd0696-713a-406b-a8b2-e8411b033f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:52.714231 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd0696-713a-406b-a8b2-e8411b033f1d None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:52.714587 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd0696-713a-406b-a8b2-e8411b033f1d None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:52.714979 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd0696-713a-406b-a8b2-e8411b033f1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:52.727467 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd0696-713a-406b-a8b2-e8411b033f1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:52.729087 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd0696-713a-406b-a8b2-e8411b033f1d None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:52.730663 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7023b3c-ced2-4895-8a46-aa96d94e56c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:52.731736 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7023b3c-ced2-4895-8a46-aa96d94e56c7 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:52.732398 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7023b3c-ced2-4895-8a46-aa96d94e56c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:52.732676 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7023b3c-ced2-4895-8a46-aa96d94e56c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:52.742877 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7023b3c-ced2-4895-8a46-aa96d94e56c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:52.744316 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7023b3c-ced2-4895-8a46-aa96d94e56c7 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:52.748055 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-1abd0696-713a-406b-a8b2-e8411b033f1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:52.749647 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 434/866] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:52.758736 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-e7023b3c-ced2-4895-8a46-aa96d94e56c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:52.760241 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 433/867] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:52.760667 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd0696-713a-406b-a8b2-e8411b033f1d None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:52.766382 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7023b3c-ced2-4895-8a46-aa96d94e56c7 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:52.872680 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7023b3c-ced2-4895-8a46-aa96d94e56c7 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:52.886735 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd0696-713a-406b-a8b2-e8411b033f1d None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:52.915994 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b574b0-a707-4821-b77a-ce872c410209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:52.916653 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b574b0-a707-4821-b77a-ce872c410209 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:52.916929 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b574b0-a707-4821-b77a-ce872c410209 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:52.917195 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b574b0-a707-4821-b77a-ce872c410209 None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:52.917972 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b574b0-a707-4821-b77a-ce872c410209 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:52.918273 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b574b0-a707-4821-b77a-ce872c410209 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:52.919707 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b574b0-a707-4821-b77a-ce872c410209 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:52.930039 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d35d8-8ec1-409f-a973-6c102f049d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:52.930749 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d35d8-8ec1-409f-a973-6c102f049d55 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:52.931052 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d35d8-8ec1-409f-a973-6c102f049d55 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:52.931325 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9d35d8-8ec1-409f-a973-6c102f049d55 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:52.931769 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 434/868] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:52.932249 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d35d8-8ec1-409f-a973-6c102f049d55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:52.932553 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d35d8-8ec1-409f-a973-6c102f049d55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:52.933898 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9d35d8-8ec1-409f-a973-6c102f049d55 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:52.941163 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b574b0-a707-4821-b77a-ce872c410209 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:52.951218 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 435/869] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:52.957421 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d35d8-8ec1-409f-a973-6c102f049d55 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:53.047135 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b574b0-a707-4821-b77a-ce872c410209 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:53.069874 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9d35d8-8ec1-409f-a973-6c102f049d55 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:53.089486 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6a0d8-ff41-43e1-b5aa-9346e9f90c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:53.090733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6a0d8-ff41-43e1-b5aa-9346e9f90c68 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:53.091212 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6a0d8-ff41-43e1-b5aa-9346e9f90c68 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:53.091873 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6a0d8-ff41-43e1-b5aa-9346e9f90c68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:53.093003 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6a0d8-ff41-43e1-b5aa-9346e9f90c68 None admin] RBAC: Adding query filter params (role.id=c8affbefb4c5462a921650b24b13c80f, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=189d616b38304d91bf1c7aded81205e3) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:53.093768 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6a0d8-ff41-43e1-b5aa-9346e9f90c68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:53.095793 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6a0d8-ff41-43e1-b5aa-9346e9f90c68 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:53.111015 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 435/870] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:43:52 2022] GET /identity/v3/role_assignments?user.id=189d616b38304d91bf1c7aded81205e3&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=c8affbefb4c5462a921650b24b13c80f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:53.113006 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd91916-108f-41c6-adf5-28b7956388a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:53.113999 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd91916-108f-41c6-adf5-28b7956388a3 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:53.114430 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd91916-108f-41c6-adf5-28b7956388a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:53.114869 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd91916-108f-41c6-adf5-28b7956388a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:53.123095 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd91916-108f-41c6-adf5-28b7956388a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:53.124866 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd91916-108f-41c6-adf5-28b7956388a3 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:53.139491 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-dcd91916-108f-41c6-adf5-28b7956388a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:53.141325 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 436/871] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:53.147880 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6a0d8-ff41-43e1-b5aa-9346e9f90c68 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:53.258776 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6a0d8-ff41-43e1-b5aa-9346e9f90c68 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:53.295285 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06364d1-53ef-4d9c-bb74-863a46c51735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:53.296278 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06364d1-53ef-4d9c-bb74-863a46c51735 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:53.296559 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06364d1-53ef-4d9c-bb74-863a46c51735 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:53.296834 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06364d1-53ef-4d9c-bb74-863a46c51735 None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:53.297622 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06364d1-53ef-4d9c-bb74-863a46c51735 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:53.297930 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06364d1-53ef-4d9c-bb74-863a46c51735 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:53.299383 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06364d1-53ef-4d9c-bb74-863a46c51735 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:53.312211 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 436/872] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:53.318507 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd91916-108f-41c6-adf5-28b7956388a3 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:53.418978 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd91916-108f-41c6-adf5-28b7956388a3 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:53.452785 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49e39a-aab5-4c07-8057-96606779de3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:53.453490 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49e39a-aab5-4c07-8057-96606779de3d None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:53.453774 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49e39a-aab5-4c07-8057-96606779de3d None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:53.454048 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49e39a-aab5-4c07-8057-96606779de3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:53.454911 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49e39a-aab5-4c07-8057-96606779de3d None admin] RBAC: Adding query filter params (role.id=f4692fa2043d468fae733095d5740686, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=5c7b25e0e29143d783553859a0583d6a) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:53.455221 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49e39a-aab5-4c07-8057-96606779de3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:53.457209 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49e39a-aab5-4c07-8057-96606779de3d None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:53.463485 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 437/873] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:43:53 2022] GET /identity/v3/role_assignments?user.id=5c7b25e0e29143d783553859a0583d6a&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=f4692fa2043d468fae733095d5740686 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:54.084966 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4446d-b20e-42ad-b971-3dc16a6ea2f4 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:54.085979 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4446d-b20e-42ad-b971-3dc16a6ea2f4 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:54.086464 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d4446d-b20e-42ad-b971-3dc16a6ea2f4 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:54.088767 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 437/874] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:54.094266 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec15220-90d1-43ca-8504-cc54fe24d713 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:54.094786 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec15220-90d1-43ca-8504-cc54fe24d713 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:54.095298 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec15220-90d1-43ca-8504-cc54fe24d713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:54.114200 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-4ec15220-90d1-43ca-8504-cc54fe24d713 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:54.115709 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-4ec15220-90d1-43ca-8504-cc54fe24d713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:54.185918 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 438/875] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:54 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:43:54.205184 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4446d-b20e-42ad-b971-3dc16a6ea2f4 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:54.308634 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d4446d-b20e-42ad-b971-3dc16a6ea2f4 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:54.345982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61702c-05b2-4ad8-bd78-42cbe98852b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:54.346569 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61702c-05b2-4ad8-bd78-42cbe98852b6 None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:54.346859 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61702c-05b2-4ad8-bd78-42cbe98852b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:54.347199 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61702c-05b2-4ad8-bd78-42cbe98852b6 None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:54.348442 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61702c-05b2-4ad8-bd78-42cbe98852b6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:54.349797 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61702c-05b2-4ad8-bd78-42cbe98852b6 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:54.476507 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 438/876] 10.222.0.24 () {60 vars in 1141 bytes} [Mon Apr 11 23:43:54 2022] POST /identity/v3/services => generated 251 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:43:54.915948 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef461ca2-767e-473a-aaff-47483a3e3eea None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:54.916450 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef461ca2-767e-473a-aaff-47483a3e3eea None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:54.916552 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef461ca2-767e-473a-aaff-47483a3e3eea None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:54.918466 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 439/877] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:54.923783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b5ac2-38bf-4e5d-b74b-4d4aebb7ec12 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:54.924066 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b5ac2-38bf-4e5d-b74b-4d4aebb7ec12 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:54.924338 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525b5ac2-38bf-4e5d-b74b-4d4aebb7ec12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:54.944017 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-525b5ac2-38bf-4e5d-b74b-4d4aebb7ec12 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:54.945195 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-525b5ac2-38bf-4e5d-b74b-4d4aebb7ec12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:55.018196 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 439/878] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:54 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:43:55.042389 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef461ca2-767e-473a-aaff-47483a3e3eea None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:55.145115 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef461ca2-767e-473a-aaff-47483a3e3eea None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:55.179556 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae07d1-15cd-46bb-8dfc-cba25643ca7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:55.180351 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae07d1-15cd-46bb-8dfc-cba25643ca7f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:55.180623 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae07d1-15cd-46bb-8dfc-cba25643ca7f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:55.180888 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ae07d1-15cd-46bb-8dfc-cba25643ca7f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:55.181537 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae07d1-15cd-46bb-8dfc-cba25643ca7f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:55.182904 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ae07d1-15cd-46bb-8dfc-cba25643ca7f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:55.194045 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-15ae07d1-15cd-46bb-8dfc-cba25643ca7f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 11 23:43:55.195553 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 440/879] 10.222.0.24 () {56 vars in 1132 bytes} [Mon Apr 11 23:43:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:55.201286 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b5ac2-38bf-4e5d-b74b-4d4aebb7ec12 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:55.300638 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525b5ac2-38bf-4e5d-b74b-4d4aebb7ec12 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:55.334676 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c1c370-66c8-4b55-8f0b-58ac3b3699c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:55.335371 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1c370-66c8-4b55-8f0b-58ac3b3699c3 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:55.335643 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1c370-66c8-4b55-8f0b-58ac3b3699c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:55.335908 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c1c370-66c8-4b55-8f0b-58ac3b3699c3 None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:55.336615 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1c370-66c8-4b55-8f0b-58ac3b3699c3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:55.336910 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1c370-66c8-4b55-8f0b-58ac3b3699c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:55.338254 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c1c370-66c8-4b55-8f0b-58ac3b3699c3 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:55.343711 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 440/880] 10.222.0.24 () {56 vars in 1126 bytes} [Mon Apr 11 23:43:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:55.349818 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae07d1-15cd-46bb-8dfc-cba25643ca7f None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:55.449554 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ae07d1-15cd-46bb-8dfc-cba25643ca7f None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:55.473044 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4c961-8788-460d-ada9-fe47ee470187 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:55.473661 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4c961-8788-460d-ada9-fe47ee470187 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:55.474155 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab4c961-8788-460d-ada9-fe47ee470187 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:55.480139 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 441/881] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:55.482144 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a064f80-4820-40bf-b023-1ffb15b1790c None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:55.482631 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a064f80-4820-40bf-b023-1ffb15b1790c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:55.483135 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a064f80-4820-40bf-b023-1ffb15b1790c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:55.494820 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fc9f6-f11b-453e-ac36-9afd1276d579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:55.495832 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fc9f6-f11b-453e-ac36-9afd1276d579 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:55.496318 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fc9f6-f11b-453e-ac36-9afd1276d579 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:55.496793 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4fc9f6-f11b-453e-ac36-9afd1276d579 None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:55.497693 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fc9f6-f11b-453e-ac36-9afd1276d579 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:55.498198 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fc9f6-f11b-453e-ac36-9afd1276d579 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:55.499893 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4fc9f6-f11b-453e-ac36-9afd1276d579 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:55.500211 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-8a064f80-4820-40bf-b023-1ffb15b1790c None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:55.501401 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-8a064f80-4820-40bf-b023-1ffb15b1790c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:55.506387 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 441/882] 10.222.0.24 () {56 vars in 1126 bytes} [Mon Apr 11 23:43:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:55.512389 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fc9f6-f11b-453e-ac36-9afd1276d579 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:55.594929 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 442/883] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:43:55.609082 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a064f80-4820-40bf-b023-1ffb15b1790c None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:55.645624 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4fc9f6-f11b-453e-ac36-9afd1276d579 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:55.684068 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2cff9-f2e5-43e9-a645-237e0d98f825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:55.685080 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2cff9-f2e5-43e9-a645-237e0d98f825 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:55.685573 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2cff9-f2e5-43e9-a645-237e0d98f825 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:55.686047 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2cff9-f2e5-43e9-a645-237e0d98f825 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:55.687076 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2cff9-f2e5-43e9-a645-237e0d98f825 None admin] RBAC: Adding query filter params (interface=public, service_id=577f8ed3499c4e73bbba17dc587ed302, region_id=RegionOne) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:55.687593 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2cff9-f2e5-43e9-a645-237e0d98f825 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:55.689132 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2cff9-f2e5-43e9-a645-237e0d98f825 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:55.695096 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 442/884] 10.222.0.24 () {56 vars in 1251 bytes} [Mon Apr 11 23:43:55 2022] GET /identity/v3/endpoints?service_id=577f8ed3499c4e73bbba17dc587ed302&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:55.700048 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2cff9-f2e5-43e9-a645-237e0d98f825 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:55.741636 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a064f80-4820-40bf-b023-1ffb15b1790c None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:55.790109 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0fb78-3645-4eac-9520-90195cb4a8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:55.791653 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0fb78-3645-4eac-9520-90195cb4a8f9 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:55.792365 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0fb78-3645-4eac-9520-90195cb4a8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:55.792818 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0fb78-3645-4eac-9520-90195cb4a8f9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:55.793815 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0fb78-3645-4eac-9520-90195cb4a8f9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:55.795797 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0fb78-3645-4eac-9520-90195cb4a8f9 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:55.806555 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2cff9-f2e5-43e9-a645-237e0d98f825 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:55.812524 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-94d0fb78-3645-4eac-9520-90195cb4a8f9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 23:43:55.814645 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 443/885] 10.222.0.24 () {56 vars in 1126 bytes} [Mon Apr 11 23:43:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:55.821225 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0fb78-3645-4eac-9520-90195cb4a8f9 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:55.847756 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9e0e7-5198-4ad8-bbd2-b589a383f868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:55.848397 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9e0e7-5198-4ad8-bbd2-b589a383f868 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:55.848675 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9e0e7-5198-4ad8-bbd2-b589a383f868 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:55.848944 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9e0e7-5198-4ad8-bbd2-b589a383f868 None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:55.849942 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9e0e7-5198-4ad8-bbd2-b589a383f868 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:55.851802 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9e0e7-5198-4ad8-bbd2-b589a383f868 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:55.863289 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 443/886] 10.222.0.24 () {56 vars in 1087 bytes} [Mon Apr 11 23:43:55 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 23:43:55.936439 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0fb78-3645-4eac-9520-90195cb4a8f9 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:55.945283 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a2b93-e7a5-4975-8884-973bc8e86937 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:55.945828 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a2b93-e7a5-4975-8884-973bc8e86937 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:55.945828 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a2b93-e7a5-4975-8884-973bc8e86937 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:55.947938 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 444/887] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:43:55.953582 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3dfef-a075-4411-9a1c-8b731010aa58 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:55.954189 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3dfef-a075-4411-9a1c-8b731010aa58 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:55.954562 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3dfef-a075-4411-9a1c-8b731010aa58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:55.972388 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-e1f3dfef-a075-4411-9a1c-8b731010aa58 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:55.973917 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-e1f3dfef-a075-4411-9a1c-8b731010aa58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:55.977015 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaa68d-bc9c-43b3-b838-442cc25f6b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:55.978612 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaa68d-bc9c-43b3-b838-442cc25f6b9b None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:55.978928 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaa68d-bc9c-43b3-b838-442cc25f6b9b None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:55.979214 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbaa68d-bc9c-43b3-b838-442cc25f6b9b None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:55.980070 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbaa68d-bc9c-43b3-b838-442cc25f6b9b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:55.980379 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbaa68d-bc9c-43b3-b838-442cc25f6b9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:55.981786 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbaa68d-bc9c-43b3-b838-442cc25f6b9b None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:55.993646 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 444/888] 10.222.0.24 () {56 vars in 1122 bytes} [Mon Apr 11 23:43:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:55.995222 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaa68d-bc9c-43b3-b838-442cc25f6b9b None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:56.062858 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 445/889] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:55 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:43:56.078772 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3dfef-a075-4411-9a1c-8b731010aa58 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:56.127187 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbaa68d-bc9c-43b3-b838-442cc25f6b9b None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:56.164992 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676b8e3-6ae7-4a41-9695-8aff904bcdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:56.165898 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676b8e3-6ae7-4a41-9695-8aff904bcdb4 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:56.166344 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676b8e3-6ae7-4a41-9695-8aff904bcdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:56.166767 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676b8e3-6ae7-4a41-9695-8aff904bcdb4 None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:56.167682 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676b8e3-6ae7-4a41-9695-8aff904bcdb4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:56.168136 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676b8e3-6ae7-4a41-9695-8aff904bcdb4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:56.169634 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676b8e3-6ae7-4a41-9695-8aff904bcdb4 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:56.174585 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 445/890] 10.222.0.24 () {56 vars in 1122 bytes} [Mon Apr 11 23:43:55 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:56.205770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3dfef-a075-4411-9a1c-8b731010aa58 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:56.245428 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae65b3-4a6f-4d58-811b-311c61fa5adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:56.246263 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae65b3-4a6f-4d58-811b-311c61fa5adf None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:56.246544 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae65b3-4a6f-4d58-811b-311c61fa5adf None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:56.246816 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ae65b3-4a6f-4d58-811b-311c61fa5adf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:56.258998 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ae65b3-4a6f-4d58-811b-311c61fa5adf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:43:56.266741 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-12ae65b3-4a6f-4d58-811b-311c61fa5adf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 23:43:56.268435 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 446/891] 10.222.0.24 () {56 vars in 1120 bytes} [Mon Apr 11 23:43:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:56.274367 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676b8e3-6ae7-4a41-9695-8aff904bcdb4 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:56.383141 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676b8e3-6ae7-4a41-9695-8aff904bcdb4 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:56.422706 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a92c3-0200-4eae-a6da-12f2a1c4b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:56.423750 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a92c3-0200-4eae-a6da-12f2a1c4b99d None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:56.424231 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a92c3-0200-4eae-a6da-12f2a1c4b99d None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:56.424680 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4a92c3-0200-4eae-a6da-12f2a1c4b99d None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:56.426311 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a92c3-0200-4eae-a6da-12f2a1c4b99d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:56.426795 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a92c3-0200-4eae-a6da-12f2a1c4b99d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:56.428364 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4a92c3-0200-4eae-a6da-12f2a1c4b99d None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:56.437016 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 446/892] 10.222.0.24 () {56 vars in 1115 bytes} [Mon Apr 11 23:43:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:56.442768 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae65b3-4a6f-4d58-811b-311c61fa5adf None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:56.547426 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ae65b3-4a6f-4d58-811b-311c61fa5adf None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:56.581262 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956122d-b3dc-425b-a7ca-f9df3b2c853b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:56.582909 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956122d-b3dc-425b-a7ca-f9df3b2c853b None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:56.583388 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956122d-b3dc-425b-a7ca-f9df3b2c853b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:56.583846 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956122d-b3dc-425b-a7ca-f9df3b2c853b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:56.595983 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956122d-b3dc-425b-a7ca-f9df3b2c853b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:56.598331 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956122d-b3dc-425b-a7ca-f9df3b2c853b None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:56.615340 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-4956122d-b3dc-425b-a7ca-f9df3b2c853b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:56.617102 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 447/893] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:56.622757 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a92c3-0200-4eae-a6da-12f2a1c4b99d None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:56.723986 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4a92c3-0200-4eae-a6da-12f2a1c4b99d None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:56.760565 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5c709-d1d8-42c5-b374-5db7f52eeef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:56.761531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5c709-d1d8-42c5-b374-5db7f52eeef6 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:56.762012 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5c709-d1d8-42c5-b374-5db7f52eeef6 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:56.762463 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5c709-d1d8-42c5-b374-5db7f52eeef6 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:56.763411 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5c709-d1d8-42c5-b374-5db7f52eeef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:56.763896 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5c709-d1d8-42c5-b374-5db7f52eeef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:56.765448 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5c709-d1d8-42c5-b374-5db7f52eeef6 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:56.778687 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 447/894] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:56.784087 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956122d-b3dc-425b-a7ca-f9df3b2c853b None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:56.846644 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071c2b7-cb60-4e4d-8e62-4796354203d5 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:56.846957 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071c2b7-cb60-4e4d-8e62-4796354203d5 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:56.847808 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071c2b7-cb60-4e4d-8e62-4796354203d5 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:56.850538 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 448/895] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:43:56.857762 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8be1e-dc08-4e40-aaec-fddcfb3fca01 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:56.858309 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8be1e-dc08-4e40-aaec-fddcfb3fca01 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:56.858814 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8be1e-dc08-4e40-aaec-fddcfb3fca01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:56.875567 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-e4c8be1e-dc08-4e40-aaec-fddcfb3fca01 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:56.877042 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-e4c8be1e-dc08-4e40-aaec-fddcfb3fca01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:56.891011 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956122d-b3dc-425b-a7ca-f9df3b2c853b None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:56.924403 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e47b4-fdf4-4411-bc50-c77a222f5c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:56.925239 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e47b4-fdf4-4411-bc50-c77a222f5c4f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:56.925523 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e47b4-fdf4-4411-bc50-c77a222f5c4f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:56.925803 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2e47b4-fdf4-4411-bc50-c77a222f5c4f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:56.933627 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e47b4-fdf4-4411-bc50-c77a222f5c4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:56.935101 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2e47b4-fdf4-4411-bc50-c77a222f5c4f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:56.949808 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-8a2e47b4-fdf4-4411-bc50-c77a222f5c4f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 23:43:56.951587 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 448/896] 10.222.0.24 () {56 vars in 1117 bytes} [Mon Apr 11 23:43:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:56.957570 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e47b4-fdf4-4411-bc50-c77a222f5c4f None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:56.960579 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 449/897] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:56 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Apr 11 23:43:56.983372 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8be1e-dc08-4e40-aaec-fddcfb3fca01 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:57.061302 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2e47b4-fdf4-4411-bc50-c77a222f5c4f None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:57.101161 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8be1e-dc08-4e40-aaec-fddcfb3fca01 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:57.106106 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8769a0-f469-434b-ac6f-750faa45d49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:57.107053 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8769a0-f469-434b-ac6f-750faa45d49d None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:57.107549 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8769a0-f469-434b-ac6f-750faa45d49d None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:57.108011 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8769a0-f469-434b-ac6f-750faa45d49d None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:57.109461 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8769a0-f469-434b-ac6f-750faa45d49d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:57.109979 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8769a0-f469-434b-ac6f-750faa45d49d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:57.111970 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8769a0-f469-434b-ac6f-750faa45d49d None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:57.135031 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 449/898] 10.222.0.24 () {56 vars in 1149 bytes} [Mon Apr 11 23:43:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:57.140494 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b74e59-d86d-4239-b5ea-63427e96339e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:57.141507 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b74e59-d86d-4239-b5ea-63427e96339e None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:57.141967 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b74e59-d86d-4239-b5ea-63427e96339e None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:57.142410 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b74e59-d86d-4239-b5ea-63427e96339e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:57.144853 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8769a0-f469-434b-ac6f-750faa45d49d None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:57.145244 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b74e59-d86d-4239-b5ea-63427e96339e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:57.146606 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b74e59-d86d-4239-b5ea-63427e96339e None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:57.164972 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-27b74e59-d86d-4239-b5ea-63427e96339e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 11 23:43:57.166725 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 450/899] 10.222.0.24 () {56 vars in 1114 bytes} [Mon Apr 11 23:43:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:57.172380 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b74e59-d86d-4239-b5ea-63427e96339e None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:57.263267 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8769a0-f469-434b-ac6f-750faa45d49d None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:57.272524 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b74e59-d86d-4239-b5ea-63427e96339e None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:57.299160 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbfe98-e1c5-4d64-9a39-6a92f8cf53d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:57.299943 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbfe98-e1c5-4d64-9a39-6a92f8cf53d9 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:57.300748 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbfe98-e1c5-4d64-9a39-6a92f8cf53d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:57.301094 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cbfe98-e1c5-4d64-9a39-6a92f8cf53d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:57.314637 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb34405-33dd-45d2-90b9-e23ee6e8ac0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:57.316886 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb34405-33dd-45d2-90b9-e23ee6e8ac0c None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:57.317382 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb34405-33dd-45d2-90b9-e23ee6e8ac0c None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:57.318030 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb34405-33dd-45d2-90b9-e23ee6e8ac0c None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:57.319200 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb34405-33dd-45d2-90b9-e23ee6e8ac0c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:57.320360 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb34405-33dd-45d2-90b9-e23ee6e8ac0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:57.321793 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb34405-33dd-45d2-90b9-e23ee6e8ac0c None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:57.331925 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 451/900] 10.222.0.24 () {56 vars in 1114 bytes} [Mon Apr 11 23:43:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:43:57.332924 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb34405-33dd-45d2-90b9-e23ee6e8ac0c None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:57.385216 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbfe98-e1c5-4d64-9a39-6a92f8cf53d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:57.387389 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cbfe98-e1c5-4d64-9a39-6a92f8cf53d9 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:57.441524 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb34405-33dd-45d2-90b9-e23ee6e8ac0c None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:57.475246 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451a779-8942-4bcd-ba05-7971480db1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:57.475912 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451a779-8942-4bcd-ba05-7971480db1c6 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:57.476191 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451a779-8942-4bcd-ba05-7971480db1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:57.476463 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c451a779-8942-4bcd-ba05-7971480db1c6 None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:57.477174 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451a779-8942-4bcd-ba05-7971480db1c6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:57.477480 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451a779-8942-4bcd-ba05-7971480db1c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:57.478856 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c451a779-8942-4bcd-ba05-7971480db1c6 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:57.491195 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 452/901] 10.222.0.24 () {56 vars in 1114 bytes} [Mon Apr 11 23:43:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:57.492625 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451a779-8942-4bcd-ba05-7971480db1c6 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:57.505452 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 450/902] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:43:57 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 23:43:57.510811 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbfe98-e1c5-4d64-9a39-6a92f8cf53d9 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:57.600464 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c451a779-8942-4bcd-ba05-7971480db1c6 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:57.607800 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cbfe98-e1c5-4d64-9a39-6a92f8cf53d9 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:57.636245 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f2c25-bf1f-4f39-a5c0-a383057b3378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:57.637592 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f2c25-bf1f-4f39-a5c0-a383057b3378 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:57.638200 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f2c25-bf1f-4f39-a5c0-a383057b3378 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:57.638727 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f2c25-bf1f-4f39-a5c0-a383057b3378 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:57.639799 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f2c25-bf1f-4f39-a5c0-a383057b3378 None admin] RBAC: Adding query filter params (interface=public, service_id=95f32385b34141b897e9b56bb700a1ea, region_id=RegionOne) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:57.640261 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f2c25-bf1f-4f39-a5c0-a383057b3378 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:57.641965 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0f2c25-bf1f-4f39-a5c0-a383057b3378 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:57.642557 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517420ff-c035-4363-a9fa-4d4a46581536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:57.643478 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517420ff-c035-4363-a9fa-4d4a46581536 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:57.643848 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517420ff-c035-4363-a9fa-4d4a46581536 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:57.644244 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517420ff-c035-4363-a9fa-4d4a46581536 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:57.656505 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 453/903] 10.222.0.24 () {56 vars in 1251 bytes} [Mon Apr 11 23:43:57 2022] GET /identity/v3/endpoints?service_id=95f32385b34141b897e9b56bb700a1ea&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:57.657910 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f2c25-bf1f-4f39-a5c0-a383057b3378 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:57.658333 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517420ff-c035-4363-a9fa-4d4a46581536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:57.661004 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517420ff-c035-4363-a9fa-4d4a46581536 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:57.678420 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-517420ff-c035-4363-a9fa-4d4a46581536 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:43:57.684359 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 451/904] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:57.686219 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517420ff-c035-4363-a9fa-4d4a46581536 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:57.781645 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f2c25-bf1f-4f39-a5c0-a383057b3378 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:57.797238 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517420ff-c035-4363-a9fa-4d4a46581536 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:57.817040 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f3976-d18b-4a5f-9b13-ced3ac9421ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:57.817869 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f3976-d18b-4a5f-9b13-ced3ac9421ed None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:57.818221 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f3976-d18b-4a5f-9b13-ced3ac9421ed None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:57.818575 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f3976-d18b-4a5f-9b13-ced3ac9421ed None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:57.819378 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f3976-d18b-4a5f-9b13-ced3ac9421ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:57.820935 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118f3976-d18b-4a5f-9b13-ced3ac9421ed None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:57.835104 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 454/905] 10.222.0.24 () {56 vars in 1087 bytes} [Mon Apr 11 23:43:57 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 23:43:57.843440 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c874b-b2bc-414a-b4fe-b7c4393df3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:57.844120 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c874b-b2bc-414a-b4fe-b7c4393df3cf None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:57.844401 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c874b-b2bc-414a-b4fe-b7c4393df3cf None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:57.844676 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c874b-b2bc-414a-b4fe-b7c4393df3cf None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:57.845416 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c874b-b2bc-414a-b4fe-b7c4393df3cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:57.845721 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c874b-b2bc-414a-b4fe-b7c4393df3cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:57.847760 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c874b-b2bc-414a-b4fe-b7c4393df3cf None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:57.860902 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 452/906] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:57.866999 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f3976-d18b-4a5f-9b13-ced3ac9421ed None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:57.983734 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f3976-d18b-4a5f-9b13-ced3ac9421ed None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:58.023886 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f29ee4-86c3-4ffd-bd72-5acc225d91ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:58.024686 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f29ee4-86c3-4ffd-bd72-5acc225d91ad None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:58.025019 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f29ee4-86c3-4ffd-bd72-5acc225d91ad None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:58.025326 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f29ee4-86c3-4ffd-bd72-5acc225d91ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:58.032685 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f29ee4-86c3-4ffd-bd72-5acc225d91ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:58.034210 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f29ee4-86c3-4ffd-bd72-5acc225d91ad None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:58.048906 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-c3f29ee4-86c3-4ffd-bd72-5acc225d91ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:43:58.050902 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 455/907] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:43:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:43:58.057021 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c874b-b2bc-414a-b4fe-b7c4393df3cf None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:58.160434 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c874b-b2bc-414a-b4fe-b7c4393df3cf None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:58.198638 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b4a69c-8e2b-4267-bee0-fc27b9422bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:58.199335 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4a69c-8e2b-4267-bee0-fc27b9422bb9 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:58.199614 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4a69c-8e2b-4267-bee0-fc27b9422bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:58.199888 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b4a69c-8e2b-4267-bee0-fc27b9422bb9 None admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:58.200731 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4a69c-8e2b-4267-bee0-fc27b9422bb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:58.201047 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4a69c-8e2b-4267-bee0-fc27b9422bb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:58.202483 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b4a69c-8e2b-4267-bee0-fc27b9422bb9 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:58.216264 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 453/908] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:43:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:58.222218 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f29ee4-86c3-4ffd-bd72-5acc225d91ad None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:58.281049 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677b11e-e9b2-4783-a2a3-37ea785f2e42 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:58.281332 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677b11e-e9b2-4783-a2a3-37ea785f2e42 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:58.281612 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0677b11e-e9b2-4783-a2a3-37ea785f2e42 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:58.283688 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 454/909] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:43:58.289652 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf454bd4-9fe5-4c2b-a11b-71415908eea2 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:58.290202 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf454bd4-9fe5-4c2b-a11b-71415908eea2 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:58.290581 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf454bd4-9fe5-4c2b-a11b-71415908eea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:58.312729 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-cf454bd4-9fe5-4c2b-a11b-71415908eea2 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:58.314066 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-cf454bd4-9fe5-4c2b-a11b-71415908eea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:58.327761 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f29ee4-86c3-4ffd-bd72-5acc225d91ad None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:58.362937 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71198108-f2dc-4e11-ad5c-2d58b60234a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:58.363854 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71198108-f2dc-4e11-ad5c-2d58b60234a2 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:58.364278 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71198108-f2dc-4e11-ad5c-2d58b60234a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:58.364697 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71198108-f2dc-4e11-ad5c-2d58b60234a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:58.365749 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71198108-f2dc-4e11-ad5c-2d58b60234a2 None admin] RBAC: Adding query filter params (role.id=b67d5ca11fd247f589cc04fcb8f4e072, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=5c7b25e0e29143d783553859a0583d6a) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:58.366276 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71198108-f2dc-4e11-ad5c-2d58b60234a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:58.367941 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71198108-f2dc-4e11-ad5c-2d58b60234a2 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:58.373914 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 456/910] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:43:58 2022] GET /identity/v3/role_assignments?user.id=5c7b25e0e29143d783553859a0583d6a&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=b67d5ca11fd247f589cc04fcb8f4e072 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:58.394715 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 455/911] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 23:43:58.419983 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71198108-f2dc-4e11-ad5c-2d58b60234a2 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:58.528481 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71198108-f2dc-4e11-ad5c-2d58b60234a2 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:58.528834 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554297a-d36a-4a09-9d94-7c571fda1b30 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:58.529015 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554297a-d36a-4a09-9d94-7c571fda1b30 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:58.529283 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554297a-d36a-4a09-9d94-7c571fda1b30 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:58.531320 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 456/912] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:43:58.536751 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dac20-b184-423a-ad22-f1d69da3f4bd None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:58.537052 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dac20-b184-423a-ad22-f1d69da3f4bd None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:58.537295 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0dac20-b184-423a-ad22-f1d69da3f4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:58.556558 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-0d0dac20-b184-423a-ad22-f1d69da3f4bd None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:43:58.557988 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-0d0dac20-b184-423a-ad22-f1d69da3f4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:43:58.568164 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa74866-8d27-4e96-8bd8-617b2b93e1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:58.569265 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa74866-8d27-4e96-8bd8-617b2b93e1c0 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:58.569539 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa74866-8d27-4e96-8bd8-617b2b93e1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:58.569809 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa74866-8d27-4e96-8bd8-617b2b93e1c0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:58.571501 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa74866-8d27-4e96-8bd8-617b2b93e1c0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:58.571911 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa74866-8d27-4e96-8bd8-617b2b93e1c0 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:58.585399 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-bfa74866-8d27-4e96-8bd8-617b2b93e1c0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Apr 11 23:43:58.587247 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 457/913] 10.222.0.24 () {56 vars in 1132 bytes} [Mon Apr 11 23:43:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:43:58.598908 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa74866-8d27-4e96-8bd8-617b2b93e1c0 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:58.634957 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 457/914] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:43:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 23:43:58.661066 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dac20-b184-423a-ad22-f1d69da3f4bd None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:58.726449 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa74866-8d27-4e96-8bd8-617b2b93e1c0 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:58.774213 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0dac20-b184-423a-ad22-f1d69da3f4bd None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:58.781306 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409733a-89d8-4f82-9789-b26bceb84098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:58.782273 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409733a-89d8-4f82-9789-b26bceb84098 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:58.782764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409733a-89d8-4f82-9789-b26bceb84098 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:58.783289 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409733a-89d8-4f82-9789-b26bceb84098 None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:58.784204 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409733a-89d8-4f82-9789-b26bceb84098 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:58.784743 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409733a-89d8-4f82-9789-b26bceb84098 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:58.786290 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409733a-89d8-4f82-9789-b26bceb84098 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:58.791550 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 458/915] 10.222.0.24 () {56 vars in 1126 bytes} [Mon Apr 11 23:43:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:58.798139 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409733a-89d8-4f82-9789-b26bceb84098 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:58.819911 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7621f79-d652-496a-ac97-f996d6446c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:58.820577 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7621f79-d652-496a-ac97-f996d6446c32 None admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:58.820855 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7621f79-d652-496a-ac97-f996d6446c32 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:58.821122 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7621f79-d652-496a-ac97-f996d6446c32 None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:58.821893 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7621f79-d652-496a-ac97-f996d6446c32 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:58.823346 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7621f79-d652-496a-ac97-f996d6446c32 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:58.908406 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 458/916] 10.222.0.24 () {60 vars in 1141 bytes} [Mon Apr 11 23:43:58 2022] POST /identity/v3/services => generated 241 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 23:43:58.916793 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409733a-89d8-4f82-9789-b26bceb84098 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:58.963359 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d4d6c-26f6-4fea-a84b-0c150cf6b5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:58.964327 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d4d6c-26f6-4fea-a84b-0c150cf6b5aa None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:58.964610 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d4d6c-26f6-4fea-a84b-0c150cf6b5aa None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:58.964878 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d4d6c-26f6-4fea-a84b-0c150cf6b5aa None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:58.965639 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d4d6c-26f6-4fea-a84b-0c150cf6b5aa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:43:58.965939 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d4d6c-26f6-4fea-a84b-0c150cf6b5aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:58.967409 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d4d6c-26f6-4fea-a84b-0c150cf6b5aa None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:58.973547 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 459/917] 10.222.0.24 () {56 vars in 1126 bytes} [Mon Apr 11 23:43:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:43:58.979898 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7621f79-d652-496a-ac97-f996d6446c32 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:43:59.100897 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7621f79-d652-496a-ac97-f996d6446c32 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:43:59.138627 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb05b0a-6366-4214-b7a0-1e907241f606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:43:59.139669 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb05b0a-6366-4214-b7a0-1e907241f606 None admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:43:59.140166 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb05b0a-6366-4214-b7a0-1e907241f606 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:43:59.140630 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb05b0a-6366-4214-b7a0-1e907241f606 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:43:59.141604 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb05b0a-6366-4214-b7a0-1e907241f606 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:43:59.143244 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb05b0a-6366-4214-b7a0-1e907241f606 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:43:59.222980 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 459/918] 10.222.0.24 () {60 vars in 1144 bytes} [Mon Apr 11 23:43:58 2022] POST /identity/v3/endpoints => generated 347 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:44:00.275255 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aae1bd-fcf4-4aa4-a875-9a933d498c75 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:00.275775 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aae1bd-fcf4-4aa4-a875-9a933d498c75 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:00.275883 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aae1bd-fcf4-4aa4-a875-9a933d498c75 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:00.277824 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 460/919] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:00.283219 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d728c61-9c65-4541-8e00-d322df159b6c None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:00.284091 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d728c61-9c65-4541-8e00-d322df159b6c None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:00.285106 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d728c61-9c65-4541-8e00-d322df159b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:00.303116 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-7d728c61-9c65-4541-8e00-d322df159b6c None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:00.304770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-7d728c61-9c65-4541-8e00-d322df159b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:00.381835 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 460/920] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:00.404663 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aae1bd-fcf4-4aa4-a875-9a933d498c75 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:00.508980 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aae1bd-fcf4-4aa4-a875-9a933d498c75 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:00.542676 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee6ac6-c3ec-42db-9da0-901d9ec5181f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:00.543420 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee6ac6-c3ec-42db-9da0-901d9ec5181f None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:00.543696 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee6ac6-c3ec-42db-9da0-901d9ec5181f None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:00.543964 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee6ac6-c3ec-42db-9da0-901d9ec5181f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:00.544612 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee6ac6-c3ec-42db-9da0-901d9ec5181f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:00.545972 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ee6ac6-c3ec-42db-9da0-901d9ec5181f None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:00.557007 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-54ee6ac6-c3ec-42db-9da0-901d9ec5181f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Apr 11 23:44:00.558489 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 461/921] 10.222.0.24 () {56 vars in 1114 bytes} [Mon Apr 11 23:44:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:00.564283 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d728c61-9c65-4541-8e00-d322df159b6c None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:00.665651 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d728c61-9c65-4541-8e00-d322df159b6c None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:00.699441 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45194d-1078-4f79-9efa-331f2e68bd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:00.700101 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45194d-1078-4f79-9efa-331f2e68bd0f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:00.700374 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45194d-1078-4f79-9efa-331f2e68bd0f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:00.700641 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45194d-1078-4f79-9efa-331f2e68bd0f None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:00.701346 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45194d-1078-4f79-9efa-331f2e68bd0f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:00.701643 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45194d-1078-4f79-9efa-331f2e68bd0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:00.703131 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc45194d-1078-4f79-9efa-331f2e68bd0f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:00.704414 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79617239-ecc8-48bf-8998-1b602ed997f1 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:00.704703 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79617239-ecc8-48bf-8998-1b602ed997f1 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:00.704981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79617239-ecc8-48bf-8998-1b602ed997f1 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:00.707642 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 462/922] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:00.708889 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 461/923] 10.222.0.24 () {56 vars in 1114 bytes} [Mon Apr 11 23:44:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:00.712828 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576b02e-a804-49f2-bcda-ac15b9af2e68 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:00.713117 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576b02e-a804-49f2-bcda-ac15b9af2e68 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:00.713392 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1576b02e-a804-49f2-bcda-ac15b9af2e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:00.715500 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45194d-1078-4f79-9efa-331f2e68bd0f None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:00.731524 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-1576b02e-a804-49f2-bcda-ac15b9af2e68 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:00.732697 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1576b02e-a804-49f2-bcda-ac15b9af2e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:00.804445 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 463/924] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:00.829246 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576b02e-a804-49f2-bcda-ac15b9af2e68 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:00.848797 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45194d-1078-4f79-9efa-331f2e68bd0f None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:00.889880 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6072de-9eb5-4eb5-a599-44571b5bc059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:00.890915 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6072de-9eb5-4eb5-a599-44571b5bc059 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:00.891828 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6072de-9eb5-4eb5-a599-44571b5bc059 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:00.892327 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6072de-9eb5-4eb5-a599-44571b5bc059 None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:00.893499 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6072de-9eb5-4eb5-a599-44571b5bc059 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:00.894735 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6072de-9eb5-4eb5-a599-44571b5bc059 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:00.896942 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6072de-9eb5-4eb5-a599-44571b5bc059 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:00.907985 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 462/925] 10.222.0.24 () {56 vars in 1114 bytes} [Mon Apr 11 23:44:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:00.909776 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6072de-9eb5-4eb5-a599-44571b5bc059 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:00.952338 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1576b02e-a804-49f2-bcda-ac15b9af2e68 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:00.994240 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3673a-37e2-418e-b6ec-0b0a11eb9cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:01.004962 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3673a-37e2-418e-b6ec-0b0a11eb9cf8 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:01.004962 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3673a-37e2-418e-b6ec-0b0a11eb9cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:01.004962 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f3673a-37e2-418e-b6ec-0b0a11eb9cf8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:01.009552 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f3673a-37e2-418e-b6ec-0b0a11eb9cf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:44:01.020580 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-70f3673a-37e2-418e-b6ec-0b0a11eb9cf8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 23:44:01.022898 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 464/926] 10.222.0.24 () {56 vars in 1120 bytes} [Mon Apr 11 23:44:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:44:01.028376 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3673a-37e2-418e-b6ec-0b0a11eb9cf8 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:01.035240 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6072de-9eb5-4eb5-a599-44571b5bc059 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:01.075286 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99098ee-0ff7-4da5-93e2-6ca022a23c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:01.075870 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99098ee-0ff7-4da5-93e2-6ca022a23c2b None admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:01.076152 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99098ee-0ff7-4da5-93e2-6ca022a23c2b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:01.076428 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99098ee-0ff7-4da5-93e2-6ca022a23c2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:01.077625 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99098ee-0ff7-4da5-93e2-6ca022a23c2b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:01.079056 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99098ee-0ff7-4da5-93e2-6ca022a23c2b None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:01.137225 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f3673a-37e2-418e-b6ec-0b0a11eb9cf8 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:01.169943 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 463/927] 10.222.0.24 () {60 vars in 1144 bytes} [Mon Apr 11 23:44:00 2022] POST /identity/v3/endpoints => generated 346 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:44:01.184340 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a444bd57-e3fd-4b4d-8169-c305411ee29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:01.185136 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444bd57-e3fd-4b4d-8169-c305411ee29d None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:01.185404 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444bd57-e3fd-4b4d-8169-c305411ee29d None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:01.185676 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444bd57-e3fd-4b4d-8169-c305411ee29d None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:01.186628 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444bd57-e3fd-4b4d-8169-c305411ee29d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:01.186956 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444bd57-e3fd-4b4d-8169-c305411ee29d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:01.188430 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a444bd57-e3fd-4b4d-8169-c305411ee29d None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:01.200772 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 465/928] 10.222.0.24 () {56 vars in 1115 bytes} [Mon Apr 11 23:44:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:01.208840 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99098ee-0ff7-4da5-93e2-6ca022a23c2b None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:01.308441 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578a677-0bce-4bdf-a328-169af69932ab None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:01.308964 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578a677-0bce-4bdf-a328-169af69932ab None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:01.308964 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578a677-0bce-4bdf-a328-169af69932ab None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:01.311154 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 466/929] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:01.316915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe456df-32ae-4c2d-b8ff-4949cc0fc7f1 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:01.317220 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe456df-32ae-4c2d-b8ff-4949cc0fc7f1 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:01.317474 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe456df-32ae-4c2d-b8ff-4949cc0fc7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:01.327869 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99098ee-0ff7-4da5-93e2-6ca022a23c2b None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:01.335854 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-afe456df-32ae-4c2d-b8ff-4949cc0fc7f1 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:01.337051 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-afe456df-32ae-4c2d-b8ff-4949cc0fc7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:01.366576 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ce891-c288-4851-b64d-b03c55ce1a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:01.367740 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ce891-c288-4851-b64d-b03c55ce1a67 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:01.368246 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ce891-c288-4851-b64d-b03c55ce1a67 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:01.368727 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ce891-c288-4851-b64d-b03c55ce1a67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:01.380111 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ce891-c288-4851-b64d-b03c55ce1a67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:01.381866 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ce891-c288-4851-b64d-b03c55ce1a67 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:01.400029 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-3e5ce891-c288-4851-b64d-b03c55ce1a67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:44:01.401840 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 464/930] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:01.408251 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ce891-c288-4851-b64d-b03c55ce1a67 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:01.408695 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 467/931] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 23:44:01.431950 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe456df-32ae-4c2d-b8ff-4949cc0fc7f1 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:01.515729 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ce891-c288-4851-b64d-b03c55ce1a67 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:01.558719 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082d859-abd5-48af-a232-23840420d42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:01.559693 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082d859-abd5-48af-a232-23840420d42f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:01.560124 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082d859-abd5-48af-a232-23840420d42f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:01.560544 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082d859-abd5-48af-a232-23840420d42f None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:01.561255 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe456df-32ae-4c2d-b8ff-4949cc0fc7f1 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:01.561591 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082d859-abd5-48af-a232-23840420d42f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:01.562040 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082d859-abd5-48af-a232-23840420d42f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:01.563633 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082d859-abd5-48af-a232-23840420d42f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:01.577124 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 465/932] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:01.583158 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082d859-abd5-48af-a232-23840420d42f None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:01.602392 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d749e-fb04-47f0-9439-7f9f7dadc409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:01.603228 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d749e-fb04-47f0-9439-7f9f7dadc409 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:01.603509 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d749e-fb04-47f0-9439-7f9f7dadc409 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:01.603780 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d749e-fb04-47f0-9439-7f9f7dadc409 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:01.604434 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d749e-fb04-47f0-9439-7f9f7dadc409 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:01.605798 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8d749e-fb04-47f0-9439-7f9f7dadc409 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:01.617357 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-3a8d749e-fb04-47f0-9439-7f9f7dadc409 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 23:44:01.618675 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 468/933] 10.222.0.24 () {56 vars in 1126 bytes} [Mon Apr 11 23:44:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:44:01.624396 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08108ff-9ebd-4c2f-9740-a8b242d6bea1 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:01.624677 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08108ff-9ebd-4c2f-9740-a8b242d6bea1 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:01.624946 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08108ff-9ebd-4c2f-9740-a8b242d6bea1 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:01.626658 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 469/934] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:01.627871 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08108ff-9ebd-4c2f-9740-a8b242d6bea1 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:01.685498 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082d859-abd5-48af-a232-23840420d42f None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:01.721312 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d687a-c96d-41b5-94c9-741e92bff051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:01.722646 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d687a-c96d-41b5-94c9-741e92bff051 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:01.722957 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d687a-c96d-41b5-94c9-741e92bff051 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:01.723224 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d687a-c96d-41b5-94c9-741e92bff051 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:01.729688 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08108ff-9ebd-4c2f-9740-a8b242d6bea1 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:01.730140 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d687a-c96d-41b5-94c9-741e92bff051 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:01.731602 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d687a-c96d-41b5-94c9-741e92bff051 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:01.747443 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-749d687a-c96d-41b5-94c9-741e92bff051 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 23:44:01.753553 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 466/935] 10.222.0.24 () {56 vars in 1117 bytes} [Mon Apr 11 23:44:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:01.754490 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b0341-8f0e-482b-b7a4-c3221b06b88b None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:01.754778 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b0341-8f0e-482b-b7a4-c3221b06b88b None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:01.755077 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4b0341-8f0e-482b-b7a4-c3221b06b88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:01.771609 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-aa4b0341-8f0e-482b-b7a4-c3221b06b88b None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:01.772323 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9250ee1-561e-4350-a09a-445f1312ca6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:01.772800 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-aa4b0341-8f0e-482b-b7a4-c3221b06b88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:01.773418 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9250ee1-561e-4350-a09a-445f1312ca6e None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:01.774663 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9250ee1-561e-4350-a09a-445f1312ca6e None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:01.774663 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9250ee1-561e-4350-a09a-445f1312ca6e None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:01.775154 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9250ee1-561e-4350-a09a-445f1312ca6e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:01.775472 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9250ee1-561e-4350-a09a-445f1312ca6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:01.776885 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9250ee1-561e-4350-a09a-445f1312ca6e None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:01.781893 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 470/936] 10.222.0.24 () {56 vars in 1122 bytes} [Mon Apr 11 23:44:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:01.782482 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9250ee1-561e-4350-a09a-445f1312ca6e None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:01.846516 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 467/937] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:01.847705 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b0341-8f0e-482b-b7a4-c3221b06b88b None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:01.888126 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9250ee1-561e-4350-a09a-445f1312ca6e None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:01.922941 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bb1e8-1b98-4487-969b-882e2932ee46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:01.923868 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bb1e8-1b98-4487-969b-882e2932ee46 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:01.924137 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bb1e8-1b98-4487-969b-882e2932ee46 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:01.924417 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680bb1e8-1b98-4487-969b-882e2932ee46 None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:01.925281 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bb1e8-1b98-4487-969b-882e2932ee46 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:01.925591 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bb1e8-1b98-4487-969b-882e2932ee46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:01.927042 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680bb1e8-1b98-4487-969b-882e2932ee46 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:01.943984 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 471/938] 10.222.0.24 () {56 vars in 1149 bytes} [Mon Apr 11 23:44:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:01.948437 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4b0341-8f0e-482b-b7a4-c3221b06b88b None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:01.949416 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bb1e8-1b98-4487-969b-882e2932ee46 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:01.982153 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb55dda-92e5-4a47-87fa-e8dfab9e9d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:01.982972 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb55dda-92e5-4a47-87fa-e8dfab9e9d9e None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:01.983257 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb55dda-92e5-4a47-87fa-e8dfab9e9d9e None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:01.983529 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb55dda-92e5-4a47-87fa-e8dfab9e9d9e None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:01.984238 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb55dda-92e5-4a47-87fa-e8dfab9e9d9e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:01.984543 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb55dda-92e5-4a47-87fa-e8dfab9e9d9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:01.985903 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb55dda-92e5-4a47-87fa-e8dfab9e9d9e None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:01.994899 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 468/939] 10.222.0.24 () {56 vars in 1122 bytes} [Mon Apr 11 23:44:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:01.994899 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb55dda-92e5-4a47-87fa-e8dfab9e9d9e None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:02.054775 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680bb1e8-1b98-4487-969b-882e2932ee46 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:02.088422 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb55dda-92e5-4a47-87fa-e8dfab9e9d9e None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:02.090658 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bba139-a89d-4de7-8e36-6d0cfcab05f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:02.092223 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bba139-a89d-4de7-8e36-6d0cfcab05f9 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:02.092511 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bba139-a89d-4de7-8e36-6d0cfcab05f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:02.092788 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bba139-a89d-4de7-8e36-6d0cfcab05f9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:02.093443 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bba139-a89d-4de7-8e36-6d0cfcab05f9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:02.094806 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bba139-a89d-4de7-8e36-6d0cfcab05f9 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:02.107558 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-b6bba139-a89d-4de7-8e36-6d0cfcab05f9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 11 23:44:02.110870 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 472/940] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:44:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:02.110870 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bba139-a89d-4de7-8e36-6d0cfcab05f9 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:02.126821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae27ff8-10cb-4680-9b38-83e3d172a853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:02.127627 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae27ff8-10cb-4680-9b38-83e3d172a853 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:02.127910 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae27ff8-10cb-4680-9b38-83e3d172a853 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:02.128181 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae27ff8-10cb-4680-9b38-83e3d172a853 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:02.138478 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae27ff8-10cb-4680-9b38-83e3d172a853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:02.139941 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae27ff8-10cb-4680-9b38-83e3d172a853 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:02.156099 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-bae27ff8-10cb-4680-9b38-83e3d172a853 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:44:02.157258 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 469/941] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:02.158013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae27ff8-10cb-4680-9b38-83e3d172a853 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:02.216638 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bba139-a89d-4de7-8e36-6d0cfcab05f9 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:02.254876 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae27ff8-10cb-4680-9b38-83e3d172a853 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:02.256545 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99ccc2-26bf-41f9-ba85-1e8885569e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:02.257975 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99ccc2-26bf-41f9-ba85-1e8885569e92 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:02.258261 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99ccc2-26bf-41f9-ba85-1e8885569e92 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:02.258539 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99ccc2-26bf-41f9-ba85-1e8885569e92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:02.259368 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99ccc2-26bf-41f9-ba85-1e8885569e92 None admin] RBAC: Adding query filter params (interface=public, service_id=e8cccc6eb22444f4adb6519cb5b94bd9, region_id=RegionOne) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:02.259683 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99ccc2-26bf-41f9-ba85-1e8885569e92 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:02.261045 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99ccc2-26bf-41f9-ba85-1e8885569e92 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:02.268562 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 473/942] 10.222.0.24 () {56 vars in 1251 bytes} [Mon Apr 11 23:44:02 2022] GET /identity/v3/endpoints?service_id=e8cccc6eb22444f4adb6519cb5b94bd9&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:02.269522 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99ccc2-26bf-41f9-ba85-1e8885569e92 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:02.292443 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e0c53-a03d-4ec0-86e9-8dd21983e5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:02.293112 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e0c53-a03d-4ec0-86e9-8dd21983e5b7 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:02.293395 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e0c53-a03d-4ec0-86e9-8dd21983e5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:02.293762 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31e0c53-a03d-4ec0-86e9-8dd21983e5b7 None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:02.294377 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e0c53-a03d-4ec0-86e9-8dd21983e5b7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:02.294687 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e0c53-a03d-4ec0-86e9-8dd21983e5b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:02.296074 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31e0c53-a03d-4ec0-86e9-8dd21983e5b7 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:02.301186 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 470/943] 10.222.0.24 () {56 vars in 1112 bytes} [Mon Apr 11 23:44:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:02.301957 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e0c53-a03d-4ec0-86e9-8dd21983e5b7 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:02.373954 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99ccc2-26bf-41f9-ba85-1e8885569e92 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:02.398174 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31e0c53-a03d-4ec0-86e9-8dd21983e5b7 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:02.405831 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae607d-d0af-4364-b9db-106a83fd597f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:02.406500 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae607d-d0af-4364-b9db-106a83fd597f None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:02.406778 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae607d-d0af-4364-b9db-106a83fd597f None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:02.407083 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae607d-d0af-4364-b9db-106a83fd597f None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:02.407808 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae607d-d0af-4364-b9db-106a83fd597f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:02.408114 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae607d-d0af-4364-b9db-106a83fd597f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:02.409472 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae607d-d0af-4364-b9db-106a83fd597f None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:02.421622 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 474/944] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:02.422428 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae607d-d0af-4364-b9db-106a83fd597f None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:02.436085 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccf600-79aa-45c1-b8ec-b214b43d4c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:02.436944 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccf600-79aa-45c1-b8ec-b214b43d4c70 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:02.437372 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccf600-79aa-45c1-b8ec-b214b43d4c70 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:02.437644 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ccf600-79aa-45c1-b8ec-b214b43d4c70 None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:02.438323 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ccf600-79aa-45c1-b8ec-b214b43d4c70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:02.439723 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ccf600-79aa-45c1-b8ec-b214b43d4c70 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:02.445462 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 471/945] 10.222.0.24 () {56 vars in 1087 bytes} [Mon Apr 11 23:44:02 2022] GET /identity/v3/services => generated 1497 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 23:44:02.446214 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccf600-79aa-45c1-b8ec-b214b43d4c70 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:02.544582 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae607d-d0af-4364-b9db-106a83fd597f None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:02.577036 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ccf600-79aa-45c1-b8ec-b214b43d4c70 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:02.582398 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce6460-2669-4d6a-9e58-4416e903b09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:02.583106 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce6460-2669-4d6a-9e58-4416e903b09a None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:02.583382 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce6460-2669-4d6a-9e58-4416e903b09a None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:02.583650 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ce6460-2669-4d6a-9e58-4416e903b09a None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:02.584365 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce6460-2669-4d6a-9e58-4416e903b09a None admin] RBAC: Adding query filter params (type=compute) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:02.584666 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce6460-2669-4d6a-9e58-4416e903b09a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:02.586081 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ce6460-2669-4d6a-9e58-4416e903b09a None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:02.599388 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 475/946] 10.222.0.24 () {56 vars in 1112 bytes} [Mon Apr 11 23:44:02 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:02.620006 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc239601-1be9-423a-8c83-8c7f2d8e9c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:02.621201 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc239601-1be9-423a-8c83-8c7f2d8e9c9f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:02.621665 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc239601-1be9-423a-8c83-8c7f2d8e9c9f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:02.622112 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc239601-1be9-423a-8c83-8c7f2d8e9c9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:02.630452 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc239601-1be9-423a-8c83-8c7f2d8e9c9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:02.632248 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc239601-1be9-423a-8c83-8c7f2d8e9c9f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:02.647990 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-cc239601-1be9-423a-8c83-8c7f2d8e9c9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:44:02.649888 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 472/947] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:44:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:02.656350 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce6460-2669-4d6a-9e58-4416e903b09a None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:02.781824 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ce6460-2669-4d6a-9e58-4416e903b09a None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:02.819532 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555157c-dfe0-43a8-87aa-46e5606c84fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:02.820528 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555157c-dfe0-43a8-87aa-46e5606c84fb None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:02.820986 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555157c-dfe0-43a8-87aa-46e5606c84fb None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:02.821439 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555157c-dfe0-43a8-87aa-46e5606c84fb None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:02.822748 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555157c-dfe0-43a8-87aa-46e5606c84fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:02.823533 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555157c-dfe0-43a8-87aa-46e5606c84fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:02.826235 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555157c-dfe0-43a8-87aa-46e5606c84fb None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:02.841242 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 476/948] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:44:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:02.846715 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc239601-1be9-423a-8c83-8c7f2d8e9c9f None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:02.947853 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc239601-1be9-423a-8c83-8c7f2d8e9c9f None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:02.982076 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28209e91-9260-4545-b626-9c893dd08d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:02.983024 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28209e91-9260-4545-b626-9c893dd08d00 None admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:02.983361 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28209e91-9260-4545-b626-9c893dd08d00 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:02.983636 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28209e91-9260-4545-b626-9c893dd08d00 None admin] PATH_INFO: `/v3/projects/3563c87e56124c688a8029b4088cb198/users/5c7b25e0e29143d783553859a0583d6a/roles/b67d5ca11fd247f589cc04fcb8f4e072` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:02.985853 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28209e91-9260-4545-b626-9c893dd08d00 None admin] RBAC: Authorizing `identity:create_grant(project_id=3563c87e56124c688a8029b4088cb198, user_id=5c7b25e0e29143d783553859a0583d6a, role_id=b67d5ca11fd247f589cc04fcb8f4e072)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:02.987314 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28209e91-9260-4545-b626-9c893dd08d00 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:03.067086 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 473/949] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:44:02 2022] PUT /identity/v3/projects/3563c87e56124c688a8029b4088cb198/users/5c7b25e0e29143d783553859a0583d6a/roles/b67d5ca11fd247f589cc04fcb8f4e072 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:44:03.515710 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4017893-8768-4fd2-b099-61c9704c9dc9 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:03.516226 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4017893-8768-4fd2-b099-61c9704c9dc9 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:03.516226 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4017893-8768-4fd2-b099-61c9704c9dc9 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:03.518263 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 477/950] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:03.524143 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0058e19-c2f7-4951-ad57-7504c96051e1 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:03.524551 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0058e19-c2f7-4951-ad57-7504c96051e1 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:03.524691 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0058e19-c2f7-4951-ad57-7504c96051e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:03.541815 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-a0058e19-c2f7-4951-ad57-7504c96051e1 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:03.543020 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-a0058e19-c2f7-4951-ad57-7504c96051e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:03.618474 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 474/951] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:03 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:03.641828 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4017893-8768-4fd2-b099-61c9704c9dc9 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:03.749223 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4017893-8768-4fd2-b099-61c9704c9dc9 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:03.783386 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be64b27-b696-4d53-a5ab-12a4fec6c403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:03.784065 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be64b27-b696-4d53-a5ab-12a4fec6c403 None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:03.784339 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be64b27-b696-4d53-a5ab-12a4fec6c403 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:03.785153 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be64b27-b696-4d53-a5ab-12a4fec6c403 None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:03.785887 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be64b27-b696-4d53-a5ab-12a4fec6c403 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:03.787349 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be64b27-b696-4d53-a5ab-12a4fec6c403 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:03.788729 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.common [None req-0be64b27-b696-4d53-a5ab-12a4fec6c403 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 11 23:44:03.837755 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.sql.core [None req-0be64b27-b696-4d53-a5ab-12a4fec6c403 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Apr 11 23:44:03.837755 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Apr 11 23:44:03.837755 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [parameters: {'id': 'b01bad13cd804a80a57bb9a747f8be13', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Apr 11 23:44:03.837755 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86501) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 11 23:44:03.844835 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-0be64b27-b696-4d53-a5ab-12a4fec6c403 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b01bad13cd804a80a57bb9a747f8be13.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b01bad13cd804a80a57bb9a747f8be13. Apr 11 23:44:03.846474 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 478/952] 10.222.0.24 () {60 vars in 1140 bytes} [Mon Apr 11 23:44:03 2022] POST /identity/v3/projects => generated 262 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:03.852887 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0058e19-c2f7-4951-ad57-7504c96051e1 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:03.953781 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0058e19-c2f7-4951-ad57-7504c96051e1 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:03.987439 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de7c67a-a57b-470f-9e31-947c2a8d3e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:03.988807 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7c67a-a57b-470f-9e31-947c2a8d3e20 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:03.989082 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7c67a-a57b-470f-9e31-947c2a8d3e20 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:03.989352 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de7c67a-a57b-470f-9e31-947c2a8d3e20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:03.996432 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7c67a-a57b-470f-9e31-947c2a8d3e20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:03.997856 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de7c67a-a57b-470f-9e31-947c2a8d3e20 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:04.010958 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-8de7c67a-a57b-470f-9e31-947c2a8d3e20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:44:04.012419 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 475/953] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:44:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:04.018319 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be64b27-b696-4d53-a5ab-12a4fec6c403 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:04.124165 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be64b27-b696-4d53-a5ab-12a4fec6c403 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:04.158122 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64dccc-ea89-4c6d-aa12-0d978f89792c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:04.159065 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64dccc-ea89-4c6d-aa12-0d978f89792c None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:04.159533 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64dccc-ea89-4c6d-aa12-0d978f89792c None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:04.160449 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64dccc-ea89-4c6d-aa12-0d978f89792c None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:04.161349 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64dccc-ea89-4c6d-aa12-0d978f89792c None admin] RBAC: Adding query filter params (name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:04.161790 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64dccc-ea89-4c6d-aa12-0d978f89792c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:04.163586 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64dccc-ea89-4c6d-aa12-0d978f89792c None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:04.185247 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 479/954] 10.222.0.24 () {56 vars in 1112 bytes} [Mon Apr 11 23:44:04 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:04.801579 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682e893-311c-40d8-a604-cccc1aea72f8 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:04.802076 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682e893-311c-40d8-a604-cccc1aea72f8 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:04.802180 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682e893-311c-40d8-a604-cccc1aea72f8 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:04.804173 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 476/955] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:04.809733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cf893-6610-4440-afbc-7b440e91db8f None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:04.810147 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cf893-6610-4440-afbc-7b440e91db8f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:04.810334 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cf893-6610-4440-afbc-7b440e91db8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:04.827744 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-da3cf893-6610-4440-afbc-7b440e91db8f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:04.829244 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-da3cf893-6610-4440-afbc-7b440e91db8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:04.896866 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 480/956] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 23:44:04.919969 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682e893-311c-40d8-a604-cccc1aea72f8 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:05.008098 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270e09a-3ded-42dd-824f-982133478a84 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:05.008397 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270e09a-3ded-42dd-824f-982133478a84 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:05.013663 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270e09a-3ded-42dd-824f-982133478a84 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:05.013663 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 481/957] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:44:05.015725 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962353d6-0f48-4b1e-b204-c5077be6822e None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:05.016011 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962353d6-0f48-4b1e-b204-c5077be6822e None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:05.016290 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962353d6-0f48-4b1e-b204-c5077be6822e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:05.027829 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682e893-311c-40d8-a604-cccc1aea72f8 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:05.035716 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-962353d6-0f48-4b1e-b204-c5077be6822e None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:05.037746 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-962353d6-0f48-4b1e-b204-c5077be6822e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:05.073764 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6237db-689a-48bc-9021-a3a41d062876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:05.074986 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6237db-689a-48bc-9021-a3a41d062876 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:05.075571 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6237db-689a-48bc-9021-a3a41d062876 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:05.076906 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6237db-689a-48bc-9021-a3a41d062876 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:05.077751 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6237db-689a-48bc-9021-a3a41d062876 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:05.079318 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6237db-689a-48bc-9021-a3a41d062876 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:05.095337 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-ff6237db-689a-48bc-9021-a3a41d062876 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 23:44:05.097881 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 477/958] 10.222.0.24 () {56 vars in 1126 bytes} [Mon Apr 11 23:44:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:44:05.104340 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6237db-689a-48bc-9021-a3a41d062876 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:05.122983 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 482/959] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 23:44:05.137275 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962353d6-0f48-4b1e-b204-c5077be6822e None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:05.224528 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6237db-689a-48bc-9021-a3a41d062876 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:05.240226 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962353d6-0f48-4b1e-b204-c5077be6822e None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:05.270887 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77876c68-8e87-4c14-a32b-e895301b8e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:05.271823 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77876c68-8e87-4c14-a32b-e895301b8e6f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:05.272238 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77876c68-8e87-4c14-a32b-e895301b8e6f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:05.272646 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77876c68-8e87-4c14-a32b-e895301b8e6f None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:05.273693 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77876c68-8e87-4c14-a32b-e895301b8e6f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:05.274133 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77876c68-8e87-4c14-a32b-e895301b8e6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:05.274561 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9cc736-2918-4ca9-850c-5c6c8dfa12ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:05.275379 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cc736-2918-4ca9-850c-5c6c8dfa12ec None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:05.275759 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cc736-2918-4ca9-850c-5c6c8dfa12ec None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:05.276130 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9cc736-2918-4ca9-850c-5c6c8dfa12ec None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:05.276295 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77876c68-8e87-4c14-a32b-e895301b8e6f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:05.277043 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9cc736-2918-4ca9-850c-5c6c8dfa12ec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:05.278556 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9cc736-2918-4ca9-850c-5c6c8dfa12ec None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:05.287041 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 478/960] 10.222.0.24 () {56 vars in 1122 bytes} [Mon Apr 11 23:44:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:05.289011 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77876c68-8e87-4c14-a32b-e895301b8e6f None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:05.383030 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 483/961] 10.222.0.24 () {60 vars in 1141 bytes} [Mon Apr 11 23:44:05 2022] POST /identity/v3/services => generated 242 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 23:44:05.399654 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77876c68-8e87-4c14-a32b-e895301b8e6f None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:05.414715 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30515db3-15f7-41e1-9616-ec83105653cf None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:05.415033 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30515db3-15f7-41e1-9616-ec83105653cf None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:05.415312 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30515db3-15f7-41e1-9616-ec83105653cf None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:05.417107 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 484/962] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:05.423613 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfc620-e15b-4bad-b6f1-5070456447ab None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:05.423916 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfc620-e15b-4bad-b6f1-5070456447ab None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:05.424149 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbfc620-e15b-4bad-b6f1-5070456447ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:05.442733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-cdbfc620-e15b-4bad-b6f1-5070456447ab None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:05.443970 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-cdbfc620-e15b-4bad-b6f1-5070456447ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:05.459315 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fcbe1-ef96-47c7-aba2-7da6d0687a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:05.460597 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fcbe1-ef96-47c7-aba2-7da6d0687a39 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:05.461581 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fcbe1-ef96-47c7-aba2-7da6d0687a39 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:05.462247 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960fcbe1-ef96-47c7-aba2-7da6d0687a39 None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:05.463299 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fcbe1-ef96-47c7-aba2-7da6d0687a39 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:05.463784 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fcbe1-ef96-47c7-aba2-7da6d0687a39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:05.466153 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960fcbe1-ef96-47c7-aba2-7da6d0687a39 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:05.474404 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 479/963] 10.222.0.24 () {56 vars in 1122 bytes} [Mon Apr 11 23:44:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:05.480565 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fcbe1-ef96-47c7-aba2-7da6d0687a39 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:05.522872 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 485/964] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:05 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 23:44:05.545932 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfc620-e15b-4bad-b6f1-5070456447ab None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:05.627987 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960fcbe1-ef96-47c7-aba2-7da6d0687a39 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:05.669213 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf7f31-b17d-49c0-9e20-c72caee2aad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:05.669870 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf7f31-b17d-49c0-9e20-c72caee2aad8 None admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:05.670151 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf7f31-b17d-49c0-9e20-c72caee2aad8 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:05.670417 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bf7f31-b17d-49c0-9e20-c72caee2aad8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:05.671178 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf7f31-b17d-49c0-9e20-c72caee2aad8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:05.672539 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bf7f31-b17d-49c0-9e20-c72caee2aad8 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:05.674608 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbfc620-e15b-4bad-b6f1-5070456447ab None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:05.709921 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dfffa-c457-4535-9c0b-c95ff6400750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:05.710730 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dfffa-c457-4535-9c0b-c95ff6400750 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:05.711051 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dfffa-c457-4535-9c0b-c95ff6400750 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:05.711324 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dfffa-c457-4535-9c0b-c95ff6400750 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:05.721623 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2dfffa-c457-4535-9c0b-c95ff6400750 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:44:05.729852 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-9a2dfffa-c457-4535-9c0b-c95ff6400750 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 23:44:05.731078 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 486/965] 10.222.0.24 () {56 vars in 1120 bytes} [Mon Apr 11 23:44:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:44:05.737000 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dfffa-c457-4535-9c0b-c95ff6400750 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:05.769789 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 480/966] 10.222.0.24 () {60 vars in 1144 bytes} [Mon Apr 11 23:44:05 2022] POST /identity/v3/endpoints => generated 349 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 23:44:05.865395 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dfffa-c457-4535-9c0b-c95ff6400750 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:05.909121 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb517475-7a4b-4478-a974-e2333fca78ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:05.910746 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb517475-7a4b-4478-a974-e2333fca78ec None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:05.911195 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb517475-7a4b-4478-a974-e2333fca78ec None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:05.911606 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb517475-7a4b-4478-a974-e2333fca78ec None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:05.912746 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb517475-7a4b-4478-a974-e2333fca78ec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:05.913056 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb517475-7a4b-4478-a974-e2333fca78ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:05.914525 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb517475-7a4b-4478-a974-e2333fca78ec None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:05.924462 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 487/967] 10.222.0.24 () {56 vars in 1115 bytes} [Mon Apr 11 23:44:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:05.930299 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf7f31-b17d-49c0-9e20-c72caee2aad8 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:06.032774 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bf7f31-b17d-49c0-9e20-c72caee2aad8 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:06.066809 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec971d1-6bd2-4822-92f1-21ee2e60a48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:06.067675 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec971d1-6bd2-4822-92f1-21ee2e60a48a None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:06.067953 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec971d1-6bd2-4822-92f1-21ee2e60a48a None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:06.068223 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec971d1-6bd2-4822-92f1-21ee2e60a48a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:06.078977 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec971d1-6bd2-4822-92f1-21ee2e60a48a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:06.080409 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec971d1-6bd2-4822-92f1-21ee2e60a48a None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:06.097854 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-1ec971d1-6bd2-4822-92f1-21ee2e60a48a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:44:06.099392 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 481/968] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:06.105068 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb517475-7a4b-4478-a974-e2333fca78ec None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:06.211564 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb517475-7a4b-4478-a974-e2333fca78ec None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:06.246767 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d114b-4f8b-4680-91db-e03446f306e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:06.247499 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d114b-4f8b-4680-91db-e03446f306e8 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:06.247782 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d114b-4f8b-4680-91db-e03446f306e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:06.248057 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d114b-4f8b-4680-91db-e03446f306e8 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:06.248843 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d114b-4f8b-4680-91db-e03446f306e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:06.249144 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d114b-4f8b-4680-91db-e03446f306e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:06.250549 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d114b-4f8b-4680-91db-e03446f306e8 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:06.263054 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 488/969] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:06.272102 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec971d1-6bd2-4822-92f1-21ee2e60a48a None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:06.370094 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec971d1-6bd2-4822-92f1-21ee2e60a48a None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:06.402556 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552a0e5-3e45-48ce-bb34-8d7329623449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:06.403391 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552a0e5-3e45-48ce-bb34-8d7329623449 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:06.403670 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552a0e5-3e45-48ce-bb34-8d7329623449 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:06.403946 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552a0e5-3e45-48ce-bb34-8d7329623449 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:06.412050 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552a0e5-3e45-48ce-bb34-8d7329623449 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:06.413479 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7552a0e5-3e45-48ce-bb34-8d7329623449 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:06.427345 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-7552a0e5-3e45-48ce-bb34-8d7329623449 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Apr 11 23:44:06.428819 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 482/970] 10.222.0.24 () {56 vars in 1117 bytes} [Mon Apr 11 23:44:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:06.434449 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d114b-4f8b-4680-91db-e03446f306e8 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:06.533932 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d114b-4f8b-4680-91db-e03446f306e8 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:06.541826 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09523b9-e8bd-468d-b8a3-621f53a0aae8 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:06.542113 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09523b9-e8bd-468d-b8a3-621f53a0aae8 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:06.542391 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09523b9-e8bd-468d-b8a3-621f53a0aae8 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:06.544452 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 483/971] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:44:06.549512 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe70dd-1667-40e9-afb3-b7bd755fb739 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:06.549790 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe70dd-1667-40e9-afb3-b7bd755fb739 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:06.550085 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbe70dd-1667-40e9-afb3-b7bd755fb739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:06.568121 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-fbbe70dd-1667-40e9-afb3-b7bd755fb739 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:06.569809 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-fbbe70dd-1667-40e9-afb3-b7bd755fb739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:06.571201 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f87be8-eea7-4678-86bb-9f08e1a47419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:06.571892 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f87be8-eea7-4678-86bb-9f08e1a47419 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:06.572168 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f87be8-eea7-4678-86bb-9f08e1a47419 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:06.572436 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f87be8-eea7-4678-86bb-9f08e1a47419 None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:06.573331 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f87be8-eea7-4678-86bb-9f08e1a47419 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:06.573593 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f87be8-eea7-4678-86bb-9f08e1a47419 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:06.575104 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f87be8-eea7-4678-86bb-9f08e1a47419 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:06.594451 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 489/972] 10.222.0.24 () {56 vars in 1149 bytes} [Mon Apr 11 23:44:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:06.600033 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f87be8-eea7-4678-86bb-9f08e1a47419 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:06.651023 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 484/973] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:06 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:06.668065 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe70dd-1667-40e9-afb3-b7bd755fb739 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:06.702589 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f87be8-eea7-4678-86bb-9f08e1a47419 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:06.737267 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f33cda-012a-42e6-a739-bc1d8f4a7d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:06.738531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f33cda-012a-42e6-a739-bc1d8f4a7d7e None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:06.738868 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f33cda-012a-42e6-a739-bc1d8f4a7d7e None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:06.739150 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f33cda-012a-42e6-a739-bc1d8f4a7d7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:06.769010 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbe70dd-1667-40e9-afb3-b7bd755fb739 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:06.803779 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1023fe-738b-4bfe-bbf1-ea4519ca6253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:06.804373 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1023fe-738b-4bfe-bbf1-ea4519ca6253 None admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:06.804654 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1023fe-738b-4bfe-bbf1-ea4519ca6253 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:06.804929 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1023fe-738b-4bfe-bbf1-ea4519ca6253 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:06.805637 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1023fe-738b-4bfe-bbf1-ea4519ca6253 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:06.807086 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1023fe-738b-4bfe-bbf1-ea4519ca6253 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:06.807369 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f33cda-012a-42e6-a739-bc1d8f4a7d7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:06.808389 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.common [None req-0b1023fe-738b-4bfe-bbf1-ea4519ca6253 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Apr 11 23:44:06.808807 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f33cda-012a-42e6-a739-bc1d8f4a7d7e None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:06.857820 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.sql.core [None req-0b1023fe-738b-4bfe-bbf1-ea4519ca6253 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Apr 11 23:44:06.857820 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Apr 11 23:44:06.857820 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [parameters: {'user_id': 'e5513209ce244a17b68f843c14c76c6f', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Apr 11 23:44:06.857820 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86500) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Apr 11 23:44:06.872587 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-0b1023fe-738b-4bfe-bbf1-ea4519ca6253 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Apr 11 23:44:06.878850 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 485/974] 10.222.0.24 () {60 vars in 1131 bytes} [Mon Apr 11 23:44:06 2022] POST /identity/v3/users => generated 160 bytes in 211 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:06.879957 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1023fe-738b-4bfe-bbf1-ea4519ca6253 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:06.923553 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 490/975] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:44:06 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 23:44:06.924457 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f33cda-012a-42e6-a739-bc1d8f4a7d7e None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:06.989751 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1023fe-738b-4bfe-bbf1-ea4519ca6253 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:07.024010 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e3998-ff5b-4c40-ae94-0a2537296e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:07.024875 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e3998-ff5b-4c40-ae94-0a2537296e63 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:07.025152 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e3998-ff5b-4c40-ae94-0a2537296e63 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:07.025424 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e3998-ff5b-4c40-ae94-0a2537296e63 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:07.029867 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f33cda-012a-42e6-a739-bc1d8f4a7d7e None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:07.034983 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e3998-ff5b-4c40-ae94-0a2537296e63 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:07.036862 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e3998-ff5b-4c40-ae94-0a2537296e63 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:07.051771 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-3b9e3998-ff5b-4c40-ae94-0a2537296e63 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Apr 11 23:44:07.052995 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 486/976] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:44:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:07.064698 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e3998-ff5b-4c40-ae94-0a2537296e63 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:07.066930 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e374d3a-de88-4f65-8eb2-56f491531d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:07.067723 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e374d3a-de88-4f65-8eb2-56f491531d2a None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:07.068004 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e374d3a-de88-4f65-8eb2-56f491531d2a None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:07.068276 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e374d3a-de88-4f65-8eb2-56f491531d2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:07.078576 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e374d3a-de88-4f65-8eb2-56f491531d2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:07.080038 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e374d3a-de88-4f65-8eb2-56f491531d2a None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:07.098649 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-8e374d3a-de88-4f65-8eb2-56f491531d2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:44:07.099879 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 491/977] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:07.105419 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e374d3a-de88-4f65-8eb2-56f491531d2a None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:07.158679 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e3998-ff5b-4c40-ae94-0a2537296e63 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:07.192327 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04781815-0034-4204-b3c1-54ddd75e28d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:07.192985 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04781815-0034-4204-b3c1-54ddd75e28d6 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:07.193262 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04781815-0034-4204-b3c1-54ddd75e28d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:07.193536 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04781815-0034-4204-b3c1-54ddd75e28d6 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:07.194334 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04781815-0034-4204-b3c1-54ddd75e28d6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:07.194632 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04781815-0034-4204-b3c1-54ddd75e28d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:07.196105 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04781815-0034-4204-b3c1-54ddd75e28d6 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:07.204571 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e374d3a-de88-4f65-8eb2-56f491531d2a None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:07.234815 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 487/978] 10.222.0.24 () {56 vars in 1101 bytes} [Mon Apr 11 23:44:07 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:07.240306 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1221d-324d-41a1-87bb-3527612913a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:07.240987 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1221d-324d-41a1-87bb-3527612913a2 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:07.241266 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1221d-324d-41a1-87bb-3527612913a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:07.241540 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac1221d-324d-41a1-87bb-3527612913a2 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:07.242283 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1221d-324d-41a1-87bb-3527612913a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:07.242588 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1221d-324d-41a1-87bb-3527612913a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:07.244133 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac1221d-324d-41a1-87bb-3527612913a2 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:07.257935 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 492/979] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:07.263743 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04781815-0034-4204-b3c1-54ddd75e28d6 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:07.368257 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04781815-0034-4204-b3c1-54ddd75e28d6 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:07.407979 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99d258-91fe-48f5-b1e1-e9e79396c31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:07.408805 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99d258-91fe-48f5-b1e1-e9e79396c31f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:07.409078 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99d258-91fe-48f5-b1e1-e9e79396c31f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:07.409349 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99d258-91fe-48f5-b1e1-e9e79396c31f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:07.417989 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99d258-91fe-48f5-b1e1-e9e79396c31f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:07.419564 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c99d258-91fe-48f5-b1e1-e9e79396c31f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:07.435531 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-4c99d258-91fe-48f5-b1e1-e9e79396c31f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:44:07.437241 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 488/980] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:44:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:07.443910 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1221d-324d-41a1-87bb-3527612913a2 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:07.551492 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac1221d-324d-41a1-87bb-3527612913a2 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:07.591347 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4425fe-6829-4fe1-a160-925c9f744581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:07.592009 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4425fe-6829-4fe1-a160-925c9f744581 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:07.592285 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4425fe-6829-4fe1-a160-925c9f744581 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:07.592552 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4425fe-6829-4fe1-a160-925c9f744581 None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:07.593328 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4425fe-6829-4fe1-a160-925c9f744581 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:07.593631 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4425fe-6829-4fe1-a160-925c9f744581 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:07.595065 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4425fe-6829-4fe1-a160-925c9f744581 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:07.611196 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 493/981] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:44:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:07.617783 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99d258-91fe-48f5-b1e1-e9e79396c31f None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:07.715122 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99d258-91fe-48f5-b1e1-e9e79396c31f None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:07.746077 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaffafae-706b-4c4f-b57c-c9973fb25a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:07.746726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffafae-706b-4c4f-b57c-c9973fb25a70 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:07.747029 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffafae-706b-4c4f-b57c-c9973fb25a70 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:07.747346 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaffafae-706b-4c4f-b57c-c9973fb25a70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:07.748171 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaffafae-706b-4c4f-b57c-c9973fb25a70 None admin] RBAC: Adding query filter params (role.id=b67d5ca11fd247f589cc04fcb8f4e072, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=5c7b25e0e29143d783553859a0583d6a) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:07.748477 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaffafae-706b-4c4f-b57c-c9973fb25a70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:07.749888 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaffafae-706b-4c4f-b57c-c9973fb25a70 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:07.756949 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 489/982] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:44:07 2022] GET /identity/v3/role_assignments?user.id=5c7b25e0e29143d783553859a0583d6a&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=b67d5ca11fd247f589cc04fcb8f4e072 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:07.786809 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed12e5-3946-4553-82bb-047486993d90 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:07.787223 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed12e5-3946-4553-82bb-047486993d90 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:07.787575 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed12e5-3946-4553-82bb-047486993d90 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:07.789573 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 494/983] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:07.795602 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773bb28-d0fd-4c96-958c-3cb80a7e6dde None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:07.795903 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773bb28-d0fd-4c96-958c-3cb80a7e6dde None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:07.796161 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773bb28-d0fd-4c96-958c-3cb80a7e6dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:07.814460 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-9773bb28-d0fd-4c96-958c-3cb80a7e6dde None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:07.816625 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-9773bb28-d0fd-4c96-958c-3cb80a7e6dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:07.894296 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 490/984] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:07 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:07.917230 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed12e5-3946-4553-82bb-047486993d90 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:08.020419 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed12e5-3946-4553-82bb-047486993d90 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:08.053286 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf8a05-fd37-4141-8d9f-afe6186f1e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:08.054068 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf8a05-fd37-4141-8d9f-afe6186f1e50 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:08.054342 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf8a05-fd37-4141-8d9f-afe6186f1e50 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:08.054607 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf8a05-fd37-4141-8d9f-afe6186f1e50 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:08.055282 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf8a05-fd37-4141-8d9f-afe6186f1e50 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:08.056620 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf8a05-fd37-4141-8d9f-afe6186f1e50 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:08.067399 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-baaf8a05-fd37-4141-8d9f-afe6186f1e50 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 11 23:44:08.073324 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 495/985] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:44:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:08.074564 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773bb28-d0fd-4c96-958c-3cb80a7e6dde None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:08.168819 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9773bb28-d0fd-4c96-958c-3cb80a7e6dde None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:08.200804 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2531393f-9d03-445f-9119-3b25c64ff274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:08.201462 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531393f-9d03-445f-9119-3b25c64ff274 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:08.201742 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531393f-9d03-445f-9119-3b25c64ff274 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:08.202012 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2531393f-9d03-445f-9119-3b25c64ff274 None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:08.202711 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531393f-9d03-445f-9119-3b25c64ff274 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:08.203042 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531393f-9d03-445f-9119-3b25c64ff274 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:08.204384 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2531393f-9d03-445f-9119-3b25c64ff274 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:08.214656 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 491/986] 10.222.0.24 () {56 vars in 1112 bytes} [Mon Apr 11 23:44:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:08.215619 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf8a05-fd37-4141-8d9f-afe6186f1e50 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:08.229993 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9bdd0-9d41-4872-a465-0119cf8c738f None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:08.230274 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9bdd0-9d41-4872-a465-0119cf8c738f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:08.230540 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9bdd0-9d41-4872-a465-0119cf8c738f None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:08.232624 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 492/987] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:44:08.237335 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b3d45-c20f-43f2-a4b3-a4547f9f30d7 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:08.237663 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b3d45-c20f-43f2-a4b3-a4547f9f30d7 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:08.237944 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b3d45-c20f-43f2-a4b3-a4547f9f30d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:08.254490 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-619b3d45-c20f-43f2-a4b3-a4547f9f30d7 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:08.255701 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-619b3d45-c20f-43f2-a4b3-a4547f9f30d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:08.315252 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf8a05-fd37-4141-8d9f-afe6186f1e50 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:08.320670 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 493/988] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:08 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 23:44:08.344007 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b3d45-c20f-43f2-a4b3-a4547f9f30d7 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:08.348033 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55cacf-a2b9-4ddc-9a48-ae699a99b31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:08.348698 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55cacf-a2b9-4ddc-9a48-ae699a99b31f None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:08.348974 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55cacf-a2b9-4ddc-9a48-ae699a99b31f None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:08.349244 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55cacf-a2b9-4ddc-9a48-ae699a99b31f None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:08.349946 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55cacf-a2b9-4ddc-9a48-ae699a99b31f None admin] RBAC: Adding query filter params (type=compute) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:08.350248 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55cacf-a2b9-4ddc-9a48-ae699a99b31f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:08.351627 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55cacf-a2b9-4ddc-9a48-ae699a99b31f None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:08.361133 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 496/989] 10.222.0.24 () {56 vars in 1112 bytes} [Mon Apr 11 23:44:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:08.362063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55cacf-a2b9-4ddc-9a48-ae699a99b31f None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:08.442371 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b3d45-c20f-43f2-a4b3-a4547f9f30d7 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:08.457696 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55cacf-a2b9-4ddc-9a48-ae699a99b31f None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:08.475742 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2ed2d-30b3-484e-8fa2-cd42a8709f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:08.476638 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2ed2d-30b3-484e-8fa2-cd42a8709f31 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:08.476920 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2ed2d-30b3-484e-8fa2-cd42a8709f31 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:08.477607 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2ed2d-30b3-484e-8fa2-cd42a8709f31 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:08.478273 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2ed2d-30b3-484e-8fa2-cd42a8709f31 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:08.479640 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2ed2d-30b3-484e-8fa2-cd42a8709f31 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:08.490317 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7e914-007f-4473-ba80-5f2146bd5e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:08.490628 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-6fb2ed2d-30b3-484e-8fa2-cd42a8709f31 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 23:44:08.491005 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7e914-007f-4473-ba80-5f2146bd5e00 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:08.491288 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7e914-007f-4473-ba80-5f2146bd5e00 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:08.491557 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7e914-007f-4473-ba80-5f2146bd5e00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:08.496569 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 494/990] 10.222.0.24 () {56 vars in 1126 bytes} [Mon Apr 11 23:44:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:44:08.496692 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7e914-007f-4473-ba80-5f2146bd5e00 None admin] RBAC: Adding query filter params (interface=public, service_id=303020887f9047cab86c3e97e8b93b63, region_id=RegionOne) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:08.496692 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7e914-007f-4473-ba80-5f2146bd5e00 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:08.496692 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7e914-007f-4473-ba80-5f2146bd5e00 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:08.497626 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2ed2d-30b3-484e-8fa2-cd42a8709f31 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:08.499171 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 497/991] 10.222.0.24 () {56 vars in 1251 bytes} [Mon Apr 11 23:44:08 2022] GET /identity/v3/endpoints?service_id=303020887f9047cab86c3e97e8b93b63&interface=public®ion_id=RegionOne => generated 194 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:08.505175 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7e914-007f-4473-ba80-5f2146bd5e00 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:08.598950 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2ed2d-30b3-484e-8fa2-cd42a8709f31 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:08.600300 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7e914-007f-4473-ba80-5f2146bd5e00 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:08.632737 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f183b98-73c5-4ee8-bd02-34fac2ee2cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:08.633133 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5ebf5-7247-41a1-b3cc-4094d166fe11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:08.633404 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f183b98-73c5-4ee8-bd02-34fac2ee2cd4 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:08.633685 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f183b98-73c5-4ee8-bd02-34fac2ee2cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:08.633784 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5ebf5-7247-41a1-b3cc-4094d166fe11 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:08.633957 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f183b98-73c5-4ee8-bd02-34fac2ee2cd4 None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:08.634054 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5ebf5-7247-41a1-b3cc-4094d166fe11 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:08.634308 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c5ebf5-7247-41a1-b3cc-4094d166fe11 None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:08.634661 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f183b98-73c5-4ee8-bd02-34fac2ee2cd4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:08.634994 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f183b98-73c5-4ee8-bd02-34fac2ee2cd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:08.635087 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5ebf5-7247-41a1-b3cc-4094d166fe11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:08.636355 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c5ebf5-7247-41a1-b3cc-4094d166fe11 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:08.636452 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f183b98-73c5-4ee8-bd02-34fac2ee2cd4 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:08.645891 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 495/992] 10.222.0.24 () {56 vars in 1122 bytes} [Mon Apr 11 23:44:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:08.646086 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 498/993] 10.222.0.24 () {56 vars in 1087 bytes} [Mon Apr 11 23:44:08 2022] GET /identity/v3/services => generated 1727 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 23:44:08.647877 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f183b98-73c5-4ee8-bd02-34fac2ee2cd4 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:08.756168 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f183b98-73c5-4ee8-bd02-34fac2ee2cd4 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:08.793814 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d372891-eead-4218-8a5b-b0951e4e1b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:08.794486 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d372891-eead-4218-8a5b-b0951e4e1b50 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:08.794763 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d372891-eead-4218-8a5b-b0951e4e1b50 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:08.795063 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d372891-eead-4218-8a5b-b0951e4e1b50 None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:08.795786 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d372891-eead-4218-8a5b-b0951e4e1b50 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:08.796088 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d372891-eead-4218-8a5b-b0951e4e1b50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:08.797476 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d372891-eead-4218-8a5b-b0951e4e1b50 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:08.808175 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 496/994] 10.222.0.24 () {56 vars in 1122 bytes} [Mon Apr 11 23:44:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:08.809389 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5ebf5-7247-41a1-b3cc-4094d166fe11 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:08.908956 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c5ebf5-7247-41a1-b3cc-4094d166fe11 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:08.943316 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7a57d-c0fc-4a96-ab5d-a136fc6eba9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:08.944039 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7a57d-c0fc-4a96-ab5d-a136fc6eba9f None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:08.944323 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7a57d-c0fc-4a96-ab5d-a136fc6eba9f None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:08.944596 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7a57d-c0fc-4a96-ab5d-a136fc6eba9f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:08.945390 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7a57d-c0fc-4a96-ab5d-a136fc6eba9f None admin] RBAC: Adding query filter params (interface=admin, service_id=e8cccc6eb22444f4adb6519cb5b94bd9, region_id=RegionOne) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:08.945701 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7a57d-c0fc-4a96-ab5d-a136fc6eba9f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:08.947093 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7a57d-c0fc-4a96-ab5d-a136fc6eba9f None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:08.952335 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 499/995] 10.222.0.24 () {56 vars in 1249 bytes} [Mon Apr 11 23:44:08 2022] GET /identity/v3/endpoints?service_id=e8cccc6eb22444f4adb6519cb5b94bd9&interface=admin®ion_id=RegionOne => generated 193 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:08.958273 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d372891-eead-4218-8a5b-b0951e4e1b50 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:09.056879 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d372891-eead-4218-8a5b-b0951e4e1b50 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:09.088481 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd7dd3-1301-45b1-ba4d-cc809faca9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:09.089216 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd7dd3-1301-45b1-ba4d-cc809faca9cc None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:09.089687 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd7dd3-1301-45b1-ba4d-cc809faca9cc None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:09.089957 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd7dd3-1301-45b1-ba4d-cc809faca9cc None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:09.090640 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd7dd3-1301-45b1-ba4d-cc809faca9cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:09.092028 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd7dd3-1301-45b1-ba4d-cc809faca9cc None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:09.098730 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 497/996] 10.222.0.24 () {56 vars in 1087 bytes} [Mon Apr 11 23:44:08 2022] GET /identity/v3/services => generated 1727 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 23:44:10.097958 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c48cb-6100-4ad8-8138-e6036ccee27b None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:10.098448 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c48cb-6100-4ad8-8138-e6036ccee27b None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:10.098448 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c48cb-6100-4ad8-8138-e6036ccee27b None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:10.100371 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 500/997] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:10.105381 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11265c-5768-40bb-8b52-31af0ef82dc9 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:10.105773 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11265c-5768-40bb-8b52-31af0ef82dc9 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:10.105966 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11265c-5768-40bb-8b52-31af0ef82dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:10.122918 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-1e11265c-5768-40bb-8b52-31af0ef82dc9 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:10.124082 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-1e11265c-5768-40bb-8b52-31af0ef82dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:10.188454 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 498/998] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:10 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:10.210815 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c48cb-6100-4ad8-8138-e6036ccee27b None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:10.307264 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c48cb-6100-4ad8-8138-e6036ccee27b None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:10.338731 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca36047-135a-47e4-87b4-eb7bf609ba07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:10.339816 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca36047-135a-47e4-87b4-eb7bf609ba07 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:10.340089 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca36047-135a-47e4-87b4-eb7bf609ba07 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:10.340353 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca36047-135a-47e4-87b4-eb7bf609ba07 None admin] PATH_INFO: `/v3/services/image` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:10.340999 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca36047-135a-47e4-87b4-eb7bf609ba07 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:10.342344 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca36047-135a-47e4-87b4-eb7bf609ba07 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:10.352910 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-5ca36047-135a-47e4-87b4-eb7bf609ba07 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 11 23:44:10.354221 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 501/999] 10.222.0.24 () {56 vars in 1105 bytes} [Mon Apr 11 23:44:10 2022] GET /identity/v3/services/image => generated 86 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:10.360132 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11265c-5768-40bb-8b52-31af0ef82dc9 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:10.454311 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11265c-5768-40bb-8b52-31af0ef82dc9 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:10.487005 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57f1d3-bab4-4d18-a344-0dd60fc6a6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:10.488269 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57f1d3-bab4-4d18-a344-0dd60fc6a6e7 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:10.488548 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57f1d3-bab4-4d18-a344-0dd60fc6a6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:10.488818 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57f1d3-bab4-4d18-a344-0dd60fc6a6e7 None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:10.489519 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57f1d3-bab4-4d18-a344-0dd60fc6a6e7 None admin] RBAC: Adding query filter params (name=image) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:10.489818 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57f1d3-bab4-4d18-a344-0dd60fc6a6e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:10.491190 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57f1d3-bab4-4d18-a344-0dd60fc6a6e7 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:10.500684 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 499/1000] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:44:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:10.501469 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca36047-135a-47e4-87b4-eb7bf609ba07 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:10.600372 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca36047-135a-47e4-87b4-eb7bf609ba07 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:10.633176 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceee299-5b45-4c1e-bd4d-d0ba07ae40f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:10.634176 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceee299-5b45-4c1e-bd4d-d0ba07ae40f3 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:10.634655 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceee299-5b45-4c1e-bd4d-d0ba07ae40f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:10.635146 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceee299-5b45-4c1e-bd4d-d0ba07ae40f3 None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:10.636181 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceee299-5b45-4c1e-bd4d-d0ba07ae40f3 None admin] RBAC: Adding query filter params (type=image) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:10.636704 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceee299-5b45-4c1e-bd4d-d0ba07ae40f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:10.638267 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceee299-5b45-4c1e-bd4d-d0ba07ae40f3 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:10.650863 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 502/1001] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:44:10 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:10.938225 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c907696-2885-4716-8621-57e9a5c7272f None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:10.938412 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c907696-2885-4716-8621-57e9a5c7272f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:10.938679 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c907696-2885-4716-8621-57e9a5c7272f None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:10.940490 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 500/1002] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:44:10.946304 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae8e9b-4844-4415-8822-44b770aa6855 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:10.946660 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae8e9b-4844-4415-8822-44b770aa6855 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:10.947048 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae8e9b-4844-4415-8822-44b770aa6855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:10.964123 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-36ae8e9b-4844-4415-8822-44b770aa6855 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:10.965533 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-36ae8e9b-4844-4415-8822-44b770aa6855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:11.031088 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 503/1003] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:10 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:11.054243 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c907696-2885-4716-8621-57e9a5c7272f None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:11.148623 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c907696-2885-4716-8621-57e9a5c7272f None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:11.182186 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b6209-b259-48be-bd7a-acca1dc4241a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:11.183043 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b6209-b259-48be-bd7a-acca1dc4241a None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:11.183350 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b6209-b259-48be-bd7a-acca1dc4241a None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:11.183622 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b6209-b259-48be-bd7a-acca1dc4241a None admin] PATH_INFO: `/v3/services/compute` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:11.184399 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b6209-b259-48be-bd7a-acca1dc4241a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:11.185822 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b6209-b259-48be-bd7a-acca1dc4241a None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:11.198627 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-e13b6209-b259-48be-bd7a-acca1dc4241a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Apr 11 23:44:11.200001 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 501/1004] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:44:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:11.205901 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae8e9b-4844-4415-8822-44b770aa6855 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:11.309948 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae8e9b-4844-4415-8822-44b770aa6855 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:11.342845 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec554ce-9afc-4333-8dab-dce3214702d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:11.343531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec554ce-9afc-4333-8dab-dce3214702d7 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:11.343803 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec554ce-9afc-4333-8dab-dce3214702d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:11.344070 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec554ce-9afc-4333-8dab-dce3214702d7 None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:11.344770 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec554ce-9afc-4333-8dab-dce3214702d7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:11.345067 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec554ce-9afc-4333-8dab-dce3214702d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:11.346420 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec554ce-9afc-4333-8dab-dce3214702d7 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:11.351496 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 504/1005] 10.222.0.24 () {56 vars in 1112 bytes} [Mon Apr 11 23:44:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:11.356879 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b6209-b259-48be-bd7a-acca1dc4241a None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:11.388995 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b698eb1-075c-4743-9733-4dc1386af438 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:11.389319 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b698eb1-075c-4743-9733-4dc1386af438 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:11.389535 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b698eb1-075c-4743-9733-4dc1386af438 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:11.391485 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 505/1006] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:44:11.396928 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb0685-f57b-465f-b04a-f834fc9ef56f None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:11.397207 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb0685-f57b-465f-b04a-f834fc9ef56f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:11.397478 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb0685-f57b-465f-b04a-f834fc9ef56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:11.414411 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-57bb0685-f57b-465f-b04a-f834fc9ef56f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:11.415594 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-57bb0685-f57b-465f-b04a-f834fc9ef56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:11.454946 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b6209-b259-48be-bd7a-acca1dc4241a None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:11.485134 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 506/1007] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 23:44:11.487943 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc0ab3-8a28-4918-9887-ff84a90a2884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:11.488600 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc0ab3-8a28-4918-9887-ff84a90a2884 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:11.488880 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc0ab3-8a28-4918-9887-ff84a90a2884 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:11.489155 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc0ab3-8a28-4918-9887-ff84a90a2884 None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:11.489856 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc0ab3-8a28-4918-9887-ff84a90a2884 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:11.490157 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc0ab3-8a28-4918-9887-ff84a90a2884 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:11.491537 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc0ab3-8a28-4918-9887-ff84a90a2884 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:11.500728 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 502/1008] 10.222.0.24 () {56 vars in 1112 bytes} [Mon Apr 11 23:44:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:11.502159 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb0685-f57b-465f-b04a-f834fc9ef56f None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:11.508190 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc0ab3-8a28-4918-9887-ff84a90a2884 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:11.606349 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb0685-f57b-465f-b04a-f834fc9ef56f None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:11.608397 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc0ab3-8a28-4918-9887-ff84a90a2884 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:11.642864 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2cad5-bd75-4ee2-922a-5d986170f066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:11.643675 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2cad5-bd75-4ee2-922a-5d986170f066 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:11.643976 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2cad5-bd75-4ee2-922a-5d986170f066 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:11.644245 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2cad5-bd75-4ee2-922a-5d986170f066 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:11.644892 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2cad5-bd75-4ee2-922a-5d986170f066 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:11.646237 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2cad5-bd75-4ee2-922a-5d986170f066 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:11.647755 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519348f2-2fcf-4b15-b598-93606387966d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:11.648869 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519348f2-2fcf-4b15-b598-93606387966d None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:11.649198 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519348f2-2fcf-4b15-b598-93606387966d None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:11.649474 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519348f2-2fcf-4b15-b598-93606387966d None admin] PATH_INFO: `/v3/endpoints` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:11.650546 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519348f2-2fcf-4b15-b598-93606387966d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:11.651918 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519348f2-2fcf-4b15-b598-93606387966d None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:11.658049 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-d1e2cad5-bd75-4ee2-922a-5d986170f066 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Apr 11 23:44:11.659475 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 503/1009] 10.222.0.24 () {56 vars in 1126 bytes} [Mon Apr 11 23:44:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:44:11.665135 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2cad5-bd75-4ee2-922a-5d986170f066 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:11.735201 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 507/1010] 10.222.0.24 () {60 vars in 1144 bytes} [Mon Apr 11 23:44:11 2022] POST /identity/v3/endpoints => generated 334 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 23:44:11.763208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2cad5-bd75-4ee2-922a-5d986170f066 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:11.811300 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758dbf0-176e-4cda-9b1f-f3f21a100432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:11.811993 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758dbf0-176e-4cda-9b1f-f3f21a100432 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:11.813770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758dbf0-176e-4cda-9b1f-f3f21a100432 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:11.813770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0758dbf0-176e-4cda-9b1f-f3f21a100432 None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:11.813770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758dbf0-176e-4cda-9b1f-f3f21a100432 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:11.813770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758dbf0-176e-4cda-9b1f-f3f21a100432 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:11.814911 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0758dbf0-176e-4cda-9b1f-f3f21a100432 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:11.826008 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 504/1011] 10.222.0.24 () {56 vars in 1122 bytes} [Mon Apr 11 23:44:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:11.827447 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519348f2-2fcf-4b15-b598-93606387966d None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:11.929502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519348f2-2fcf-4b15-b598-93606387966d None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:11.962539 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074f995-171b-4cc3-851d-2ed994f2fbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:11.963234 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074f995-171b-4cc3-851d-2ed994f2fbf7 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:11.963527 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074f995-171b-4cc3-851d-2ed994f2fbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:11.963791 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074f995-171b-4cc3-851d-2ed994f2fbf7 None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:11.964756 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074f995-171b-4cc3-851d-2ed994f2fbf7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:11.965056 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074f995-171b-4cc3-851d-2ed994f2fbf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:11.966396 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074f995-171b-4cc3-851d-2ed994f2fbf7 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:11.971327 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 508/1012] 10.222.0.24 () {56 vars in 1122 bytes} [Mon Apr 11 23:44:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:11.977317 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758dbf0-176e-4cda-9b1f-f3f21a100432 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:12.078086 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0758dbf0-176e-4cda-9b1f-f3f21a100432 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:12.110572 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af03946-f6c1-41ea-8547-cf08c2d2eac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:12.111260 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03946-f6c1-41ea-8547-cf08c2d2eac5 None admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:12.111541 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03946-f6c1-41ea-8547-cf08c2d2eac5 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:12.111818 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af03946-f6c1-41ea-8547-cf08c2d2eac5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:12.113120 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af03946-f6c1-41ea-8547-cf08c2d2eac5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:12.114517 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af03946-f6c1-41ea-8547-cf08c2d2eac5 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:12.179150 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 505/1013] 10.222.0.24 () {60 vars in 1144 bytes} [Mon Apr 11 23:44:11 2022] POST /identity/v3/endpoints => generated 325 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:44:12.953566 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cca859-52d8-414b-ae54-efdc79381b9e None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:12.954079 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cca859-52d8-414b-ae54-efdc79381b9e None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:12.954185 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cca859-52d8-414b-ae54-efdc79381b9e None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:12.955984 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 509/1014] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:12.961156 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56dd6f-fa8f-4698-bdb4-bc868b77e825 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:12.961452 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56dd6f-fa8f-4698-bdb4-bc868b77e825 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:12.961727 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56dd6f-fa8f-4698-bdb4-bc868b77e825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:12.980203 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-df56dd6f-fa8f-4698-bdb4-bc868b77e825 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:12.981419 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-df56dd6f-fa8f-4698-bdb4-bc868b77e825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:13.054006 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 506/1015] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:12 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:13.077185 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cca859-52d8-414b-ae54-efdc79381b9e None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:13.182860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cca859-52d8-414b-ae54-efdc79381b9e None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:13.222860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f6932-3ff5-46ab-982c-9bb72385164c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:13.222860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f6932-3ff5-46ab-982c-9bb72385164c None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:13.222860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f6932-3ff5-46ab-982c-9bb72385164c None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:13.222860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f6932-3ff5-46ab-982c-9bb72385164c None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:13.223346 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f6932-3ff5-46ab-982c-9bb72385164c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:13.223438 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f6932-3ff5-46ab-982c-9bb72385164c None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:13.298798 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 510/1016] 10.222.0.24 () {60 vars in 1141 bytes} [Mon Apr 11 23:44:13 2022] POST /identity/v3/services => generated 242 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:44:14.155710 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1b32a-8173-48a0-be71-48995604142e None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:14.156315 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1b32a-8173-48a0-be71-48995604142e None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:14.156315 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1b32a-8173-48a0-be71-48995604142e None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:14.158402 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 507/1017] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:14.164433 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7c1c0-92cf-4e85-a31b-8f584c2473df None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:14.164919 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7c1c0-92cf-4e85-a31b-8f584c2473df None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:14.164997 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff7c1c0-92cf-4e85-a31b-8f584c2473df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:14.186003 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-eff7c1c0-92cf-4e85-a31b-8f584c2473df None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:14.187217 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-eff7c1c0-92cf-4e85-a31b-8f584c2473df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:14.257992 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 511/1018] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:14.281383 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1b32a-8173-48a0-be71-48995604142e None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:14.380641 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1b32a-8173-48a0-be71-48995604142e None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:14.412843 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63908431-915a-4a4e-bede-5429840803b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:14.413571 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63908431-915a-4a4e-bede-5429840803b6 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:14.413849 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63908431-915a-4a4e-bede-5429840803b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:14.414115 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63908431-915a-4a4e-bede-5429840803b6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:14.424061 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63908431-915a-4a4e-bede-5429840803b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:44:14.431523 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-63908431-915a-4a4e-bede-5429840803b6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 23:44:14.432950 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 508/1019] 10.222.0.24 () {56 vars in 1120 bytes} [Mon Apr 11 23:44:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:14.438915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7c1c0-92cf-4e85-a31b-8f584c2473df None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:14.513296 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74dbf9-29d2-4b98-86bf-b3c658d2a768 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:14.513578 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74dbf9-29d2-4b98-86bf-b3c658d2a768 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:14.513862 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74dbf9-29d2-4b98-86bf-b3c658d2a768 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:14.515813 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 509/1020] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:14.522347 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1715452-a4e4-4777-aed4-a485ec503aab None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:14.522626 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1715452-a4e4-4777-aed4-a485ec503aab None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:14.522939 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1715452-a4e4-4777-aed4-a485ec503aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:14.535415 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff7c1c0-92cf-4e85-a31b-8f584c2473df None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:14.539879 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-f1715452-a4e4-4777-aed4-a485ec503aab None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:14.541085 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-f1715452-a4e4-4777-aed4-a485ec503aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:14.570246 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a9ebd-6626-4f43-9c03-93c0f56caf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:14.570947 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a9ebd-6626-4f43-9c03-93c0f56caf83 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:14.571231 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a9ebd-6626-4f43-9c03-93c0f56caf83 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:14.571506 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a9ebd-6626-4f43-9c03-93c0f56caf83 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:14.572254 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a9ebd-6626-4f43-9c03-93c0f56caf83 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:14.572563 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a9ebd-6626-4f43-9c03-93c0f56caf83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:14.573911 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42a9ebd-6626-4f43-9c03-93c0f56caf83 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:14.586383 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 512/1021] 10.222.0.24 () {56 vars in 1115 bytes} [Mon Apr 11 23:44:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:14.587626 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a9ebd-6626-4f43-9c03-93c0f56caf83 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:14.618960 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 510/1022] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 23:44:14.633539 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1715452-a4e4-4777-aed4-a485ec503aab None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:14.684000 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a9ebd-6626-4f43-9c03-93c0f56caf83 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:14.717941 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14671e-8c00-45b8-b238-d7250d625b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:14.718724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14671e-8c00-45b8-b238-d7250d625b20 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:14.719037 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14671e-8c00-45b8-b238-d7250d625b20 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:14.719313 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa14671e-8c00-45b8-b238-d7250d625b20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:14.727242 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1715452-a4e4-4777-aed4-a485ec503aab None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:14.729525 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14671e-8c00-45b8-b238-d7250d625b20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:14.731015 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa14671e-8c00-45b8-b238-d7250d625b20 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:14.747907 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-fa14671e-8c00-45b8-b238-d7250d625b20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:44:14.754877 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 513/1023] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:14.758665 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14671e-8c00-45b8-b238-d7250d625b20 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:14.762605 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15f56e-9235-42d1-9f7d-d1a52eca1870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:14.763425 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15f56e-9235-42d1-9f7d-d1a52eca1870 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:14.763712 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15f56e-9235-42d1-9f7d-d1a52eca1870 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:14.764041 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac15f56e-9235-42d1-9f7d-d1a52eca1870 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:14.765270 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15f56e-9235-42d1-9f7d-d1a52eca1870 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:14.768430 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac15f56e-9235-42d1-9f7d-d1a52eca1870 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:14.768829 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 511/1024] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:44:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:14.774176 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15f56e-9235-42d1-9f7d-d1a52eca1870 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:14.860564 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa14671e-8c00-45b8-b238-d7250d625b20 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:14.869924 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac15f56e-9235-42d1-9f7d-d1a52eca1870 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:14.898547 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d098b-fa04-4843-b59c-5e590a1eec16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:14.899248 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d098b-fa04-4843-b59c-5e590a1eec16 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:14.899526 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d098b-fa04-4843-b59c-5e590a1eec16 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:14.899797 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d098b-fa04-4843-b59c-5e590a1eec16 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:14.900510 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d098b-fa04-4843-b59c-5e590a1eec16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:14.900809 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d098b-fa04-4843-b59c-5e590a1eec16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:14.902160 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d098b-fa04-4843-b59c-5e590a1eec16 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:14.909369 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29cd61-8096-41dc-86b7-a4192a301f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:14.910026 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29cd61-8096-41dc-86b7-a4192a301f31 None admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:14.910303 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29cd61-8096-41dc-86b7-a4192a301f31 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:14.910575 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29cd61-8096-41dc-86b7-a4192a301f31 None admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:14.911321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29cd61-8096-41dc-86b7-a4192a301f31 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:14.912715 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29cd61-8096-41dc-86b7-a4192a301f31 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:14.914034 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 514/1025] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:14.919308 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d098b-fa04-4843-b59c-5e590a1eec16 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:15.002524 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 512/1026] 10.222.0.24 () {60 vars in 1141 bytes} [Mon Apr 11 23:44:14 2022] POST /identity/v3/projects => generated 311 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 23:44:15.013979 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d098b-fa04-4843-b59c-5e590a1eec16 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:15.051258 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d1141-8eb0-4b00-8686-de27af57559b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:15.052078 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d1141-8eb0-4b00-8686-de27af57559b None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:15.052353 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d1141-8eb0-4b00-8686-de27af57559b None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:15.052621 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d1141-8eb0-4b00-8686-de27af57559b None admin] PATH_INFO: `/v3/users/nova` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:15.060849 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d1141-8eb0-4b00-8686-de27af57559b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:15.062451 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d1141-8eb0-4b00-8686-de27af57559b None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:15.077641 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-aa3d1141-8eb0-4b00-8686-de27af57559b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 23:44:15.079100 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 515/1027] 10.222.0.24 () {56 vars in 1093 bytes} [Mon Apr 11 23:44:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:44:15.084829 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29cd61-8096-41dc-86b7-a4192a301f31 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:15.187580 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29cd61-8096-41dc-86b7-a4192a301f31 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:15.221083 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0029267-70fb-463c-aa7f-c0b0c5fa6b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:15.221748 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0029267-70fb-463c-aa7f-c0b0c5fa6b9a None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:15.222538 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0029267-70fb-463c-aa7f-c0b0c5fa6b9a None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:15.222799 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0029267-70fb-463c-aa7f-c0b0c5fa6b9a None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:15.223662 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0029267-70fb-463c-aa7f-c0b0c5fa6b9a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:15.223965 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0029267-70fb-463c-aa7f-c0b0c5fa6b9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:15.225369 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0029267-70fb-463c-aa7f-c0b0c5fa6b9a None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:15.243697 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 513/1028] 10.222.0.24 () {56 vars in 1133 bytes} [Mon Apr 11 23:44:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:15.249731 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d1141-8eb0-4b00-8686-de27af57559b None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:15.349605 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d1141-8eb0-4b00-8686-de27af57559b None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:15.381757 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ea3c9-c02c-4b9e-b2e8-09b0c5f62829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:15.382401 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ea3c9-c02c-4b9e-b2e8-09b0c5f62829 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:15.382678 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ea3c9-c02c-4b9e-b2e8-09b0c5f62829 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:15.382995 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ea3c9-c02c-4b9e-b2e8-09b0c5f62829 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:15.446438 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ea3c9-c02c-4b9e-b2e8-09b0c5f62829 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:15.447915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ea3c9-c02c-4b9e-b2e8-09b0c5f62829 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:15.545659 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 516/1029] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:44:15 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 23:44:15.547346 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0029267-70fb-463c-aa7f-c0b0c5fa6b9a None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:15.619503 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a0614-cf81-4c1c-9c9a-9c411a0bd0c3 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:15.619864 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a0614-cf81-4c1c-9c9a-9c411a0bd0c3 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:15.620056 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a0614-cf81-4c1c-9c9a-9c411a0bd0c3 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:15.621959 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 517/1030] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:44:15.626609 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d62e34-66de-4721-a161-402275c58753 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:15.626920 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d62e34-66de-4721-a161-402275c58753 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:15.627200 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d62e34-66de-4721-a161-402275c58753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:15.641715 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0029267-70fb-463c-aa7f-c0b0c5fa6b9a None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:15.643396 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-13d62e34-66de-4721-a161-402275c58753 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:15.645121 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-13d62e34-66de-4721-a161-402275c58753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:15.675329 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84d676-2660-4d36-b933-f16290949f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:15.676114 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84d676-2660-4d36-b933-f16290949f42 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:15.676440 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84d676-2660-4d36-b933-f16290949f42 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:15.676669 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c84d676-2660-4d36-b933-f16290949f42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:15.686981 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84d676-2660-4d36-b933-f16290949f42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:15.688432 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c84d676-2660-4d36-b933-f16290949f42 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:15.705374 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-7c84d676-2660-4d36-b933-f16290949f42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:44:15.707152 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 514/1031] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:44:15.714684 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 518/1032] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 23:44:15.723784 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84d676-2660-4d36-b933-f16290949f42 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:15.734258 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d62e34-66de-4721-a161-402275c58753 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:15.825874 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c84d676-2660-4d36-b933-f16290949f42 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:15.829240 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d62e34-66de-4721-a161-402275c58753 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:15.860329 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c4ad2-c72f-4ccc-bf76-848d3f8044b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:15.861273 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c4ad2-c72f-4ccc-bf76-848d3f8044b8 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:15.861549 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c4ad2-c72f-4ccc-bf76-848d3f8044b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:15.861822 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7c4ad2-c72f-4ccc-bf76-848d3f8044b8 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:15.862540 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c4ad2-c72f-4ccc-bf76-848d3f8044b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:15.862881 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c4ad2-c72f-4ccc-bf76-848d3f8044b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:15.863988 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107eee0-79b1-4d49-8da6-d4e99fad8081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:15.864579 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7c4ad2-c72f-4ccc-bf76-848d3f8044b8 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:15.864765 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107eee0-79b1-4d49-8da6-d4e99fad8081 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:15.865045 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107eee0-79b1-4d49-8da6-d4e99fad8081 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:15.865316 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107eee0-79b1-4d49-8da6-d4e99fad8081 None admin] PATH_INFO: `/v3/services/image` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:15.866101 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107eee0-79b1-4d49-8da6-d4e99fad8081 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:15.867377 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107eee0-79b1-4d49-8da6-d4e99fad8081 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:15.881148 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 515/1033] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:15.881311 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-6107eee0-79b1-4d49-8da6-d4e99fad8081 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 11 23:44:15.881311 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 519/1034] 10.222.0.24 () {56 vars in 1105 bytes} [Mon Apr 11 23:44:15 2022] GET /identity/v3/services/image => generated 86 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:44:15.885477 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c4ad2-c72f-4ccc-bf76-848d3f8044b8 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:15.886891 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107eee0-79b1-4d49-8da6-d4e99fad8081 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:15.984590 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107eee0-79b1-4d49-8da6-d4e99fad8081 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:15.986214 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7c4ad2-c72f-4ccc-bf76-848d3f8044b8 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:16.016965 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db64194-9d9d-449d-8f36-75df9a3eccc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:16.017623 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db64194-9d9d-449d-8f36-75df9a3eccc9 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:16.017897 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db64194-9d9d-449d-8f36-75df9a3eccc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:16.018161 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db64194-9d9d-449d-8f36-75df9a3eccc9 None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:16.018533 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0d687-fff2-46a1-904c-de3de04bb4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:16.019428 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db64194-9d9d-449d-8f36-75df9a3eccc9 None admin] RBAC: Adding query filter params (name=image) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:16.019731 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db64194-9d9d-449d-8f36-75df9a3eccc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:16.019925 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0d687-fff2-46a1-904c-de3de04bb4b9 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:16.020197 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0d687-fff2-46a1-904c-de3de04bb4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:16.020461 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0d687-fff2-46a1-904c-de3de04bb4b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:16.021073 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db64194-9d9d-449d-8f36-75df9a3eccc9 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:16.030700 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 520/1035] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:44:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:16.030898 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0d687-fff2-46a1-904c-de3de04bb4b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:16.030898 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0d687-fff2-46a1-904c-de3de04bb4b9 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:16.031911 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db64194-9d9d-449d-8f36-75df9a3eccc9 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:16.042426 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-87d0d687-fff2-46a1-904c-de3de04bb4b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:44:16.048380 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 516/1036] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:44:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:16.049527 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0d687-fff2-46a1-904c-de3de04bb4b9 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:16.131717 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db64194-9d9d-449d-8f36-75df9a3eccc9 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:16.146931 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0d687-fff2-46a1-904c-de3de04bb4b9 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:16.163425 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf04098-2ca3-4f1e-af2f-e96403df50d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:16.164085 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf04098-2ca3-4f1e-af2f-e96403df50d1 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:16.164361 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf04098-2ca3-4f1e-af2f-e96403df50d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:16.164629 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf04098-2ca3-4f1e-af2f-e96403df50d1 None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:16.165335 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf04098-2ca3-4f1e-af2f-e96403df50d1 None admin] RBAC: Adding query filter params (type=image) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:16.165634 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf04098-2ca3-4f1e-af2f-e96403df50d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:16.167028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf04098-2ca3-4f1e-af2f-e96403df50d1 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:16.172835 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 521/1037] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:44:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:16.179169 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf04098-2ca3-4f1e-af2f-e96403df50d1 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:16.182422 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6dffa-0747-4c4d-b157-0708810cb155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:16.186825 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6dffa-0747-4c4d-b157-0708810cb155 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:16.187145 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6dffa-0747-4c4d-b157-0708810cb155 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:16.187423 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6dffa-0747-4c4d-b157-0708810cb155 None admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:16.188566 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6dffa-0747-4c4d-b157-0708810cb155 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:16.189092 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6dffa-0747-4c4d-b157-0708810cb155 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:16.190319 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6dffa-0747-4c4d-b157-0708810cb155 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:16.206866 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 517/1038] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:44:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:16.209699 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6dffa-0747-4c4d-b157-0708810cb155 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:16.288591 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf04098-2ca3-4f1e-af2f-e96403df50d1 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:16.305158 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6dffa-0747-4c4d-b157-0708810cb155 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:16.320950 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c86d05-bb52-4dcc-aeea-8fb22f8dd399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:16.321783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c86d05-bb52-4dcc-aeea-8fb22f8dd399 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:16.322064 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c86d05-bb52-4dcc-aeea-8fb22f8dd399 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:16.322333 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c86d05-bb52-4dcc-aeea-8fb22f8dd399 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:16.323167 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c86d05-bb52-4dcc-aeea-8fb22f8dd399 None admin] RBAC: Adding query filter params (interface=public, service_id=d81952b7be414349be66d738d8b65d90, region_id=RegionOne) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:16.323475 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c86d05-bb52-4dcc-aeea-8fb22f8dd399 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:16.324820 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c86d05-bb52-4dcc-aeea-8fb22f8dd399 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:16.329739 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 522/1039] 10.222.0.24 () {56 vars in 1251 bytes} [Mon Apr 11 23:44:16 2022] GET /identity/v3/endpoints?service_id=d81952b7be414349be66d738d8b65d90&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:16.335245 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c86d05-bb52-4dcc-aeea-8fb22f8dd399 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:16.337524 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da45525-0f1c-4042-a369-ad5ca3c4e0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:16.338166 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da45525-0f1c-4042-a369-ad5ca3c4e0e9 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:16.338985 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da45525-0f1c-4042-a369-ad5ca3c4e0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:16.338985 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da45525-0f1c-4042-a369-ad5ca3c4e0e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:16.339832 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da45525-0f1c-4042-a369-ad5ca3c4e0e9 None admin] RBAC: Adding query filter params (role.id=b67d5ca11fd247f589cc04fcb8f4e072, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=a9519f49f897415a894c1121278dda9c) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:16.340137 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da45525-0f1c-4042-a369-ad5ca3c4e0e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:16.341534 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da45525-0f1c-4042-a369-ad5ca3c4e0e9 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:16.355274 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 518/1040] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:44:16 2022] GET /identity/v3/role_assignments?user.id=a9519f49f897415a894c1121278dda9c&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=b67d5ca11fd247f589cc04fcb8f4e072 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:16.437258 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c86d05-bb52-4dcc-aeea-8fb22f8dd399 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:16.471730 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282162df-bb86-4585-bf3d-9ae5729b5dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:16.472954 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282162df-bb86-4585-bf3d-9ae5729b5dfe None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:16.473232 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282162df-bb86-4585-bf3d-9ae5729b5dfe None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:16.473502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282162df-bb86-4585-bf3d-9ae5729b5dfe None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:16.474189 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282162df-bb86-4585-bf3d-9ae5729b5dfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:16.475622 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282162df-bb86-4585-bf3d-9ae5729b5dfe None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:16.491110 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 523/1041] 10.222.0.24 () {56 vars in 1087 bytes} [Mon Apr 11 23:44:16 2022] GET /identity/v3/services => generated 1957 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 11 23:44:17.345319 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07725f94-5029-4a82-a221-e2b1937d6fd7 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:17.345864 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07725f94-5029-4a82-a221-e2b1937d6fd7 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:17.345864 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07725f94-5029-4a82-a221-e2b1937d6fd7 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:17.348252 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 519/1042] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:17.353379 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dacb7-1fcc-4bf9-8b95-b602345f67c2 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:17.353828 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dacb7-1fcc-4bf9-8b95-b602345f67c2 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:17.353909 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9dacb7-1fcc-4bf9-8b95-b602345f67c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:17.371172 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-0f9dacb7-1fcc-4bf9-8b95-b602345f67c2 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:17.372344 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-0f9dacb7-1fcc-4bf9-8b95-b602345f67c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:17.441408 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 524/1043] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:17.465334 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07725f94-5029-4a82-a221-e2b1937d6fd7 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:17.561405 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07725f94-5029-4a82-a221-e2b1937d6fd7 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:17.593189 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958df7b-0946-4811-94dc-19d3177e236f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:17.593967 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958df7b-0946-4811-94dc-19d3177e236f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:17.594242 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958df7b-0946-4811-94dc-19d3177e236f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:17.594511 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958df7b-0946-4811-94dc-19d3177e236f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:17.595764 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958df7b-0946-4811-94dc-19d3177e236f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:17.597814 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b958df7b-0946-4811-94dc-19d3177e236f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:17.599668 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 520/1044] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:44:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:17.605342 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9dacb7-1fcc-4bf9-8b95-b602345f67c2 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:17.696733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9dacb7-1fcc-4bf9-8b95-b602345f67c2 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:17.735421 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea59099-7be1-4ed6-844e-3aa9ea71d130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:17.736082 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea59099-7be1-4ed6-844e-3aa9ea71d130 None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:17.736355 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea59099-7be1-4ed6-844e-3aa9ea71d130 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:17.736622 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea59099-7be1-4ed6-844e-3aa9ea71d130 None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:17.737324 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea59099-7be1-4ed6-844e-3aa9ea71d130 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:17.738743 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea59099-7be1-4ed6-844e-3aa9ea71d130 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:17.832756 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 525/1045] 10.222.0.24 () {60 vars in 1132 bytes} [Mon Apr 11 23:44:17 2022] POST /identity/v3/users => generated 285 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:44:18.629782 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e06fa6-d76f-414c-b912-97e98dd2dccc None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:18.630339 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e06fa6-d76f-414c-b912-97e98dd2dccc None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:18.630339 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e06fa6-d76f-414c-b912-97e98dd2dccc None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:18.632205 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 521/1046] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:18.637479 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f2ccd-5404-4bbc-9130-ed556448a726 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:18.637873 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f2ccd-5404-4bbc-9130-ed556448a726 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:18.638052 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f2ccd-5404-4bbc-9130-ed556448a726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:18.655411 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-636f2ccd-5404-4bbc-9130-ed556448a726 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:18.656577 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-636f2ccd-5404-4bbc-9130-ed556448a726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:18.720776 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 526/1047] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:18.743323 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e06fa6-d76f-414c-b912-97e98dd2dccc None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:18.792762 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb48c70-e27f-43bf-b75a-4ac3af4cbc97 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:18.793045 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb48c70-e27f-43bf-b75a-4ac3af4cbc97 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:18.793501 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb48c70-e27f-43bf-b75a-4ac3af4cbc97 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:18.795475 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 527/1048] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:44:18.800060 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9ccf5-a702-49df-8e6d-dd276b52c581 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:18.800336 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9ccf5-a702-49df-8e6d-dd276b52c581 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:18.800614 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9ccf5-a702-49df-8e6d-dd276b52c581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:18.817167 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-18d9ccf5-a702-49df-8e6d-dd276b52c581 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:18.818338 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-18d9ccf5-a702-49df-8e6d-dd276b52c581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:18.842563 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e06fa6-d76f-414c-b912-97e98dd2dccc None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:18.876867 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdc81c-97f9-4a5f-b767-9e60b3c9da06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:18.877670 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdc81c-97f9-4a5f-b767-9e60b3c9da06 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:18.877948 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdc81c-97f9-4a5f-b767-9e60b3c9da06 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:18.878750 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfdc81c-97f9-4a5f-b767-9e60b3c9da06 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:18.886934 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 528/1049] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:18 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 23:44:18.895384 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfdc81c-97f9-4a5f-b767-9e60b3c9da06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:44:18.902588 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-1dfdc81c-97f9-4a5f-b767-9e60b3c9da06 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 23:44:18.903951 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 522/1050] 10.222.0.24 () {56 vars in 1120 bytes} [Mon Apr 11 23:44:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:18.907326 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9ccf5-a702-49df-8e6d-dd276b52c581 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:18.909713 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdc81c-97f9-4a5f-b767-9e60b3c9da06 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:19.005695 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9ccf5-a702-49df-8e6d-dd276b52c581 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:19.012135 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfdc81c-97f9-4a5f-b767-9e60b3c9da06 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:19.039374 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffc811-8c3d-433c-86eb-44bd5a387b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:19.040161 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffc811-8c3d-433c-86eb-44bd5a387b18 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:19.040425 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffc811-8c3d-433c-86eb-44bd5a387b18 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:19.045315 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffc811-8c3d-433c-86eb-44bd5a387b18 None admin] PATH_INFO: `/v3/services/image` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:19.045315 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffc811-8c3d-433c-86eb-44bd5a387b18 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:19.045315 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffc811-8c3d-433c-86eb-44bd5a387b18 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:19.050960 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6a60d-90aa-487f-b69a-2e0456b61e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:19.051623 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6a60d-90aa-487f-b69a-2e0456b61e99 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:19.051898 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6a60d-90aa-487f-b69a-2e0456b61e99 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:19.052167 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6a60d-90aa-487f-b69a-2e0456b61e99 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:19.052953 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6a60d-90aa-487f-b69a-2e0456b61e99 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:19.053209 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6a60d-90aa-487f-b69a-2e0456b61e99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:19.054545 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6a60d-90aa-487f-b69a-2e0456b61e99 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:19.055755 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-2bffc811-8c3d-433c-86eb-44bd5a387b18 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Apr 11 23:44:19.056941 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 529/1051] 10.222.0.24 () {56 vars in 1105 bytes} [Mon Apr 11 23:44:18 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:19.062651 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffc811-8c3d-433c-86eb-44bd5a387b18 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:19.072277 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 523/1052] 10.222.0.24 () {56 vars in 1115 bytes} [Mon Apr 11 23:44:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:19.073282 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6a60d-90aa-487f-b69a-2e0456b61e99 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:19.162354 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffc811-8c3d-433c-86eb-44bd5a387b18 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:19.169755 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6a60d-90aa-487f-b69a-2e0456b61e99 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:19.194237 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae96b3a-a590-4434-baf9-aab11adfee99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:19.195116 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae96b3a-a590-4434-baf9-aab11adfee99 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:19.195397 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae96b3a-a590-4434-baf9-aab11adfee99 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:19.195699 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae96b3a-a590-4434-baf9-aab11adfee99 None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:19.196366 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae96b3a-a590-4434-baf9-aab11adfee99 None admin] RBAC: Adding query filter params (name=image) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:19.196715 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae96b3a-a590-4434-baf9-aab11adfee99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:19.198074 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae96b3a-a590-4434-baf9-aab11adfee99 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:19.202131 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60291e7e-37ee-48b4-8f7e-528d90bdde21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:19.202920 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 530/1053] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:44:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:19.203040 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60291e7e-37ee-48b4-8f7e-528d90bdde21 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:19.203219 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60291e7e-37ee-48b4-8f7e-528d90bdde21 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:19.203488 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60291e7e-37ee-48b4-8f7e-528d90bdde21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:19.208750 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae96b3a-a590-4434-baf9-aab11adfee99 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:19.214819 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60291e7e-37ee-48b4-8f7e-528d90bdde21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:19.216267 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60291e7e-37ee-48b4-8f7e-528d90bdde21 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:19.232793 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-60291e7e-37ee-48b4-8f7e-528d90bdde21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:44:19.234019 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 524/1054] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:19.239666 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60291e7e-37ee-48b4-8f7e-528d90bdde21 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:19.313240 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae96b3a-a590-4434-baf9-aab11adfee99 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:19.333580 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60291e7e-37ee-48b4-8f7e-528d90bdde21 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:19.346115 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2f2c1-525b-48e7-9134-f61e5b5ab5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:19.347352 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2f2c1-525b-48e7-9134-f61e5b5ab5db None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:19.347643 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2f2c1-525b-48e7-9134-f61e5b5ab5db None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:19.347911 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2f2c1-525b-48e7-9134-f61e5b5ab5db None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:19.348645 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2f2c1-525b-48e7-9134-f61e5b5ab5db None admin] RBAC: Adding query filter params (type=image) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:19.348950 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2f2c1-525b-48e7-9134-f61e5b5ab5db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:19.350292 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2f2c1-525b-48e7-9134-f61e5b5ab5db None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:19.354816 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 531/1055] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:44:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:19.360345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2f2c1-525b-48e7-9134-f61e5b5ab5db None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:19.367765 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef890ce5-c471-49b0-aee4-4ffadafb1dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:19.368421 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef890ce5-c471-49b0-aee4-4ffadafb1dfb None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:19.368703 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef890ce5-c471-49b0-aee4-4ffadafb1dfb None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:19.368972 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef890ce5-c471-49b0-aee4-4ffadafb1dfb None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:19.369687 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef890ce5-c471-49b0-aee4-4ffadafb1dfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:19.369986 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef890ce5-c471-49b0-aee4-4ffadafb1dfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:19.371366 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef890ce5-c471-49b0-aee4-4ffadafb1dfb None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:19.383035 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 525/1056] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:19.388268 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef890ce5-c471-49b0-aee4-4ffadafb1dfb None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:19.456633 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2f2c1-525b-48e7-9134-f61e5b5ab5db None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:19.484068 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef890ce5-c471-49b0-aee4-4ffadafb1dfb None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:19.489672 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6542b-7e1a-4cbd-9491-1a53f00150ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:19.490331 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6542b-7e1a-4cbd-9491-1a53f00150ff None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:19.490612 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6542b-7e1a-4cbd-9491-1a53f00150ff None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:19.490909 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6542b-7e1a-4cbd-9491-1a53f00150ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:19.491646 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6542b-7e1a-4cbd-9491-1a53f00150ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:19.493010 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6542b-7e1a-4cbd-9491-1a53f00150ff None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:19.517657 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8a6dd-18f7-4204-a5e8-5553a782bc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:19.518742 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8a6dd-18f7-4204-a5e8-5553a782bc2f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:19.518742 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8a6dd-18f7-4204-a5e8-5553a782bc2f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:19.519019 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf8a6dd-18f7-4204-a5e8-5553a782bc2f None admin] PATH_INFO: `/v3/users/nova` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:19.525845 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8a6dd-18f7-4204-a5e8-5553a782bc2f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:19.527299 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf8a6dd-18f7-4204-a5e8-5553a782bc2f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:19.541076 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-adf8a6dd-18f7-4204-a5e8-5553a782bc2f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 23:44:19.542238 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 526/1057] 10.222.0.24 () {56 vars in 1093 bytes} [Mon Apr 11 23:44:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:44:19.547837 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8a6dd-18f7-4204-a5e8-5553a782bc2f None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:19.586920 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 532/1058] 10.222.0.24 () {60 vars in 1144 bytes} [Mon Apr 11 23:44:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:44:19.658396 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf8a6dd-18f7-4204-a5e8-5553a782bc2f None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:19.700980 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175295e-102f-44b1-80b8-c6dbd567a492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:19.702109 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175295e-102f-44b1-80b8-c6dbd567a492 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:19.702619 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175295e-102f-44b1-80b8-c6dbd567a492 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:19.703117 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175295e-102f-44b1-80b8-c6dbd567a492 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:19.704162 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175295e-102f-44b1-80b8-c6dbd567a492 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:19.704690 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175295e-102f-44b1-80b8-c6dbd567a492 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:19.706393 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175295e-102f-44b1-80b8-c6dbd567a492 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:19.732432 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 527/1059] 10.222.0.24 () {56 vars in 1133 bytes} [Mon Apr 11 23:44:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:19.738464 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6542b-7e1a-4cbd-9491-1a53f00150ff None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:19.845400 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6542b-7e1a-4cbd-9491-1a53f00150ff None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:19.877889 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d2c4f-ef7a-4d11-876d-ba1f37b94582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:19.879191 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d2c4f-ef7a-4d11-876d-ba1f37b94582 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:19.879671 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d2c4f-ef7a-4d11-876d-ba1f37b94582 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:19.880136 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d2c4f-ef7a-4d11-876d-ba1f37b94582 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:19.890750 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d2c4f-ef7a-4d11-876d-ba1f37b94582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:19.892653 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d2c4f-ef7a-4d11-876d-ba1f37b94582 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:19.914585 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-853d2c4f-ef7a-4d11-876d-ba1f37b94582 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:44:19.916609 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 533/1060] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:44:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:19.921894 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175295e-102f-44b1-80b8-c6dbd567a492 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:20.016152 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175295e-102f-44b1-80b8-c6dbd567a492 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:20.049477 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a78c8-206c-4c95-b238-45e5a3671a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:20.052324 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a78c8-206c-4c95-b238-45e5a3671a06 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:20.052324 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a78c8-206c-4c95-b238-45e5a3671a06 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:20.052324 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a78c8-206c-4c95-b238-45e5a3671a06 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:20.052324 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a78c8-206c-4c95-b238-45e5a3671a06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:20.052324 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a78c8-206c-4c95-b238-45e5a3671a06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:20.053832 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a78c8-206c-4c95-b238-45e5a3671a06 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:20.065174 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 528/1061] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:20.070384 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d2c4f-ef7a-4d11-876d-ba1f37b94582 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:20.164806 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81a8be-be3b-4ff0-9598-c6fb2d0d0a8d None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:20.165098 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81a8be-be3b-4ff0-9598-c6fb2d0d0a8d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:20.165371 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f81a8be-be3b-4ff0-9598-c6fb2d0d0a8d None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:20.167377 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 529/1062] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:44:20.167555 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d2c4f-ef7a-4d11-876d-ba1f37b94582 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:20.172370 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254a004-471e-4886-baee-6524aaf906ec None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:20.172652 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254a004-471e-4886-baee-6524aaf906ec None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:20.172926 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254a004-471e-4886-baee-6524aaf906ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:20.189033 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-a254a004-471e-4886-baee-6524aaf906ec None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:20.190208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-a254a004-471e-4886-baee-6524aaf906ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:20.201136 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239d4ee-98c7-4f64-bb0f-9d5df1bdfb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:20.201925 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239d4ee-98c7-4f64-bb0f-9d5df1bdfb7e None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:20.202202 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239d4ee-98c7-4f64-bb0f-9d5df1bdfb7e None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:20.202469 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239d4ee-98c7-4f64-bb0f-9d5df1bdfb7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:20.209687 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239d4ee-98c7-4f64-bb0f-9d5df1bdfb7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:20.211148 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239d4ee-98c7-4f64-bb0f-9d5df1bdfb7e None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:20.224681 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-2239d4ee-98c7-4f64-bb0f-9d5df1bdfb7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:44:20.225996 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 534/1063] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:44:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:20.231451 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239d4ee-98c7-4f64-bb0f-9d5df1bdfb7e None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:20.255707 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 530/1064] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 23:44:20.279317 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254a004-471e-4886-baee-6524aaf906ec None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:20.329990 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239d4ee-98c7-4f64-bb0f-9d5df1bdfb7e None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:20.364489 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853b058-1583-4942-ab0b-6d26d5b551dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:20.365151 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853b058-1583-4942-ab0b-6d26d5b551dc None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:20.365433 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853b058-1583-4942-ab0b-6d26d5b551dc None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:20.365860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853b058-1583-4942-ab0b-6d26d5b551dc None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:20.366493 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853b058-1583-4942-ab0b-6d26d5b551dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:20.366795 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853b058-1583-4942-ab0b-6d26d5b551dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:20.368232 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853b058-1583-4942-ab0b-6d26d5b551dc None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:20.374120 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254a004-471e-4886-baee-6524aaf906ec None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:20.380733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 535/1065] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:44:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:20.386390 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853b058-1583-4942-ab0b-6d26d5b551dc None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:20.408419 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be055f22-88b9-42e1-ad9b-9405763af90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:20.409650 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be055f22-88b9-42e1-ad9b-9405763af90b None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:20.410192 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be055f22-88b9-42e1-ad9b-9405763af90b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:20.410466 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be055f22-88b9-42e1-ad9b-9405763af90b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:20.421260 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be055f22-88b9-42e1-ad9b-9405763af90b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:44:20.428151 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-be055f22-88b9-42e1-ad9b-9405763af90b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:44:20.434030 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 531/1066] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:44:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:44:20.435377 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be055f22-88b9-42e1-ad9b-9405763af90b None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:20.487254 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853b058-1583-4942-ab0b-6d26d5b551dc None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:20.519992 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb396a8-40a5-494a-9cb7-b44f5aebf0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:20.520866 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb396a8-40a5-494a-9cb7-b44f5aebf0df None admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:20.521140 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb396a8-40a5-494a-9cb7-b44f5aebf0df None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:20.521402 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb396a8-40a5-494a-9cb7-b44f5aebf0df None admin] PATH_INFO: `/v3/projects/3563c87e56124c688a8029b4088cb198/users/a9519f49f897415a894c1121278dda9c/roles/b67d5ca11fd247f589cc04fcb8f4e072` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:20.523642 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb396a8-40a5-494a-9cb7-b44f5aebf0df None admin] RBAC: Authorizing `identity:create_grant(project_id=3563c87e56124c688a8029b4088cb198, user_id=a9519f49f897415a894c1121278dda9c, role_id=b67d5ca11fd247f589cc04fcb8f4e072)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:20.525063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb396a8-40a5-494a-9cb7-b44f5aebf0df None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:20.541667 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be055f22-88b9-42e1-ad9b-9405763af90b None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:20.574610 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1f12a-4bec-482b-ba65-b4ccc0aff08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:20.575696 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1f12a-4bec-482b-ba65-b4ccc0aff08b None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:20.576166 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1f12a-4bec-482b-ba65-b4ccc0aff08b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:20.576630 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1f12a-4bec-482b-ba65-b4ccc0aff08b None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:20.577952 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1f12a-4bec-482b-ba65-b4ccc0aff08b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:20.578448 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1f12a-4bec-482b-ba65-b4ccc0aff08b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:20.579875 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f1f12a-4bec-482b-ba65-b4ccc0aff08b None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:20.588063 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 532/1067] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:44:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:20.593646 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1f12a-4bec-482b-ba65-b4ccc0aff08b None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:20.615131 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 536/1068] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:44:20 2022] PUT /identity/v3/projects/3563c87e56124c688a8029b4088cb198/users/a9519f49f897415a894c1121278dda9c/roles/b67d5ca11fd247f589cc04fcb8f4e072 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 23:44:20.698491 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1f12a-4bec-482b-ba65-b4ccc0aff08b None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:20.735050 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40d4b8-26d5-4bdf-baba-ecd3dbd2c63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:20.735940 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40d4b8-26d5-4bdf-baba-ecd3dbd2c63c None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:20.736288 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40d4b8-26d5-4bdf-baba-ecd3dbd2c63c None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:20.736478 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c40d4b8-26d5-4bdf-baba-ecd3dbd2c63c None admin] PATH_INFO: `/v3/users/a006067fcb0647c8b26bb51ccb0d110b` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:20.752481 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40d4b8-26d5-4bdf-baba-ecd3dbd2c63c None admin] RBAC: Authorizing `identity:get_user(user_id=a006067fcb0647c8b26bb51ccb0d110b)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:20.755065 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c40d4b8-26d5-4bdf-baba-ecd3dbd2c63c None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:20.760866 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 533/1069] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:44:20 2022] GET /identity/v3/users/a006067fcb0647c8b26bb51ccb0d110b => generated 285 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:20.762227 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb396a8-40a5-494a-9cb7-b44f5aebf0df None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:20.868077 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb396a8-40a5-494a-9cb7-b44f5aebf0df None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:20.899999 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ff955-c197-4d4c-b3d1-a85d833b6cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:20.900636 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ff955-c197-4d4c-b3d1-a85d833b6cee None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:20.900913 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ff955-c197-4d4c-b3d1-a85d833b6cee None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:20.901181 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9ff955-c197-4d4c-b3d1-a85d833b6cee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:20.964811 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ff955-c197-4d4c-b3d1-a85d833b6cee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:20.966231 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9ff955-c197-4d4c-b3d1-a85d833b6cee None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:21.060130 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 537/1070] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:44:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 23:44:21.065700 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40d4b8-26d5-4bdf-baba-ecd3dbd2c63c None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:21.160774 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c40d4b8-26d5-4bdf-baba-ecd3dbd2c63c None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:21.192618 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b300c-3d32-4135-b996-3b948663f795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:21.193460 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b300c-3d32-4135-b996-3b948663f795 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:21.193733 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b300c-3d32-4135-b996-3b948663f795 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:21.193990 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b300c-3d32-4135-b996-3b948663f795 None admin] PATH_INFO: `/v3/projects/45924baadf0448eb938a6140c3544c86` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:21.195177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b300c-3d32-4135-b996-3b948663f795 None admin] RBAC: Authorizing `identity:get_project(project_id=45924baadf0448eb938a6140c3544c86)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:21.196594 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b300c-3d32-4135-b996-3b948663f795 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:21.198425 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 534/1071] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:44:21 2022] GET /identity/v3/projects/45924baadf0448eb938a6140c3544c86 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:21.204173 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ff955-c197-4d4c-b3d1-a85d833b6cee None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:21.296717 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9ff955-c197-4d4c-b3d1-a85d833b6cee None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:21.328968 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438435f1-4f93-4427-9b55-eee061a90359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:21.329612 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438435f1-4f93-4427-9b55-eee061a90359 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:21.329885 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438435f1-4f93-4427-9b55-eee061a90359 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:21.330152 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438435f1-4f93-4427-9b55-eee061a90359 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:21.330999 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438435f1-4f93-4427-9b55-eee061a90359 None admin] RBAC: Adding query filter params (role.id=c8affbefb4c5462a921650b24b13c80f, scope.project.id=45924baadf0448eb938a6140c3544c86, user.id=a006067fcb0647c8b26bb51ccb0d110b) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:21.331834 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438435f1-4f93-4427-9b55-eee061a90359 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:21.333291 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438435f1-4f93-4427-9b55-eee061a90359 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:21.338998 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 538/1072] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:44:21 2022] GET /identity/v3/role_assignments?user.id=a006067fcb0647c8b26bb51ccb0d110b&scope.project.id=45924baadf0448eb938a6140c3544c86&role.id=c8affbefb4c5462a921650b24b13c80f => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:21.900931 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c7651-01ba-4317-9bfd-7a3991095469 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:21.901456 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c7651-01ba-4317-9bfd-7a3991095469 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:21.901456 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c7651-01ba-4317-9bfd-7a3991095469 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:21.903309 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 535/1073] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:21.908327 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525645a-1027-4ef6-b435-2699d261c77b None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:21.908713 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525645a-1027-4ef6-b435-2699d261c77b None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:21.908870 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525645a-1027-4ef6-b435-2699d261c77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:21.926889 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-b525645a-1027-4ef6-b435-2699d261c77b None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:21.928076 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-b525645a-1027-4ef6-b435-2699d261c77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:21.990020 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 539/1074] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:22.011708 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c7651-01ba-4317-9bfd-7a3991095469 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:22.109135 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418c7651-01ba-4317-9bfd-7a3991095469 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:22.141560 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230d121-01cf-4856-ab1a-fbcff3c87c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:22.142200 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230d121-01cf-4856-ab1a-fbcff3c87c12 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:22.142474 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230d121-01cf-4856-ab1a-fbcff3c87c12 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:22.142741 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230d121-01cf-4856-ab1a-fbcff3c87c12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:22.206689 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230d121-01cf-4856-ab1a-fbcff3c87c12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:22.208195 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230d121-01cf-4856-ab1a-fbcff3c87c12 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:22.304855 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 536/1075] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:44:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 23:44:22.306121 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525645a-1027-4ef6-b435-2699d261c77b None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:22.399528 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525645a-1027-4ef6-b435-2699d261c77b None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:22.431863 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e2edb7-130a-4278-b0f2-d243f017b55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:22.432672 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2edb7-130a-4278-b0f2-d243f017b55f None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:22.432944 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2edb7-130a-4278-b0f2-d243f017b55f None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:22.433209 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e2edb7-130a-4278-b0f2-d243f017b55f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:22.445020 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2edb7-130a-4278-b0f2-d243f017b55f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:22.446474 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e2edb7-130a-4278-b0f2-d243f017b55f None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:22.464287 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-35e2edb7-130a-4278-b0f2-d243f017b55f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:44:22.465917 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 540/1076] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:22.472253 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230d121-01cf-4856-ab1a-fbcff3c87c12 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:22.567725 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230d121-01cf-4856-ab1a-fbcff3c87c12 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:22.601880 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f144d90b-3b10-4587-ab0f-0e67ffb4af98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:22.602532 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144d90b-3b10-4587-ab0f-0e67ffb4af98 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:22.602809 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144d90b-3b10-4587-ab0f-0e67ffb4af98 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:22.603096 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f144d90b-3b10-4587-ab0f-0e67ffb4af98 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:22.603809 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144d90b-3b10-4587-ab0f-0e67ffb4af98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:22.604105 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144d90b-3b10-4587-ab0f-0e67ffb4af98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:22.605456 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f144d90b-3b10-4587-ab0f-0e67ffb4af98 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:22.622865 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 537/1077] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:22.919386 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97364708-ddf1-43b3-a6dc-750d79f199e2 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:22.919915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97364708-ddf1-43b3-a6dc-750d79f199e2 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:22.919915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97364708-ddf1-43b3-a6dc-750d79f199e2 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:22.921847 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 541/1078] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:22.927423 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e85f2-2c54-4b1e-a1e8-050c495732b8 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:22.927866 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e85f2-2c54-4b1e-a1e8-050c495732b8 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:22.927959 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e85f2-2c54-4b1e-a1e8-050c495732b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:22.945069 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-b04e85f2-2c54-4b1e-a1e8-050c495732b8 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:22.946322 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-b04e85f2-2c54-4b1e-a1e8-050c495732b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:23.009409 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 538/1079] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 23:44:23.032678 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97364708-ddf1-43b3-a6dc-750d79f199e2 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:23.129988 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97364708-ddf1-43b3-a6dc-750d79f199e2 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:23.161606 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b29326-8d8b-4321-9461-54e004e34144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:23.162410 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b29326-8d8b-4321-9461-54e004e34144 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:23.162691 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b29326-8d8b-4321-9461-54e004e34144 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:23.163011 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b29326-8d8b-4321-9461-54e004e34144 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:23.172736 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b29326-8d8b-4321-9461-54e004e34144 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:44:23.180740 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-e7b29326-8d8b-4321-9461-54e004e34144 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Apr 11 23:44:23.182223 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 542/1080] 10.222.0.24 () {56 vars in 1120 bytes} [Mon Apr 11 23:44:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:23.187847 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e85f2-2c54-4b1e-a1e8-050c495732b8 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:23.293735 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04e85f2-2c54-4b1e-a1e8-050c495732b8 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:23.327171 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0bf1a-ca10-4a46-b52d-4ac6e050a3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:23.327827 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0bf1a-ca10-4a46-b52d-4ac6e050a3e2 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:23.328105 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0bf1a-ca10-4a46-b52d-4ac6e050a3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:23.328376 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb0bf1a-ca10-4a46-b52d-4ac6e050a3e2 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:23.329119 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0bf1a-ca10-4a46-b52d-4ac6e050a3e2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:23.329421 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0bf1a-ca10-4a46-b52d-4ac6e050a3e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:23.330805 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb0bf1a-ca10-4a46-b52d-4ac6e050a3e2 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:23.338417 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 539/1081] 10.222.0.24 () {56 vars in 1115 bytes} [Mon Apr 11 23:44:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:23.344207 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b29326-8d8b-4321-9461-54e004e34144 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:23.438400 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b29326-8d8b-4321-9461-54e004e34144 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:23.470023 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61471de2-5dbe-4bc8-8cb1-9f68277e44d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:23.470812 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61471de2-5dbe-4bc8-8cb1-9f68277e44d5 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:23.471124 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61471de2-5dbe-4bc8-8cb1-9f68277e44d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:23.471400 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61471de2-5dbe-4bc8-8cb1-9f68277e44d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:23.481973 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61471de2-5dbe-4bc8-8cb1-9f68277e44d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:23.483453 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61471de2-5dbe-4bc8-8cb1-9f68277e44d5 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:23.499893 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-61471de2-5dbe-4bc8-8cb1-9f68277e44d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:44:23.501204 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 543/1082] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:44:23.506703 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0bf1a-ca10-4a46-b52d-4ac6e050a3e2 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:23.599955 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d595bd-5849-4903-a401-b96efd260e67 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:23.600262 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d595bd-5849-4903-a401-b96efd260e67 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:23.600507 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb0bf1a-ca10-4a46-b52d-4ac6e050a3e2 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:23.600653 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d595bd-5849-4903-a401-b96efd260e67 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:23.602643 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 544/1083] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:44:23.607476 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd1333-dc6d-4c33-86ec-7d1fa146bcb1 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:23.607758 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd1333-dc6d-4c33-86ec-7d1fa146bcb1 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:23.608029 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd1333-dc6d-4c33-86ec-7d1fa146bcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:23.624196 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-8afd1333-dc6d-4c33-86ec-7d1fa146bcb1 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:23.625358 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-8afd1333-dc6d-4c33-86ec-7d1fa146bcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:23.632164 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd681fbe-9adb-47c3-a410-af9822310982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:23.632823 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd681fbe-9adb-47c3-a410-af9822310982 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:23.633099 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd681fbe-9adb-47c3-a410-af9822310982 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:23.633372 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd681fbe-9adb-47c3-a410-af9822310982 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:23.634092 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd681fbe-9adb-47c3-a410-af9822310982 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:23.634397 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd681fbe-9adb-47c3-a410-af9822310982 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:23.635782 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd681fbe-9adb-47c3-a410-af9822310982 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:23.647664 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 540/1084] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:23.653225 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd681fbe-9adb-47c3-a410-af9822310982 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:23.692121 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 545/1085] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 23:44:23.714786 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd1333-dc6d-4c33-86ec-7d1fa146bcb1 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:23.756445 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd681fbe-9adb-47c3-a410-af9822310982 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:23.796218 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da482344-fa8b-45b2-85ff-e5087f04cb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:23.797013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da482344-fa8b-45b2-85ff-e5087f04cb4a None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:23.797401 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da482344-fa8b-45b2-85ff-e5087f04cb4a None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:23.797675 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da482344-fa8b-45b2-85ff-e5087f04cb4a None admin] PATH_INFO: `/v3/users/nova` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:23.807006 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da482344-fa8b-45b2-85ff-e5087f04cb4a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:23.808066 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da482344-fa8b-45b2-85ff-e5087f04cb4a None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:23.810640 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd1333-dc6d-4c33-86ec-7d1fa146bcb1 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:23.833336 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-da482344-fa8b-45b2-85ff-e5087f04cb4a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Apr 11 23:44:23.834763 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 541/1086] 10.222.0.24 () {56 vars in 1093 bytes} [Mon Apr 11 23:44:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:44:23.841882 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da482344-fa8b-45b2-85ff-e5087f04cb4a None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:23.848347 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f3b72-a44b-4900-953a-ad59cfe35365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:23.849146 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f3b72-a44b-4900-953a-ad59cfe35365 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:23.849427 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f3b72-a44b-4900-953a-ad59cfe35365 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:23.849704 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906f3b72-a44b-4900-953a-ad59cfe35365 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:23.860460 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906f3b72-a44b-4900-953a-ad59cfe35365 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:44:23.867357 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-906f3b72-a44b-4900-953a-ad59cfe35365 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:44:23.868549 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 546/1087] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:44:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:44:23.874387 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f3b72-a44b-4900-953a-ad59cfe35365 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:23.947779 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da482344-fa8b-45b2-85ff-e5087f04cb4a None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:23.972825 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906f3b72-a44b-4900-953a-ad59cfe35365 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:23.982080 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e53e7c-bb6f-4219-b192-9c6fc9da4878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:23.982744 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e53e7c-bb6f-4219-b192-9c6fc9da4878 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:23.983053 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e53e7c-bb6f-4219-b192-9c6fc9da4878 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:23.983322 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e53e7c-bb6f-4219-b192-9c6fc9da4878 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:23.984155 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e53e7c-bb6f-4219-b192-9c6fc9da4878 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:23.984459 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e53e7c-bb6f-4219-b192-9c6fc9da4878 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:23.985908 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e53e7c-bb6f-4219-b192-9c6fc9da4878 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:24.002872 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 542/1088] 10.222.0.24 () {56 vars in 1133 bytes} [Mon Apr 11 23:44:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:24.008922 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e53e7c-bb6f-4219-b192-9c6fc9da4878 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:24.012864 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cde3b2-42ba-4673-90d7-ec25be12494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:24.013529 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cde3b2-42ba-4673-90d7-ec25be12494d None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:24.013807 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cde3b2-42ba-4673-90d7-ec25be12494d None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:24.014080 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cde3b2-42ba-4673-90d7-ec25be12494d None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:24.014822 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cde3b2-42ba-4673-90d7-ec25be12494d None admin] RBAC: Adding query filter params (name=admin) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:24.015153 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cde3b2-42ba-4673-90d7-ec25be12494d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:24.016510 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cde3b2-42ba-4673-90d7-ec25be12494d None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:24.026417 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 547/1089] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:44:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:24.032288 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cde3b2-42ba-4673-90d7-ec25be12494d None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:24.106207 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e53e7c-bb6f-4219-b192-9c6fc9da4878 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:24.132796 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cde3b2-42ba-4673-90d7-ec25be12494d None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:24.139009 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3deed5-4683-41de-b32b-1d76601950f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:24.139652 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3deed5-4683-41de-b32b-1d76601950f0 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:24.139935 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3deed5-4683-41de-b32b-1d76601950f0 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:24.140205 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3deed5-4683-41de-b32b-1d76601950f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:24.171474 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fa054-7612-4013-9fc1-ef4cd8a07e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:24.172338 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fa054-7612-4013-9fc1-ef4cd8a07e15 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:24.172614 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fa054-7612-4013-9fc1-ef4cd8a07e15 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:24.172879 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fa054-7612-4013-9fc1-ef4cd8a07e15 None admin] PATH_INFO: `/v3/users/a006067fcb0647c8b26bb51ccb0d110b` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:24.174078 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fa054-7612-4013-9fc1-ef4cd8a07e15 None admin] RBAC: Authorizing `identity:get_user(user_id=a006067fcb0647c8b26bb51ccb0d110b)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:24.176107 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fa054-7612-4013-9fc1-ef4cd8a07e15 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:24.178054 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 548/1090] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:44:24 2022] GET /identity/v3/users/a006067fcb0647c8b26bb51ccb0d110b => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:24.183871 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fa054-7612-4013-9fc1-ef4cd8a07e15 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:24.206137 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3deed5-4683-41de-b32b-1d76601950f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:24.207610 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3deed5-4683-41de-b32b-1d76601950f0 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:24.290192 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fa054-7612-4013-9fc1-ef4cd8a07e15 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:24.320015 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 543/1091] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:44:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 23:44:24.323316 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d183a0a-6eaf-45b2-9216-e4f162263fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:24.324240 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d183a0a-6eaf-45b2-9216-e4f162263fc1 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:24.324512 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d183a0a-6eaf-45b2-9216-e4f162263fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:24.324774 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d183a0a-6eaf-45b2-9216-e4f162263fc1 None admin] PATH_INFO: `/v3/projects/45924baadf0448eb938a6140c3544c86` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:24.326139 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d183a0a-6eaf-45b2-9216-e4f162263fc1 None admin] RBAC: Authorizing `identity:get_project(project_id=45924baadf0448eb938a6140c3544c86)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:24.326675 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3deed5-4683-41de-b32b-1d76601950f0 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:24.327657 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d183a0a-6eaf-45b2-9216-e4f162263fc1 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:24.329801 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 549/1092] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:44:24 2022] GET /identity/v3/projects/45924baadf0448eb938a6140c3544c86 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:24.335852 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d183a0a-6eaf-45b2-9216-e4f162263fc1 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:24.426230 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3deed5-4683-41de-b32b-1d76601950f0 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:24.431041 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d183a0a-6eaf-45b2-9216-e4f162263fc1 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:24.464032 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4e7e3-6db5-49f4-8237-5ce992bbb704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:24.465085 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4e7e3-6db5-49f4-8237-5ce992bbb704 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:24.465364 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4e7e3-6db5-49f4-8237-5ce992bbb704 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:24.465633 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4e7e3-6db5-49f4-8237-5ce992bbb704 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:24.466212 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed1cca-1ec8-4645-9ebe-3a5219cce503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:24.467122 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed1cca-1ec8-4645-9ebe-3a5219cce503 None admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:24.467405 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed1cca-1ec8-4645-9ebe-3a5219cce503 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:24.467673 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed1cca-1ec8-4645-9ebe-3a5219cce503 None admin] PATH_INFO: `/v3/projects/45924baadf0448eb938a6140c3544c86/users/a006067fcb0647c8b26bb51ccb0d110b/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:24.469644 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed1cca-1ec8-4645-9ebe-3a5219cce503 None admin] RBAC: Authorizing `identity:create_grant(project_id=45924baadf0448eb938a6140c3544c86, user_id=a006067fcb0647c8b26bb51ccb0d110b, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:24.473593 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed1cca-1ec8-4645-9ebe-3a5219cce503 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:24.478095 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4e7e3-6db5-49f4-8237-5ce992bbb704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:24.479585 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4e7e3-6db5-49f4-8237-5ce992bbb704 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:24.499744 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-79c4e7e3-6db5-49f4-8237-5ce992bbb704 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:44:24.500928 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 544/1093] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:44:24.506874 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4e7e3-6db5-49f4-8237-5ce992bbb704 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:24.567033 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 550/1094] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:44:24 2022] PUT /identity/v3/projects/45924baadf0448eb938a6140c3544c86/users/a006067fcb0647c8b26bb51ccb0d110b/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 23:44:24.604661 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4e7e3-6db5-49f4-8237-5ce992bbb704 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:24.639705 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5c994-48ec-428a-8923-2e5b2b4bf44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:24.640404 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5c994-48ec-428a-8923-2e5b2b4bf44f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:24.640681 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5c994-48ec-428a-8923-2e5b2b4bf44f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:24.640950 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c5c994-48ec-428a-8923-2e5b2b4bf44f None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:24.641676 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5c994-48ec-428a-8923-2e5b2b4bf44f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:24.641978 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5c994-48ec-428a-8923-2e5b2b4bf44f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:24.644105 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c5c994-48ec-428a-8923-2e5b2b4bf44f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:24.656051 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 545/1095] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:24.662553 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed1cca-1ec8-4645-9ebe-3a5219cce503 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:24.773302 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed1cca-1ec8-4645-9ebe-3a5219cce503 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:24.805343 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200062d-b688-44ed-8992-52c3fd3668e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:24.806126 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200062d-b688-44ed-8992-52c3fd3668e8 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:24.806405 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200062d-b688-44ed-8992-52c3fd3668e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:24.806677 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200062d-b688-44ed-8992-52c3fd3668e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:24.813132 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200062d-b688-44ed-8992-52c3fd3668e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:24.814544 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200062d-b688-44ed-8992-52c3fd3668e8 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:24.827730 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-5200062d-b688-44ed-8992-52c3fd3668e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:44:24.829843 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 551/1096] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:44:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:24.836216 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5c994-48ec-428a-8923-2e5b2b4bf44f None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:24.928658 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c5c994-48ec-428a-8923-2e5b2b4bf44f None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:24.960309 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8de71d-8ed3-4665-8bd2-38898b2196ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:24.960957 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8de71d-8ed3-4665-8bd2-38898b2196ce None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:24.961230 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8de71d-8ed3-4665-8bd2-38898b2196ce None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:24.961498 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8de71d-8ed3-4665-8bd2-38898b2196ce None admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:24.962269 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8de71d-8ed3-4665-8bd2-38898b2196ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:24.962567 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8de71d-8ed3-4665-8bd2-38898b2196ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:24.964034 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8de71d-8ed3-4665-8bd2-38898b2196ce None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:24.975614 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 546/1097] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:44:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:24.981516 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200062d-b688-44ed-8992-52c3fd3668e8 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:25.075143 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200062d-b688-44ed-8992-52c3fd3668e8 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:25.106063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e176b-2eb2-4574-9873-0d35d8f4fc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:25.106703 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e176b-2eb2-4574-9873-0d35d8f4fc64 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:25.107017 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e176b-2eb2-4574-9873-0d35d8f4fc64 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:25.107290 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e176b-2eb2-4574-9873-0d35d8f4fc64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:25.108111 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e176b-2eb2-4574-9873-0d35d8f4fc64 None admin] RBAC: Adding query filter params (role.id=b67d5ca11fd247f589cc04fcb8f4e072, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=a9519f49f897415a894c1121278dda9c) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:25.108417 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e176b-2eb2-4574-9873-0d35d8f4fc64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:25.109839 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e176b-2eb2-4574-9873-0d35d8f4fc64 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:25.115874 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 552/1098] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:44:24 2022] GET /identity/v3/role_assignments?user.id=a9519f49f897415a894c1121278dda9c&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=b67d5ca11fd247f589cc04fcb8f4e072 => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:26.817651 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728212e1-07ff-4909-af89-342e8c1b38ad None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:26.818175 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728212e1-07ff-4909-af89-342e8c1b38ad None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:26.818175 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728212e1-07ff-4909-af89-342e8c1b38ad None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:26.820054 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 547/1099] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:26.825047 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8ce13-385c-4c00-b3ac-be23aa545ec7 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:26.825473 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8ce13-385c-4c00-b3ac-be23aa545ec7 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:26.825599 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8ce13-385c-4c00-b3ac-be23aa545ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:26.842147 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-2bb8ce13-385c-4c00-b3ac-be23aa545ec7 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:26.843425 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-2bb8ce13-385c-4c00-b3ac-be23aa545ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:26.905820 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 553/1100] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:26.934501 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728212e1-07ff-4909-af89-342e8c1b38ad None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:27.028922 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728212e1-07ff-4909-af89-342e8c1b38ad None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:27.094102 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aff9ca-ab68-4a6b-9b85-bb0ba1ad94ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:27.094894 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aff9ca-ab68-4a6b-9b85-bb0ba1ad94ba None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:27.095176 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aff9ca-ab68-4a6b-9b85-bb0ba1ad94ba None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:27.095447 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aff9ca-ab68-4a6b-9b85-bb0ba1ad94ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:27.105461 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aff9ca-ab68-4a6b-9b85-bb0ba1ad94ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:44:27.112953 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-d6aff9ca-ab68-4a6b-9b85-bb0ba1ad94ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:44:27.114104 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 548/1101] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:44:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:27.120022 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8ce13-385c-4c00-b3ac-be23aa545ec7 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:27.209622 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8ce13-385c-4c00-b3ac-be23aa545ec7 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:27.242169 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2295dd6-3a2e-4d91-8a57-85acb911241e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:27.242826 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2295dd6-3a2e-4d91-8a57-85acb911241e None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:27.243128 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2295dd6-3a2e-4d91-8a57-85acb911241e None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:27.243395 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2295dd6-3a2e-4d91-8a57-85acb911241e None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:27.244128 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2295dd6-3a2e-4d91-8a57-85acb911241e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:27.244425 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2295dd6-3a2e-4d91-8a57-85acb911241e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:27.245768 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2295dd6-3a2e-4d91-8a57-85acb911241e None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:27.253582 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 554/1102] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:44:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:27.259319 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aff9ca-ab68-4a6b-9b85-bb0ba1ad94ba None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:27.353113 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aff9ca-ab68-4a6b-9b85-bb0ba1ad94ba None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:27.383786 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ea5bb-bd61-49cd-88e1-56923abb007d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:27.384623 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ea5bb-bd61-49cd-88e1-56923abb007d None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:27.384898 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ea5bb-bd61-49cd-88e1-56923abb007d None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:27.385169 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775ea5bb-bd61-49cd-88e1-56923abb007d None admin] PATH_INFO: `/v3/users/a006067fcb0647c8b26bb51ccb0d110b` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:27.386328 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ea5bb-bd61-49cd-88e1-56923abb007d None admin] RBAC: Authorizing `identity:get_user(user_id=a006067fcb0647c8b26bb51ccb0d110b)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:27.387776 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775ea5bb-bd61-49cd-88e1-56923abb007d None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:27.389355 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 549/1103] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:44:27 2022] GET /identity/v3/users/a006067fcb0647c8b26bb51ccb0d110b => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:27.395337 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2295dd6-3a2e-4d91-8a57-85acb911241e None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:27.486815 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2295dd6-3a2e-4d91-8a57-85acb911241e None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:27.517018 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d14e7-485a-48a4-bf6c-9ebcf227de41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:27.517640 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d14e7-485a-48a4-bf6c-9ebcf227de41 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:27.517915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d14e7-485a-48a4-bf6c-9ebcf227de41 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:27.518184 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d14e7-485a-48a4-bf6c-9ebcf227de41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:27.579348 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d14e7-485a-48a4-bf6c-9ebcf227de41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:27.580751 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d14e7-485a-48a4-bf6c-9ebcf227de41 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:27.671274 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 555/1104] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:44:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 23:44:27.676908 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ea5bb-bd61-49cd-88e1-56923abb007d None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:27.769707 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775ea5bb-bd61-49cd-88e1-56923abb007d None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:27.805067 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed602c00-f547-48fb-b1ea-f8e0d0f78d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:27.805919 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed602c00-f547-48fb-b1ea-f8e0d0f78d31 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:27.806196 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed602c00-f547-48fb-b1ea-f8e0d0f78d31 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:27.806468 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed602c00-f547-48fb-b1ea-f8e0d0f78d31 None admin] PATH_INFO: `/v3/projects/45924baadf0448eb938a6140c3544c86` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:27.807668 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed602c00-f547-48fb-b1ea-f8e0d0f78d31 None admin] RBAC: Authorizing `identity:get_project(project_id=45924baadf0448eb938a6140c3544c86)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:27.809078 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed602c00-f547-48fb-b1ea-f8e0d0f78d31 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:27.810755 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 550/1105] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:44:27 2022] GET /identity/v3/projects/45924baadf0448eb938a6140c3544c86 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:27.817232 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d14e7-485a-48a4-bf6c-9ebcf227de41 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:27.908567 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d14e7-485a-48a4-bf6c-9ebcf227de41 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:27.939639 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc164a-6aba-4a29-a9f1-b8d49670daa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:27.940212 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc164a-6aba-4a29-a9f1-b8d49670daa9 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:27.940976 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc164a-6aba-4a29-a9f1-b8d49670daa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:27.941241 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc164a-6aba-4a29-a9f1-b8d49670daa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:27.942050 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc164a-6aba-4a29-a9f1-b8d49670daa9 None admin] RBAC: Adding query filter params (role.id=c8affbefb4c5462a921650b24b13c80f, scope.project.id=45924baadf0448eb938a6140c3544c86, user.id=a006067fcb0647c8b26bb51ccb0d110b) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:27.942428 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc164a-6aba-4a29-a9f1-b8d49670daa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:27.944032 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc164a-6aba-4a29-a9f1-b8d49670daa9 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:27.950462 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 556/1106] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:44:27 2022] GET /identity/v3/role_assignments?user.id=a006067fcb0647c8b26bb51ccb0d110b&scope.project.id=45924baadf0448eb938a6140c3544c86&role.id=c8affbefb4c5462a921650b24b13c80f => generated 608 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:30.222987 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77ba8d-9833-4c05-8b83-5cacc938199d None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:30.223568 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77ba8d-9833-4c05-8b83-5cacc938199d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:30.223568 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77ba8d-9833-4c05-8b83-5cacc938199d None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:30.225315 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 551/1107] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:30.230575 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81decafe-64a7-4d0f-8e3c-c24c1b0c808b None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:30.231001 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81decafe-64a7-4d0f-8e3c-c24c1b0c808b None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:30.231143 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81decafe-64a7-4d0f-8e3c-c24c1b0c808b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:30.248499 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-81decafe-64a7-4d0f-8e3c-c24c1b0c808b None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:30.249882 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-81decafe-64a7-4d0f-8e3c-c24c1b0c808b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:30.313524 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 557/1108] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:30.338197 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77ba8d-9833-4c05-8b83-5cacc938199d None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:30.432599 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77ba8d-9833-4c05-8b83-5cacc938199d None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:30.463767 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb1a5ce-9774-4f64-a26c-93312710d990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:30.464525 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1a5ce-9774-4f64-a26c-93312710d990 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:30.465055 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1a5ce-9774-4f64-a26c-93312710d990 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:30.465324 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb1a5ce-9774-4f64-a26c-93312710d990 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:30.466475 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1a5ce-9774-4f64-a26c-93312710d990 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:30.467907 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb1a5ce-9774-4f64-a26c-93312710d990 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:30.469471 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 552/1109] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:44:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:30.475789 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81decafe-64a7-4d0f-8e3c-c24c1b0c808b None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:30.566414 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81decafe-64a7-4d0f-8e3c-c24c1b0c808b None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:30.598461 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45acb2c9-c014-4ea3-8198-f085de443140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:30.599125 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acb2c9-c014-4ea3-8198-f085de443140 None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:30.599401 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acb2c9-c014-4ea3-8198-f085de443140 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:30.599670 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45acb2c9-c014-4ea3-8198-f085de443140 None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:30.600368 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45acb2c9-c014-4ea3-8198-f085de443140 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:30.601778 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45acb2c9-c014-4ea3-8198-f085de443140 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:30.682001 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 558/1110] 10.222.0.24 () {60 vars in 1132 bytes} [Mon Apr 11 23:44:30 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:44:32.965686 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91824a8-4715-490c-a7d1-56c77aeef9b7 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:32.966218 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91824a8-4715-490c-a7d1-56c77aeef9b7 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:32.966218 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91824a8-4715-490c-a7d1-56c77aeef9b7 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:32.968061 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 553/1111] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:32.973635 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16284d69-2f4b-4b72-8b93-a4f6397b5665 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:32.974052 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16284d69-2f4b-4b72-8b93-a4f6397b5665 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:32.974175 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16284d69-2f4b-4b72-8b93-a4f6397b5665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:32.990969 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-16284d69-2f4b-4b72-8b93-a4f6397b5665 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:32.992135 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-16284d69-2f4b-4b72-8b93-a4f6397b5665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:33.053347 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 559/1112] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:33.076190 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91824a8-4715-490c-a7d1-56c77aeef9b7 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:33.192821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91824a8-4715-490c-a7d1-56c77aeef9b7 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:33.224065 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6245026-0a4a-48b7-8263-a76981936bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:33.224888 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6245026-0a4a-48b7-8263-a76981936bf0 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:33.225165 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6245026-0a4a-48b7-8263-a76981936bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:33.225435 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6245026-0a4a-48b7-8263-a76981936bf0 None admin] PATH_INFO: `/v3/roles/f7b5f822a48e4e269ab53ce00a04194e` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:33.226908 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6245026-0a4a-48b7-8263-a76981936bf0 None admin] RBAC: Authorizing `identity:get_role(role_id=f7b5f822a48e4e269ab53ce00a04194e)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:33.228291 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6245026-0a4a-48b7-8263-a76981936bf0 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:33.229632 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 554/1113] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:44:33 2022] GET /identity/v3/roles/f7b5f822a48e4e269ab53ce00a04194e => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:33.235253 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16284d69-2f4b-4b72-8b93-a4f6397b5665 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:33.327986 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16284d69-2f4b-4b72-8b93-a4f6397b5665 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:33.360537 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585f20c-329a-4f50-bb33-20a98bc91a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:33.361392 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585f20c-329a-4f50-bb33-20a98bc91a77 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:33.361663 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585f20c-329a-4f50-bb33-20a98bc91a77 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:33.361930 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c585f20c-329a-4f50-bb33-20a98bc91a77 None admin] PATH_INFO: `/v3/users/0551428b53b6448e99d0186b7c888045` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:33.374149 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585f20c-329a-4f50-bb33-20a98bc91a77 None admin] RBAC: Authorizing `identity:get_user(user_id=0551428b53b6448e99d0186b7c888045)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:33.375581 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c585f20c-329a-4f50-bb33-20a98bc91a77 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:33.377187 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 560/1114] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:44:33 2022] GET /identity/v3/users/0551428b53b6448e99d0186b7c888045 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:33.382974 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6245026-0a4a-48b7-8263-a76981936bf0 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:33.476540 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6245026-0a4a-48b7-8263-a76981936bf0 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:33.506928 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77990389-0a63-4b57-8a43-48b6a7a968a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:33.507555 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77990389-0a63-4b57-8a43-48b6a7a968a4 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:33.507834 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77990389-0a63-4b57-8a43-48b6a7a968a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:33.508107 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77990389-0a63-4b57-8a43-48b6a7a968a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:33.569780 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77990389-0a63-4b57-8a43-48b6a7a968a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:33.571236 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77990389-0a63-4b57-8a43-48b6a7a968a4 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:33.678846 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 555/1115] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:44:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 23:44:33.684797 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585f20c-329a-4f50-bb33-20a98bc91a77 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:33.777838 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c585f20c-329a-4f50-bb33-20a98bc91a77 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:33.811382 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb0c75-09c5-4674-b556-497eb6f4cf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:33.812222 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb0c75-09c5-4674-b556-497eb6f4cf36 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:33.812496 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb0c75-09c5-4674-b556-497eb6f4cf36 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:33.812761 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb0c75-09c5-4674-b556-497eb6f4cf36 None admin] PATH_INFO: `/v3/projects/45924baadf0448eb938a6140c3544c86` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:33.813934 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb0c75-09c5-4674-b556-497eb6f4cf36 None admin] RBAC: Authorizing `identity:get_project(project_id=45924baadf0448eb938a6140c3544c86)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:33.815946 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb0c75-09c5-4674-b556-497eb6f4cf36 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:33.817680 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 561/1116] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:44:33 2022] GET /identity/v3/projects/45924baadf0448eb938a6140c3544c86 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:33.823746 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77990389-0a63-4b57-8a43-48b6a7a968a4 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:33.916458 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77990389-0a63-4b57-8a43-48b6a7a968a4 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:33.951328 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62aa1b0-a0bb-4ce5-8078-25a4c19b3dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:33.951902 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aa1b0-a0bb-4ce5-8078-25a4c19b3dc8 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:33.952179 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aa1b0-a0bb-4ce5-8078-25a4c19b3dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:33.952450 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aa1b0-a0bb-4ce5-8078-25a4c19b3dc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:33.953276 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62aa1b0-a0bb-4ce5-8078-25a4c19b3dc8 None admin] RBAC: Adding query filter params (role.id=f7b5f822a48e4e269ab53ce00a04194e, scope.project.id=45924baadf0448eb938a6140c3544c86, user.id=0551428b53b6448e99d0186b7c888045) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:33.953580 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62aa1b0-a0bb-4ce5-8078-25a4c19b3dc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:33.955031 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62aa1b0-a0bb-4ce5-8078-25a4c19b3dc8 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:33.960843 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 556/1117] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:44:33 2022] GET /identity/v3/role_assignments?user.id=0551428b53b6448e99d0186b7c888045&scope.project.id=45924baadf0448eb938a6140c3544c86&role.id=f7b5f822a48e4e269ab53ce00a04194e => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:36.187669 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bc54f-01ab-4883-9871-b5249c13df08 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:36.188182 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bc54f-01ab-4883-9871-b5249c13df08 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:36.188272 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bc54f-01ab-4883-9871-b5249c13df08 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:36.190007 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 562/1118] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:36.195972 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbad1d8-6051-44b4-9edd-23398b700714 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:36.196388 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbad1d8-6051-44b4-9edd-23398b700714 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:36.196526 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbad1d8-6051-44b4-9edd-23398b700714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:36.213787 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-afbad1d8-6051-44b4-9edd-23398b700714 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:36.215257 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-afbad1d8-6051-44b4-9edd-23398b700714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:36.277270 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 557/1119] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:36.300223 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bc54f-01ab-4883-9871-b5249c13df08 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:36.394379 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bc54f-01ab-4883-9871-b5249c13df08 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:36.425940 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9798bd1-069a-42a0-86ff-d43636493780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:36.426773 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9798bd1-069a-42a0-86ff-d43636493780 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:36.427077 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9798bd1-069a-42a0-86ff-d43636493780 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:36.427348 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9798bd1-069a-42a0-86ff-d43636493780 None admin] PATH_INFO: `/v3/roles/f7b5f822a48e4e269ab53ce00a04194e` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:36.428804 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9798bd1-069a-42a0-86ff-d43636493780 None admin] RBAC: Authorizing `identity:get_role(role_id=f7b5f822a48e4e269ab53ce00a04194e)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:36.430149 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9798bd1-069a-42a0-86ff-d43636493780 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:36.431519 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 563/1120] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:44:36 2022] GET /identity/v3/roles/f7b5f822a48e4e269ab53ce00a04194e => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:36.437256 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbad1d8-6051-44b4-9edd-23398b700714 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:36.529187 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbad1d8-6051-44b4-9edd-23398b700714 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:36.560108 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261766a-56ef-477e-94e5-daf7545d07a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:36.561034 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261766a-56ef-477e-94e5-daf7545d07a7 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:36.561314 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261766a-56ef-477e-94e5-daf7545d07a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:36.561582 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261766a-56ef-477e-94e5-daf7545d07a7 None admin] PATH_INFO: `/v3/users/0551428b53b6448e99d0186b7c888045` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:36.562737 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261766a-56ef-477e-94e5-daf7545d07a7 None admin] RBAC: Authorizing `identity:get_user(user_id=0551428b53b6448e99d0186b7c888045)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:36.564172 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261766a-56ef-477e-94e5-daf7545d07a7 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:36.566323 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 558/1121] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:44:36 2022] GET /identity/v3/users/0551428b53b6448e99d0186b7c888045 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:36.571823 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9798bd1-069a-42a0-86ff-d43636493780 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:36.664100 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9798bd1-069a-42a0-86ff-d43636493780 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:36.696965 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa570b9d-27d7-4b1d-8b5f-cf0e182e848b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:36.697782 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa570b9d-27d7-4b1d-8b5f-cf0e182e848b None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:36.698063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa570b9d-27d7-4b1d-8b5f-cf0e182e848b None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:36.698328 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa570b9d-27d7-4b1d-8b5f-cf0e182e848b None admin] PATH_INFO: `/v3/projects/45924baadf0448eb938a6140c3544c86` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:36.699492 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa570b9d-27d7-4b1d-8b5f-cf0e182e848b None admin] RBAC: Authorizing `identity:get_project(project_id=45924baadf0448eb938a6140c3544c86)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:36.700906 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa570b9d-27d7-4b1d-8b5f-cf0e182e848b None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:36.702535 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 564/1122] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:44:36 2022] GET /identity/v3/projects/45924baadf0448eb938a6140c3544c86 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:36.708305 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261766a-56ef-477e-94e5-daf7545d07a7 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:36.801026 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261766a-56ef-477e-94e5-daf7545d07a7 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:36.831786 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5428d4b5-6409-4bdc-bc54-e80ddcfd1d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:36.832648 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428d4b5-6409-4bdc-bc54-e80ddcfd1d22 None admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:36.832924 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428d4b5-6409-4bdc-bc54-e80ddcfd1d22 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:36.833192 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5428d4b5-6409-4bdc-bc54-e80ddcfd1d22 None admin] PATH_INFO: `/v3/projects/45924baadf0448eb938a6140c3544c86/users/0551428b53b6448e99d0186b7c888045/roles/f7b5f822a48e4e269ab53ce00a04194e` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:36.835364 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428d4b5-6409-4bdc-bc54-e80ddcfd1d22 None admin] RBAC: Authorizing `identity:create_grant(project_id=45924baadf0448eb938a6140c3544c86, user_id=0551428b53b6448e99d0186b7c888045, role_id=f7b5f822a48e4e269ab53ce00a04194e)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:36.836768 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5428d4b5-6409-4bdc-bc54-e80ddcfd1d22 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:36.914840 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 559/1123] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:44:36 2022] PUT /identity/v3/projects/45924baadf0448eb938a6140c3544c86/users/0551428b53b6448e99d0186b7c888045/roles/f7b5f822a48e4e269ab53ce00a04194e => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:44:39.135679 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c66131-36ef-45be-b81d-eae5d0990236 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:39.136203 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c66131-36ef-45be-b81d-eae5d0990236 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:39.136203 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c66131-36ef-45be-b81d-eae5d0990236 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:39.137979 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 565/1124] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:39.143007 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bff96b-ffa9-43ff-b8be-c5457bef14da None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:39.143394 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bff96b-ffa9-43ff-b8be-c5457bef14da None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:39.143554 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bff96b-ffa9-43ff-b8be-c5457bef14da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:39.160157 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-22bff96b-ffa9-43ff-b8be-c5457bef14da None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:39.161308 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-22bff96b-ffa9-43ff-b8be-c5457bef14da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:39.222887 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 560/1125] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:39.245670 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c66131-36ef-45be-b81d-eae5d0990236 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:39.461206 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c66131-36ef-45be-b81d-eae5d0990236 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:39.492165 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc2e5b-bdc4-4c8c-a260-b1d2a67a766b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:39.492988 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc2e5b-bdc4-4c8c-a260-b1d2a67a766b None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:39.493261 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc2e5b-bdc4-4c8c-a260-b1d2a67a766b None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:39.493527 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc2e5b-bdc4-4c8c-a260-b1d2a67a766b None admin] PATH_INFO: `/v3/roles/f7b5f822a48e4e269ab53ce00a04194e` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:39.494991 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc2e5b-bdc4-4c8c-a260-b1d2a67a766b None admin] RBAC: Authorizing `identity:get_role(role_id=f7b5f822a48e4e269ab53ce00a04194e)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:39.496310 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc2e5b-bdc4-4c8c-a260-b1d2a67a766b None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:39.497635 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 566/1126] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:44:39 2022] GET /identity/v3/roles/f7b5f822a48e4e269ab53ce00a04194e => generated 223 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:39.503486 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bff96b-ffa9-43ff-b8be-c5457bef14da None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:39.594387 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bff96b-ffa9-43ff-b8be-c5457bef14da None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:39.625906 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eca58b-ed9c-4d81-983c-6e4ea063f5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:39.626744 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eca58b-ed9c-4d81-983c-6e4ea063f5ea None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:39.627081 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eca58b-ed9c-4d81-983c-6e4ea063f5ea None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:39.627353 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eca58b-ed9c-4d81-983c-6e4ea063f5ea None admin] PATH_INFO: `/v3/users/0551428b53b6448e99d0186b7c888045` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:39.629124 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eca58b-ed9c-4d81-983c-6e4ea063f5ea None admin] RBAC: Authorizing `identity:get_user(user_id=0551428b53b6448e99d0186b7c888045)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:39.630552 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eca58b-ed9c-4d81-983c-6e4ea063f5ea None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:39.632159 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 561/1127] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:44:39 2022] GET /identity/v3/users/0551428b53b6448e99d0186b7c888045 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:39.637618 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc2e5b-bdc4-4c8c-a260-b1d2a67a766b None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:39.729453 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc2e5b-bdc4-4c8c-a260-b1d2a67a766b None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:39.760285 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a052c-fe51-41d9-9c9e-288de9ec49d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:39.760907 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a052c-fe51-41d9-9c9e-288de9ec49d3 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:39.761179 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a052c-fe51-41d9-9c9e-288de9ec49d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:39.761442 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6a052c-fe51-41d9-9c9e-288de9ec49d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:39.824141 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a052c-fe51-41d9-9c9e-288de9ec49d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:39.825547 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6a052c-fe51-41d9-9c9e-288de9ec49d3 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:39.921095 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 567/1128] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:44:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 23:44:39.926966 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eca58b-ed9c-4d81-983c-6e4ea063f5ea None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:40.025095 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eca58b-ed9c-4d81-983c-6e4ea063f5ea None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:40.056293 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d5243-9e94-4fc0-abe7-b2ea86e0efa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:40.057126 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d5243-9e94-4fc0-abe7-b2ea86e0efa4 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:40.057402 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d5243-9e94-4fc0-abe7-b2ea86e0efa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:40.057670 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d5243-9e94-4fc0-abe7-b2ea86e0efa4 None admin] PATH_INFO: `/v3/projects/45924baadf0448eb938a6140c3544c86` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:40.058815 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d5243-9e94-4fc0-abe7-b2ea86e0efa4 None admin] RBAC: Authorizing `identity:get_project(project_id=45924baadf0448eb938a6140c3544c86)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:40.060253 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d5243-9e94-4fc0-abe7-b2ea86e0efa4 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:40.061910 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 562/1129] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:44:39 2022] GET /identity/v3/projects/45924baadf0448eb938a6140c3544c86 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:40.068533 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a052c-fe51-41d9-9c9e-288de9ec49d3 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:40.158982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6a052c-fe51-41d9-9c9e-288de9ec49d3 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:40.190722 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac17d9-166f-47c6-b09b-59acfd28a88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:40.191375 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac17d9-166f-47c6-b09b-59acfd28a88f None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:40.191650 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac17d9-166f-47c6-b09b-59acfd28a88f None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:40.191916 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac17d9-166f-47c6-b09b-59acfd28a88f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:40.192724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac17d9-166f-47c6-b09b-59acfd28a88f None admin] RBAC: Adding query filter params (role.id=f7b5f822a48e4e269ab53ce00a04194e, scope.project.id=45924baadf0448eb938a6140c3544c86, user.id=0551428b53b6448e99d0186b7c888045) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:40.193022 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac17d9-166f-47c6-b09b-59acfd28a88f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:40.194415 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac17d9-166f-47c6-b09b-59acfd28a88f None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:40.199909 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 568/1130] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:44:40 2022] GET /identity/v3/role_assignments?user.id=0551428b53b6448e99d0186b7c888045&scope.project.id=45924baadf0448eb938a6140c3544c86&role.id=f7b5f822a48e4e269ab53ce00a04194e => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:42.454816 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a45892-7e56-4efa-b125-5e3ddc842b52 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:42.455391 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a45892-7e56-4efa-b125-5e3ddc842b52 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:42.455391 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a45892-7e56-4efa-b125-5e3ddc842b52 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:42.457712 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 563/1131] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:42.462920 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11f820-ed00-43f1-a9a3-80efa78d6917 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:42.463333 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11f820-ed00-43f1-a9a3-80efa78d6917 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:42.463464 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11f820-ed00-43f1-a9a3-80efa78d6917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:42.480764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-df11f820-ed00-43f1-a9a3-80efa78d6917 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:42.481927 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-df11f820-ed00-43f1-a9a3-80efa78d6917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:42.542923 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 569/1132] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:42.565970 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a45892-7e56-4efa-b125-5e3ddc842b52 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:42.660627 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a45892-7e56-4efa-b125-5e3ddc842b52 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:42.691611 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f108640-f195-428c-b456-48029bd5b3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:42.692377 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f108640-f195-428c-b456-48029bd5b3d8 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:42.692653 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f108640-f195-428c-b456-48029bd5b3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:42.692920 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f108640-f195-428c-b456-48029bd5b3d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:42.694066 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f108640-f195-428c-b456-48029bd5b3d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:42.695499 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f108640-f195-428c-b456-48029bd5b3d8 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:42.697065 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 564/1133] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:44:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:42.702783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11f820-ed00-43f1-a9a3-80efa78d6917 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:42.794999 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11f820-ed00-43f1-a9a3-80efa78d6917 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:42.826154 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc08e4a-33eb-4334-8dc9-f7f17c1ada08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:42.826790 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc08e4a-33eb-4334-8dc9-f7f17c1ada08 None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:42.827095 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc08e4a-33eb-4334-8dc9-f7f17c1ada08 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:42.827365 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc08e4a-33eb-4334-8dc9-f7f17c1ada08 None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:42.828064 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc08e4a-33eb-4334-8dc9-f7f17c1ada08 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:42.829459 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc08e4a-33eb-4334-8dc9-f7f17c1ada08 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:42.915938 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 570/1134] 10.222.0.24 () {60 vars in 1141 bytes} [Mon Apr 11 23:44:42 2022] POST /identity/v3/projects => generated 311 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:44:45.205375 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45370aa0-f4e9-4e74-adeb-43e5d32c8307 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:45.205929 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45370aa0-f4e9-4e74-adeb-43e5d32c8307 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:45.205929 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45370aa0-f4e9-4e74-adeb-43e5d32c8307 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:45.208326 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 565/1135] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:45.213376 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97800f6-1942-4a50-8fe4-6dd0fc5be6bc None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:45.213811 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97800f6-1942-4a50-8fe4-6dd0fc5be6bc None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:45.213903 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97800f6-1942-4a50-8fe4-6dd0fc5be6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:45.230826 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-c97800f6-1942-4a50-8fe4-6dd0fc5be6bc None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:45.231998 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-c97800f6-1942-4a50-8fe4-6dd0fc5be6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:45.294110 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 571/1136] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:45.321981 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45370aa0-f4e9-4e74-adeb-43e5d32c8307 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:45.417632 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45370aa0-f4e9-4e74-adeb-43e5d32c8307 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:45.448436 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3d5f9-01d8-452f-9aac-9c961cee4dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:45.449214 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3d5f9-01d8-452f-9aac-9c961cee4dcf None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:45.449494 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3d5f9-01d8-452f-9aac-9c961cee4dcf None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:45.449766 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3d5f9-01d8-452f-9aac-9c961cee4dcf None admin] PATH_INFO: `/v3/domains/default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:45.450958 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3d5f9-01d8-452f-9aac-9c961cee4dcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:45.452376 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3d5f9-01d8-452f-9aac-9c961cee4dcf None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:45.453959 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 566/1137] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:44:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:45.460165 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97800f6-1942-4a50-8fe4-6dd0fc5be6bc None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:45.556036 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97800f6-1942-4a50-8fe4-6dd0fc5be6bc None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:45.587178 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d3649-ce43-409c-b99e-aa6fe6d56e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:45.587828 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d3649-ce43-409c-b99e-aa6fe6d56e22 None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:45.588100 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d3649-ce43-409c-b99e-aa6fe6d56e22 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:45.588369 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d3649-ce43-409c-b99e-aa6fe6d56e22 None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:45.589060 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d3649-ce43-409c-b99e-aa6fe6d56e22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:45.590715 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d3649-ce43-409c-b99e-aa6fe6d56e22 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:45.698241 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 572/1138] 10.222.0.24 () {60 vars in 1132 bytes} [Mon Apr 11 23:44:45 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:44:48.013968 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ce616-71d5-4777-85ef-30938c493dd9 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:48.014488 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ce616-71d5-4777-85ef-30938c493dd9 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:48.014488 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ce616-71d5-4777-85ef-30938c493dd9 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:48.016312 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 567/1139] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:48.022163 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda452dc-482c-49f1-9c46-7a91f914cb8b None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:48.022559 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda452dc-482c-49f1-9c46-7a91f914cb8b None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:48.022648 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda452dc-482c-49f1-9c46-7a91f914cb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:48.038871 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-dda452dc-482c-49f1-9c46-7a91f914cb8b None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:48.040045 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-dda452dc-482c-49f1-9c46-7a91f914cb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:48.106073 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 573/1140] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 23:44:48.129832 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ce616-71d5-4777-85ef-30938c493dd9 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:48.223452 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ce616-71d5-4777-85ef-30938c493dd9 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:48.254438 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55061f3-881f-4e3c-aaaa-c1f04d6c9f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:48.255219 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55061f3-881f-4e3c-aaaa-c1f04d6c9f2d None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:48.255495 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55061f3-881f-4e3c-aaaa-c1f04d6c9f2d None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:48.255761 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55061f3-881f-4e3c-aaaa-c1f04d6c9f2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:48.265260 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55061f3-881f-4e3c-aaaa-c1f04d6c9f2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:44:48.272679 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-e55061f3-881f-4e3c-aaaa-c1f04d6c9f2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:44:48.273751 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 568/1141] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:44:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:48.279427 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda452dc-482c-49f1-9c46-7a91f914cb8b None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:48.369898 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda452dc-482c-49f1-9c46-7a91f914cb8b None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:48.401033 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c6b48-7e70-4565-91e8-efb600294f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:48.401672 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c6b48-7e70-4565-91e8-efb600294f5a None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:48.401949 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c6b48-7e70-4565-91e8-efb600294f5a None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:48.402218 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c6b48-7e70-4565-91e8-efb600294f5a None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:48.402985 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c6b48-7e70-4565-91e8-efb600294f5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:48.403287 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c6b48-7e70-4565-91e8-efb600294f5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:48.404624 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c6b48-7e70-4565-91e8-efb600294f5a None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:48.412149 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 574/1142] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:44:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:48.417733 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55061f3-881f-4e3c-aaaa-c1f04d6c9f2d None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:48.509780 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55061f3-881f-4e3c-aaaa-c1f04d6c9f2d None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:48.540012 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfc9d0-eab4-41fa-90ca-618c353f275a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:48.540792 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfc9d0-eab4-41fa-90ca-618c353f275a None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:48.541066 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfc9d0-eab4-41fa-90ca-618c353f275a None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:48.541334 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfc9d0-eab4-41fa-90ca-618c353f275a None admin] PATH_INFO: `/v3/users/6ef768e787094d1eb0fa082371707d92` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:48.554600 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfc9d0-eab4-41fa-90ca-618c353f275a None admin] RBAC: Authorizing `identity:get_user(user_id=6ef768e787094d1eb0fa082371707d92)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:48.556070 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfc9d0-eab4-41fa-90ca-618c353f275a None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:48.557640 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 569/1143] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:44:48 2022] GET /identity/v3/users/6ef768e787094d1eb0fa082371707d92 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:48.563045 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c6b48-7e70-4565-91e8-efb600294f5a None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:48.656359 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c6b48-7e70-4565-91e8-efb600294f5a None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:48.689927 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cf065-0c79-460e-b50e-dbd27f018bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:48.691120 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cf065-0c79-460e-b50e-dbd27f018bf1 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:48.691399 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cf065-0c79-460e-b50e-dbd27f018bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:48.691672 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8cf065-0c79-460e-b50e-dbd27f018bf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:48.754426 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8cf065-0c79-460e-b50e-dbd27f018bf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:48.755890 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8cf065-0c79-460e-b50e-dbd27f018bf1 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:48.846362 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 575/1144] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:44:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 23:44:48.852077 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfc9d0-eab4-41fa-90ca-618c353f275a None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:48.944016 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfc9d0-eab4-41fa-90ca-618c353f275a None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:48.975652 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801339f8-5e19-4756-98cc-3eeb2de1de8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:48.976481 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801339f8-5e19-4756-98cc-3eeb2de1de8b None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:48.976765 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801339f8-5e19-4756-98cc-3eeb2de1de8b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:48.977031 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801339f8-5e19-4756-98cc-3eeb2de1de8b None admin] PATH_INFO: `/v3/projects/a6da77bad07843f5b55ff834b1d5781d` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:48.978188 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801339f8-5e19-4756-98cc-3eeb2de1de8b None admin] RBAC: Authorizing `identity:get_project(project_id=a6da77bad07843f5b55ff834b1d5781d)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:48.979622 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801339f8-5e19-4756-98cc-3eeb2de1de8b None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:48.981313 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 570/1145] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:44:48 2022] GET /identity/v3/projects/a6da77bad07843f5b55ff834b1d5781d => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:48.987752 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cf065-0c79-460e-b50e-dbd27f018bf1 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:49.085237 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8cf065-0c79-460e-b50e-dbd27f018bf1 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:49.116542 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c732e9-be9b-4899-82a2-9a8e4f6b68ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:49.117173 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c732e9-be9b-4899-82a2-9a8e4f6b68ab None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:49.117445 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c732e9-be9b-4899-82a2-9a8e4f6b68ab None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:49.117709 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c732e9-be9b-4899-82a2-9a8e4f6b68ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:49.118515 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c732e9-be9b-4899-82a2-9a8e4f6b68ab None admin] RBAC: Adding query filter params (role.id=c8affbefb4c5462a921650b24b13c80f, scope.project.id=a6da77bad07843f5b55ff834b1d5781d, user.id=6ef768e787094d1eb0fa082371707d92) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:49.118815 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c732e9-be9b-4899-82a2-9a8e4f6b68ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:49.120226 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c732e9-be9b-4899-82a2-9a8e4f6b68ab None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:49.125256 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 576/1146] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:44:48 2022] GET /identity/v3/role_assignments?user.id=6ef768e787094d1eb0fa082371707d92&scope.project.id=a6da77bad07843f5b55ff834b1d5781d&role.id=c8affbefb4c5462a921650b24b13c80f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:51.339966 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4262f-5095-41da-88e4-6ecba8ac3aa4 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:51.340749 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4262f-5095-41da-88e4-6ecba8ac3aa4 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:51.340749 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e4262f-5095-41da-88e4-6ecba8ac3aa4 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:51.342540 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 571/1147] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:51.347887 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a118ec-1111-424b-9363-1aa04255b9fc None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:51.348325 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a118ec-1111-424b-9363-1aa04255b9fc None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:51.348418 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a118ec-1111-424b-9363-1aa04255b9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:51.365089 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-53a118ec-1111-424b-9363-1aa04255b9fc None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:51.366238 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-53a118ec-1111-424b-9363-1aa04255b9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:51.426897 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 577/1148] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:51.449125 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4262f-5095-41da-88e4-6ecba8ac3aa4 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:51.541539 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e4262f-5095-41da-88e4-6ecba8ac3aa4 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:51.573006 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876f87c-9185-4f1e-9c29-f106a50dc224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:51.573767 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876f87c-9185-4f1e-9c29-f106a50dc224 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:51.574040 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876f87c-9185-4f1e-9c29-f106a50dc224 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:51.574304 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876f87c-9185-4f1e-9c29-f106a50dc224 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:51.583717 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876f87c-9185-4f1e-9c29-f106a50dc224 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:44:51.590799 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-d876f87c-9185-4f1e-9c29-f106a50dc224 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:44:51.591893 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 572/1149] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:44:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:51.597615 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a118ec-1111-424b-9363-1aa04255b9fc None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:51.689313 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a118ec-1111-424b-9363-1aa04255b9fc None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:51.721091 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60bc9a-b75c-47f7-bcb2-c3532aa02382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:51.722266 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60bc9a-b75c-47f7-bcb2-c3532aa02382 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:51.722545 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60bc9a-b75c-47f7-bcb2-c3532aa02382 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:51.722816 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc60bc9a-b75c-47f7-bcb2-c3532aa02382 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:51.723580 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc60bc9a-b75c-47f7-bcb2-c3532aa02382 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:51.723881 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc60bc9a-b75c-47f7-bcb2-c3532aa02382 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:51.725220 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc60bc9a-b75c-47f7-bcb2-c3532aa02382 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:51.733059 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 578/1150] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:44:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:51.739367 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876f87c-9185-4f1e-9c29-f106a50dc224 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:51.832066 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876f87c-9185-4f1e-9c29-f106a50dc224 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:51.863716 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25de468-7e22-4349-9016-a33ebf7fd05c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:51.864558 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25de468-7e22-4349-9016-a33ebf7fd05c None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:51.864834 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25de468-7e22-4349-9016-a33ebf7fd05c None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:51.865104 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25de468-7e22-4349-9016-a33ebf7fd05c None admin] PATH_INFO: `/v3/users/6ef768e787094d1eb0fa082371707d92` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:51.866256 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25de468-7e22-4349-9016-a33ebf7fd05c None admin] RBAC: Authorizing `identity:get_user(user_id=6ef768e787094d1eb0fa082371707d92)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:51.867682 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25de468-7e22-4349-9016-a33ebf7fd05c None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:51.869267 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 573/1151] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:44:51 2022] GET /identity/v3/users/6ef768e787094d1eb0fa082371707d92 => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:51.875179 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60bc9a-b75c-47f7-bcb2-c3532aa02382 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:51.974681 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc60bc9a-b75c-47f7-bcb2-c3532aa02382 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:52.005425 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe0398-ec3e-409e-8ff3-5cf8483fef70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:52.006266 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe0398-ec3e-409e-8ff3-5cf8483fef70 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:52.006542 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe0398-ec3e-409e-8ff3-5cf8483fef70 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:52.006811 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe0398-ec3e-409e-8ff3-5cf8483fef70 None admin] PATH_INFO: `/v3/projects/a6da77bad07843f5b55ff834b1d5781d` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:52.007989 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe0398-ec3e-409e-8ff3-5cf8483fef70 None admin] RBAC: Authorizing `identity:get_project(project_id=a6da77bad07843f5b55ff834b1d5781d)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:52.009391 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abe0398-ec3e-409e-8ff3-5cf8483fef70 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:52.011080 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 579/1152] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:44:51 2022] GET /identity/v3/projects/a6da77bad07843f5b55ff834b1d5781d => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:52.016872 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25de468-7e22-4349-9016-a33ebf7fd05c None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:52.110407 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25de468-7e22-4349-9016-a33ebf7fd05c None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:52.141245 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a97e5-b88f-4317-bee4-c0b8aaf5d8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:52.142049 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a97e5-b88f-4317-bee4-c0b8aaf5d8db None admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:52.142322 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a97e5-b88f-4317-bee4-c0b8aaf5d8db None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:52.142588 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a97e5-b88f-4317-bee4-c0b8aaf5d8db None admin] PATH_INFO: `/v3/projects/a6da77bad07843f5b55ff834b1d5781d/users/6ef768e787094d1eb0fa082371707d92/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:52.145068 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a97e5-b88f-4317-bee4-c0b8aaf5d8db None admin] RBAC: Authorizing `identity:create_grant(project_id=a6da77bad07843f5b55ff834b1d5781d, user_id=6ef768e787094d1eb0fa082371707d92, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:52.146471 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a97e5-b88f-4317-bee4-c0b8aaf5d8db None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:52.219264 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 574/1153] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:44:52 2022] PUT /identity/v3/projects/a6da77bad07843f5b55ff834b1d5781d/users/6ef768e787094d1eb0fa082371707d92/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:44:54.439340 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e1255-c3ef-4461-aede-195c3f811cb6 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:54.439896 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e1255-c3ef-4461-aede-195c3f811cb6 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:54.439896 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e1255-c3ef-4461-aede-195c3f811cb6 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:54.441703 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 580/1154] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:54.446753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54891e-26b8-46dc-b3c6-bc3e4f2be395 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:54.447191 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54891e-26b8-46dc-b3c6-bc3e4f2be395 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:54.447342 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54891e-26b8-46dc-b3c6-bc3e4f2be395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:54.464114 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-fa54891e-26b8-46dc-b3c6-bc3e4f2be395 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:54.465537 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-fa54891e-26b8-46dc-b3c6-bc3e4f2be395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:54.527564 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 575/1155] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:54.550496 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e1255-c3ef-4461-aede-195c3f811cb6 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:54.645393 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e1255-c3ef-4461-aede-195c3f811cb6 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:54.676373 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00893eb2-ce94-4a90-bc4f-b025b304778d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:54.677137 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00893eb2-ce94-4a90-bc4f-b025b304778d None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:54.677411 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00893eb2-ce94-4a90-bc4f-b025b304778d None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:54.677679 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00893eb2-ce94-4a90-bc4f-b025b304778d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:54.687524 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00893eb2-ce94-4a90-bc4f-b025b304778d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:44:54.694794 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-00893eb2-ce94-4a90-bc4f-b025b304778d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:44:54.695902 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 581/1156] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:44:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:54.701766 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54891e-26b8-46dc-b3c6-bc3e4f2be395 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:54.793668 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54891e-26b8-46dc-b3c6-bc3e4f2be395 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:54.825619 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fee114-fecc-4a6e-a7be-04699907a20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:54.826267 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fee114-fecc-4a6e-a7be-04699907a20c None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:54.826547 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fee114-fecc-4a6e-a7be-04699907a20c None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:54.826818 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fee114-fecc-4a6e-a7be-04699907a20c None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:54.827595 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fee114-fecc-4a6e-a7be-04699907a20c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:54.827894 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fee114-fecc-4a6e-a7be-04699907a20c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:54.829247 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fee114-fecc-4a6e-a7be-04699907a20c None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:54.837401 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 576/1157] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:44:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:44:54.843528 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00893eb2-ce94-4a90-bc4f-b025b304778d None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:54.938109 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00893eb2-ce94-4a90-bc4f-b025b304778d None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:54.969700 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cd788-d9d6-40cf-9f31-7868288f687e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:54.970488 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cd788-d9d6-40cf-9f31-7868288f687e None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:54.970758 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cd788-d9d6-40cf-9f31-7868288f687e None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:54.971048 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5cd788-d9d6-40cf-9f31-7868288f687e None admin] PATH_INFO: `/v3/users/6ef768e787094d1eb0fa082371707d92` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:54.972226 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cd788-d9d6-40cf-9f31-7868288f687e None admin] RBAC: Authorizing `identity:get_user(user_id=6ef768e787094d1eb0fa082371707d92)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:54.973632 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5cd788-d9d6-40cf-9f31-7868288f687e None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:54.975239 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 582/1158] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:44:54 2022] GET /identity/v3/users/6ef768e787094d1eb0fa082371707d92 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:54.980846 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fee114-fecc-4a6e-a7be-04699907a20c None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:55.199687 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fee114-fecc-4a6e-a7be-04699907a20c None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:55.230266 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3afa0d-a8e0-4f2c-92fd-95dadb3332a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:55.230858 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3afa0d-a8e0-4f2c-92fd-95dadb3332a8 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:55.231142 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3afa0d-a8e0-4f2c-92fd-95dadb3332a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:55.231411 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3afa0d-a8e0-4f2c-92fd-95dadb3332a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:55.292598 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3afa0d-a8e0-4f2c-92fd-95dadb3332a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:55.293997 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3afa0d-a8e0-4f2c-92fd-95dadb3332a8 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:55.384242 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 577/1159] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:44:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 23:44:55.390143 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cd788-d9d6-40cf-9f31-7868288f687e None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:55.481770 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5cd788-d9d6-40cf-9f31-7868288f687e None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:55.512653 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa2125-f3b9-4f75-b0a4-d6f295390732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:55.513489 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa2125-f3b9-4f75-b0a4-d6f295390732 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:55.513764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa2125-f3b9-4f75-b0a4-d6f295390732 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:55.514032 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa2125-f3b9-4f75-b0a4-d6f295390732 None admin] PATH_INFO: `/v3/projects/a6da77bad07843f5b55ff834b1d5781d` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:55.515209 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa2125-f3b9-4f75-b0a4-d6f295390732 None admin] RBAC: Authorizing `identity:get_project(project_id=a6da77bad07843f5b55ff834b1d5781d)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:55.516606 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa2125-f3b9-4f75-b0a4-d6f295390732 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:55.518264 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 583/1160] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:44:55 2022] GET /identity/v3/projects/a6da77bad07843f5b55ff834b1d5781d => generated 311 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:55.524213 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3afa0d-a8e0-4f2c-92fd-95dadb3332a8 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:55.615960 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3afa0d-a8e0-4f2c-92fd-95dadb3332a8 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:55.646898 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6faf82-fc7a-43a9-844d-6511d5866332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:55.647510 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6faf82-fc7a-43a9-844d-6511d5866332 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:55.647786 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6faf82-fc7a-43a9-844d-6511d5866332 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:55.648055 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6faf82-fc7a-43a9-844d-6511d5866332 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:55.648874 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6faf82-fc7a-43a9-844d-6511d5866332 None admin] RBAC: Adding query filter params (role.id=c8affbefb4c5462a921650b24b13c80f, scope.project.id=a6da77bad07843f5b55ff834b1d5781d, user.id=6ef768e787094d1eb0fa082371707d92) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:55.649178 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6faf82-fc7a-43a9-844d-6511d5866332 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:55.650580 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6faf82-fc7a-43a9-844d-6511d5866332 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:55.656081 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 578/1161] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:44:55 2022] GET /identity/v3/role_assignments?user.id=6ef768e787094d1eb0fa082371707d92&scope.project.id=a6da77bad07843f5b55ff834b1d5781d&role.id=c8affbefb4c5462a921650b24b13c80f => generated 608 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:44:57.947800 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d05f0-1284-4ca3-a925-9c56f76d2cbf None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:57.948336 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d05f0-1284-4ca3-a925-9c56f76d2cbf None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:57.948336 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d05f0-1284-4ca3-a925-9c56f76d2cbf None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:57.950119 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 584/1162] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:44:57.955217 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e64e4-a2d1-4615-96b7-3557a2ea94f3 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:57.955641 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e64e4-a2d1-4615-96b7-3557a2ea94f3 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:57.955762 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08e64e4-a2d1-4615-96b7-3557a2ea94f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:57.972543 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-e08e64e4-a2d1-4615-96b7-3557a2ea94f3 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:44:57.973816 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-e08e64e4-a2d1-4615-96b7-3557a2ea94f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:44:58.042090 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 579/1163] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:44:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:44:58.065950 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d05f0-1284-4ca3-a925-9c56f76d2cbf None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:58.163426 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d05f0-1284-4ca3-a925-9c56f76d2cbf None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:58.195095 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba640713-aca6-440f-a601-6e89aebea5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:58.195722 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba640713-aca6-440f-a601-6e89aebea5f2 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:58.195997 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba640713-aca6-440f-a601-6e89aebea5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:58.196265 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba640713-aca6-440f-a601-6e89aebea5f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:58.258155 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba640713-aca6-440f-a601-6e89aebea5f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:58.259589 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba640713-aca6-440f-a601-6e89aebea5f2 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:58.349597 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 585/1164] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:44:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 23:44:58.355563 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e64e4-a2d1-4615-96b7-3557a2ea94f3 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:58.446321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08e64e4-a2d1-4615-96b7-3557a2ea94f3 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:58.477510 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376959ef-8535-46ee-9f85-d256185a2cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:58.478354 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376959ef-8535-46ee-9f85-d256185a2cf8 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:58.478634 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376959ef-8535-46ee-9f85-d256185a2cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:58.479054 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376959ef-8535-46ee-9f85-d256185a2cf8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:58.485632 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376959ef-8535-46ee-9f85-d256185a2cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:58.487695 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376959ef-8535-46ee-9f85-d256185a2cf8 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:58.501226 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-376959ef-8535-46ee-9f85-d256185a2cf8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Apr 11 23:44:58.502365 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 580/1165] 10.222.0.24 () {56 vars in 1117 bytes} [Mon Apr 11 23:44:58 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:44:58.508056 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba640713-aca6-440f-a601-6e89aebea5f2 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:44:58.599908 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba640713-aca6-440f-a601-6e89aebea5f2 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:44:58.632853 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c56ae0-3f07-4126-8c47-f60bb749c209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:44:58.633485 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c56ae0-3f07-4126-8c47-f60bb749c209 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:44:58.633761 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c56ae0-3f07-4126-8c47-f60bb749c209 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:44:58.634028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c56ae0-3f07-4126-8c47-f60bb749c209 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:44:58.634733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c56ae0-3f07-4126-8c47-f60bb749c209 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:44:58.635056 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c56ae0-3f07-4126-8c47-f60bb749c209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:44:58.636389 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c56ae0-3f07-4126-8c47-f60bb749c209 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:44:58.643732 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 586/1166] 10.222.0.24 () {56 vars in 1115 bytes} [Mon Apr 11 23:44:58 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:45:00.860758 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39267e95-2dd3-435c-9ae6-478b8b6e1006 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:00.861257 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39267e95-2dd3-435c-9ae6-478b8b6e1006 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:00.861352 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39267e95-2dd3-435c-9ae6-478b8b6e1006 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:00.864549 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 581/1167] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:45:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:45:00.869730 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af451b7-a893-4ddf-862b-abae2a2dfdf0 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:00.870155 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af451b7-a893-4ddf-862b-abae2a2dfdf0 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:00.870258 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af451b7-a893-4ddf-862b-abae2a2dfdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:00.886961 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-9af451b7-a893-4ddf-862b-abae2a2dfdf0 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:45:00.888118 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-9af451b7-a893-4ddf-862b-abae2a2dfdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:45:00.949438 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 587/1168] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:45:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:45:00.972562 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39267e95-2dd3-435c-9ae6-478b8b6e1006 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:45:01.067130 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39267e95-2dd3-435c-9ae6-478b8b6e1006 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:45:01.103102 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697f4ba-3b55-4333-9659-9b2c8115490b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:45:01.103757 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697f4ba-3b55-4333-9659-9b2c8115490b None admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:01.104036 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697f4ba-3b55-4333-9659-9b2c8115490b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:01.104423 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697f4ba-3b55-4333-9659-9b2c8115490b None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:01.105176 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697f4ba-3b55-4333-9659-9b2c8115490b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:45:01.106526 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697f4ba-3b55-4333-9659-9b2c8115490b None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:45:01.175321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 582/1169] 10.222.0.24 () {60 vars in 1138 bytes} [Mon Apr 11 23:45:00 2022] POST /identity/v3/domains => generated 267 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:45:03.450159 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a43565-003b-46f4-b722-fa6a9d51dcc0 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:03.450708 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a43565-003b-46f4-b722-fa6a9d51dcc0 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:03.450708 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a43565-003b-46f4-b722-fa6a9d51dcc0 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:03.452504 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 588/1170] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:45:03.458243 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9f42a-4c1f-4dea-9a25-89dc8b5bf70d None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:03.458670 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9f42a-4c1f-4dea-9a25-89dc8b5bf70d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:03.458762 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9f42a-4c1f-4dea-9a25-89dc8b5bf70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:03.475670 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-f0d9f42a-4c1f-4dea-9a25-89dc8b5bf70d None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:45:03.476815 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-f0d9f42a-4c1f-4dea-9a25-89dc8b5bf70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:45:03.537673 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 583/1171] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:45:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:45:03.560436 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a43565-003b-46f4-b722-fa6a9d51dcc0 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:45:03.653488 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a43565-003b-46f4-b722-fa6a9d51dcc0 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:45:03.684332 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b462ee5-1d94-471f-9302-40771555a420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:45:03.685154 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b462ee5-1d94-471f-9302-40771555a420 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:03.685425 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b462ee5-1d94-471f-9302-40771555a420 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:03.685688 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b462ee5-1d94-471f-9302-40771555a420 None admin] PATH_INFO: `/v3/domains/117068b9a0b541de8a24402a9d7223d1` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:03.695840 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b462ee5-1d94-471f-9302-40771555a420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=117068b9a0b541de8a24402a9d7223d1)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:45:03.697245 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b462ee5-1d94-471f-9302-40771555a420 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:45:03.698808 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 589/1172] 10.222.0.24 () {56 vars in 1183 bytes} [Mon Apr 11 23:45:03 2022] GET /identity/v3/domains/117068b9a0b541de8a24402a9d7223d1 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:45:03.704312 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9f42a-4c1f-4dea-9a25-89dc8b5bf70d None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:45:03.795369 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9f42a-4c1f-4dea-9a25-89dc8b5bf70d None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:45:03.827083 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1569a-065f-4433-8f57-1ddc7978b424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:45:03.827721 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1569a-065f-4433-8f57-1ddc7978b424 None admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:03.827994 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1569a-065f-4433-8f57-1ddc7978b424 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:03.828258 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1569a-065f-4433-8f57-1ddc7978b424 None admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:03.828962 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1569a-065f-4433-8f57-1ddc7978b424 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:45:03.830384 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1569a-065f-4433-8f57-1ddc7978b424 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:45:03.905864 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 584/1173] 10.222.0.24 () {60 vars in 1141 bytes} [Mon Apr 11 23:45:03 2022] POST /identity/v3/projects => generated 361 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:45:06.218643 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e158f3-fd01-4c99-82b1-79bfdfc1850a None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:06.219247 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e158f3-fd01-4c99-82b1-79bfdfc1850a None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:06.219247 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e158f3-fd01-4c99-82b1-79bfdfc1850a None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:06.221536 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 590/1174] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:45:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:45:06.226743 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97932a-b39b-4301-9b74-67f2e9a715ba None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:06.227185 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97932a-b39b-4301-9b74-67f2e9a715ba None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:06.227325 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97932a-b39b-4301-9b74-67f2e9a715ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:06.244390 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-5a97932a-b39b-4301-9b74-67f2e9a715ba None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:45:06.245568 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-5a97932a-b39b-4301-9b74-67f2e9a715ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:45:06.307645 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 585/1175] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:45:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:45:06.332488 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e158f3-fd01-4c99-82b1-79bfdfc1850a None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:45:06.428886 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e158f3-fd01-4c99-82b1-79bfdfc1850a None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:45:06.460046 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a413d-7086-413e-b7f3-efb433b1cb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:45:06.460886 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a413d-7086-413e-b7f3-efb433b1cb47 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:06.461162 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a413d-7086-413e-b7f3-efb433b1cb47 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:06.461430 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a413d-7086-413e-b7f3-efb433b1cb47 None admin] PATH_INFO: `/v3/domains/117068b9a0b541de8a24402a9d7223d1` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:06.462588 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a413d-7086-413e-b7f3-efb433b1cb47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=117068b9a0b541de8a24402a9d7223d1)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:45:06.464038 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a413d-7086-413e-b7f3-efb433b1cb47 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:45:06.465879 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 591/1176] 10.222.0.24 () {56 vars in 1183 bytes} [Mon Apr 11 23:45:06 2022] GET /identity/v3/domains/117068b9a0b541de8a24402a9d7223d1 => generated 267 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:45:06.472154 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97932a-b39b-4301-9b74-67f2e9a715ba None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:45:06.562971 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97932a-b39b-4301-9b74-67f2e9a715ba None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:45:06.594820 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1536e6-bbd8-4c72-aa68-ef97ae3f97b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:45:06.595501 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1536e6-bbd8-4c72-aa68-ef97ae3f97b6 None admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:06.595782 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1536e6-bbd8-4c72-aa68-ef97ae3f97b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:06.596093 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1536e6-bbd8-4c72-aa68-ef97ae3f97b6 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:06.597304 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1536e6-bbd8-4c72-aa68-ef97ae3f97b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:45:06.598717 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1536e6-bbd8-4c72-aa68-ef97ae3f97b6 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:45:06.704550 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 586/1177] 10.222.0.24 () {60 vars in 1132 bytes} [Mon Apr 11 23:45:06 2022] POST /identity/v3/users => generated 311 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:45:09.001383 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65fd3b-bae5-4a16-ba49-1789526c3fdb None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:09.010438 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65fd3b-bae5-4a16-ba49-1789526c3fdb None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:09.010438 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65fd3b-bae5-4a16-ba49-1789526c3fdb None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:09.010438 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 592/1178] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:45:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:45:09.010713 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ee9d5-1918-48e0-b4d1-242b39f0ad73 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:09.010713 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ee9d5-1918-48e0-b4d1-242b39f0ad73 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:09.010713 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ee9d5-1918-48e0-b4d1-242b39f0ad73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:09.026826 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-730ee9d5-1918-48e0-b4d1-242b39f0ad73 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:45:09.027958 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-730ee9d5-1918-48e0-b4d1-242b39f0ad73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:45:09.091892 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 587/1179] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:45:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:45:09.114814 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65fd3b-bae5-4a16-ba49-1789526c3fdb None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:45:09.219188 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65fd3b-bae5-4a16-ba49-1789526c3fdb None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:45:09.249807 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36374ff-f932-41ec-8f4c-e5e724a1f6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:45:09.250583 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36374ff-f932-41ec-8f4c-e5e724a1f6fa None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:09.250891 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36374ff-f932-41ec-8f4c-e5e724a1f6fa None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:09.251168 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36374ff-f932-41ec-8f4c-e5e724a1f6fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:09.261705 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36374ff-f932-41ec-8f4c-e5e724a1f6fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:45:09.269167 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-c36374ff-f932-41ec-8f4c-e5e724a1f6fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:45:09.270321 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 593/1180] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:45:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:45:09.276328 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ee9d5-1918-48e0-b4d1-242b39f0ad73 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:45:09.367418 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730ee9d5-1918-48e0-b4d1-242b39f0ad73 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:45:09.399138 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cf6d4-94ba-4ee0-98dd-c7918cf1f494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:45:09.399778 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cf6d4-94ba-4ee0-98dd-c7918cf1f494 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:09.400053 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cf6d4-94ba-4ee0-98dd-c7918cf1f494 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:09.400319 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6cf6d4-94ba-4ee0-98dd-c7918cf1f494 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:09.401059 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6cf6d4-94ba-4ee0-98dd-c7918cf1f494 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:45:09.401355 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6cf6d4-94ba-4ee0-98dd-c7918cf1f494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:45:09.402690 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6cf6d4-94ba-4ee0-98dd-c7918cf1f494 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:45:09.410271 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 588/1181] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:45:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:45:09.419196 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36374ff-f932-41ec-8f4c-e5e724a1f6fa None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:45:09.512510 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36374ff-f932-41ec-8f4c-e5e724a1f6fa None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:45:09.543153 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fff380-97b2-4e25-a4ca-06931ee583f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:45:09.543991 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fff380-97b2-4e25-a4ca-06931ee583f7 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:09.544266 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fff380-97b2-4e25-a4ca-06931ee583f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:09.544534 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fff380-97b2-4e25-a4ca-06931ee583f7 None admin] PATH_INFO: `/v3/users/01dfef958968471da4fa51a74facaa17` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:09.558041 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fff380-97b2-4e25-a4ca-06931ee583f7 None admin] RBAC: Authorizing `identity:get_user(user_id=01dfef958968471da4fa51a74facaa17)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:45:09.559474 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fff380-97b2-4e25-a4ca-06931ee583f7 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:45:09.561048 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 594/1182] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:45:09 2022] GET /identity/v3/users/01dfef958968471da4fa51a74facaa17 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:45:09.567417 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cf6d4-94ba-4ee0-98dd-c7918cf1f494 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:45:09.659499 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6cf6d4-94ba-4ee0-98dd-c7918cf1f494 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:45:09.691037 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3834f-2f5f-4970-8539-4d23af971fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:45:09.691748 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3834f-2f5f-4970-8539-4d23af971fe6 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:09.692031 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3834f-2f5f-4970-8539-4d23af971fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:09.692304 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3834f-2f5f-4970-8539-4d23af971fe6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:09.754334 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3834f-2f5f-4970-8539-4d23af971fe6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:45:09.755787 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3834f-2f5f-4970-8539-4d23af971fe6 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:45:09.846683 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 589/1183] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:45:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 23:45:09.852569 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fff380-97b2-4e25-a4ca-06931ee583f7 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:45:09.945700 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fff380-97b2-4e25-a4ca-06931ee583f7 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:45:09.976996 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b5ec6-9223-46c0-941a-7e3209ed42d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:45:09.977818 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b5ec6-9223-46c0-941a-7e3209ed42d8 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:09.978088 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b5ec6-9223-46c0-941a-7e3209ed42d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:09.978351 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b5ec6-9223-46c0-941a-7e3209ed42d8 None admin] PATH_INFO: `/v3/projects/b52c238f032b44c3aa901a8a21f32e8e` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:09.979516 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b5ec6-9223-46c0-941a-7e3209ed42d8 None admin] RBAC: Authorizing `identity:get_project(project_id=b52c238f032b44c3aa901a8a21f32e8e)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:45:09.980915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386b5ec6-9223-46c0-941a-7e3209ed42d8 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:45:09.982548 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 595/1184] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:45:09 2022] GET /identity/v3/projects/b52c238f032b44c3aa901a8a21f32e8e => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:45:09.989010 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3834f-2f5f-4970-8539-4d23af971fe6 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:45:10.083246 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3834f-2f5f-4970-8539-4d23af971fe6 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:45:10.114761 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0b8d8-d934-450b-9b53-5efb5a470b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:45:10.115417 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0b8d8-d934-450b-9b53-5efb5a470b56 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:10.115695 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0b8d8-d934-450b-9b53-5efb5a470b56 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:10.115964 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0b8d8-d934-450b-9b53-5efb5a470b56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:10.116783 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0b8d8-d934-450b-9b53-5efb5a470b56 None admin] RBAC: Adding query filter params (role.id=c8affbefb4c5462a921650b24b13c80f, scope.project.id=b52c238f032b44c3aa901a8a21f32e8e, user.id=01dfef958968471da4fa51a74facaa17) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:45:10.117085 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0b8d8-d934-450b-9b53-5efb5a470b56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:45:10.118494 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0b8d8-d934-450b-9b53-5efb5a470b56 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:45:10.123598 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 590/1185] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:45:09 2022] GET /identity/v3/role_assignments?user.id=01dfef958968471da4fa51a74facaa17&scope.project.id=b52c238f032b44c3aa901a8a21f32e8e&role.id=c8affbefb4c5462a921650b24b13c80f => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:45:12.339823 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6859c-0789-4796-80eb-de275a75a8d5 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:12.340622 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6859c-0789-4796-80eb-de275a75a8d5 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:12.340622 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa6859c-0789-4796-80eb-de275a75a8d5 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:12.342384 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 596/1186] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:45:12.347646 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630b134-6e15-4017-b8a7-08cb3e24aa0d None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:12.348034 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630b134-6e15-4017-b8a7-08cb3e24aa0d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:12.348197 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630b134-6e15-4017-b8a7-08cb3e24aa0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:12.364801 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-e630b134-6e15-4017-b8a7-08cb3e24aa0d None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:45:12.365952 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-e630b134-6e15-4017-b8a7-08cb3e24aa0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:45:12.427350 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 591/1187] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:45:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:45:12.449674 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6859c-0789-4796-80eb-de275a75a8d5 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:45:12.543710 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa6859c-0789-4796-80eb-de275a75a8d5 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:45:12.575494 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bcb9c-5370-4171-a556-86e790da6710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:45:12.576253 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bcb9c-5370-4171-a556-86e790da6710 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:12.576536 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bcb9c-5370-4171-a556-86e790da6710 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:12.576805 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228bcb9c-5370-4171-a556-86e790da6710 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:12.586611 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228bcb9c-5370-4171-a556-86e790da6710 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:45:12.594276 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-228bcb9c-5370-4171-a556-86e790da6710 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:45:12.595573 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 597/1188] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:45:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:45:12.601394 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630b134-6e15-4017-b8a7-08cb3e24aa0d None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:45:12.693282 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e630b134-6e15-4017-b8a7-08cb3e24aa0d None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:45:12.724680 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59174605-8430-45d2-a03c-9bb7d60c9163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:45:12.725321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59174605-8430-45d2-a03c-9bb7d60c9163 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:12.725598 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59174605-8430-45d2-a03c-9bb7d60c9163 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:12.725865 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59174605-8430-45d2-a03c-9bb7d60c9163 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:12.726595 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59174605-8430-45d2-a03c-9bb7d60c9163 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:45:12.726919 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59174605-8430-45d2-a03c-9bb7d60c9163 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:45:12.728254 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59174605-8430-45d2-a03c-9bb7d60c9163 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:45:12.735753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 592/1189] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:45:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:45:12.741975 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bcb9c-5370-4171-a556-86e790da6710 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:45:12.835892 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228bcb9c-5370-4171-a556-86e790da6710 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:45:12.868065 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b974ce-0c45-4061-aa71-faee3d532598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:45:12.868917 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b974ce-0c45-4061-aa71-faee3d532598 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:12.869193 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b974ce-0c45-4061-aa71-faee3d532598 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:12.869465 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b974ce-0c45-4061-aa71-faee3d532598 None admin] PATH_INFO: `/v3/users/01dfef958968471da4fa51a74facaa17` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:12.870630 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b974ce-0c45-4061-aa71-faee3d532598 None admin] RBAC: Authorizing `identity:get_user(user_id=01dfef958968471da4fa51a74facaa17)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:45:12.872069 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b974ce-0c45-4061-aa71-faee3d532598 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:45:12.873663 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 598/1190] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:45:12 2022] GET /identity/v3/users/01dfef958968471da4fa51a74facaa17 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:45:12.879458 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59174605-8430-45d2-a03c-9bb7d60c9163 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:45:12.973012 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59174605-8430-45d2-a03c-9bb7d60c9163 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:45:13.004414 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b768bd-e6dd-4b18-8e96-fd27e5484f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:45:13.005248 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b768bd-e6dd-4b18-8e96-fd27e5484f16 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:13.005527 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b768bd-e6dd-4b18-8e96-fd27e5484f16 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:13.005800 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b768bd-e6dd-4b18-8e96-fd27e5484f16 None admin] PATH_INFO: `/v3/projects/b52c238f032b44c3aa901a8a21f32e8e` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:13.007001 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b768bd-e6dd-4b18-8e96-fd27e5484f16 None admin] RBAC: Authorizing `identity:get_project(project_id=b52c238f032b44c3aa901a8a21f32e8e)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:45:13.008406 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b768bd-e6dd-4b18-8e96-fd27e5484f16 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:45:13.010071 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 593/1191] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:45:12 2022] GET /identity/v3/projects/b52c238f032b44c3aa901a8a21f32e8e => generated 361 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:45:13.015847 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b974ce-0c45-4061-aa71-faee3d532598 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:45:13.109673 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b974ce-0c45-4061-aa71-faee3d532598 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:45:13.141941 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec5357-42bd-45ed-870b-2fe9efc62e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:45:13.143249 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec5357-42bd-45ed-870b-2fe9efc62e3b None admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:13.143531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec5357-42bd-45ed-870b-2fe9efc62e3b None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:13.143869 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec5357-42bd-45ed-870b-2fe9efc62e3b None admin] PATH_INFO: `/v3/projects/b52c238f032b44c3aa901a8a21f32e8e/users/01dfef958968471da4fa51a74facaa17/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:13.145742 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec5357-42bd-45ed-870b-2fe9efc62e3b None admin] RBAC: Authorizing `identity:create_grant(project_id=b52c238f032b44c3aa901a8a21f32e8e, user_id=01dfef958968471da4fa51a74facaa17, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:45:13.147193 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec5357-42bd-45ed-870b-2fe9efc62e3b None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:45:13.212875 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 599/1192] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:45:13 2022] PUT /identity/v3/projects/b52c238f032b44c3aa901a8a21f32e8e/users/01dfef958968471da4fa51a74facaa17/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:45:15.447808 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f097aa3-add5-43fb-b756-7d81d8ca8d7d None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:15.448411 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f097aa3-add5-43fb-b756-7d81d8ca8d7d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:15.448411 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f097aa3-add5-43fb-b756-7d81d8ca8d7d None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:15.450155 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 594/1193] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:45:15.455401 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4a5a-08e6-4373-92e9-57cbe426e0d3 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:15.455786 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4a5a-08e6-4373-92e9-57cbe426e0d3 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:15.455957 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e4a5a-08e6-4373-92e9-57cbe426e0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:15.472465 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-ac5e4a5a-08e6-4373-92e9-57cbe426e0d3 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:45:15.473615 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-ac5e4a5a-08e6-4373-92e9-57cbe426e0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:45:15.535358 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 600/1194] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:45:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:45:15.558747 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f097aa3-add5-43fb-b756-7d81d8ca8d7d None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:45:15.653007 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f097aa3-add5-43fb-b756-7d81d8ca8d7d None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:45:15.684618 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d588c1-2370-489e-ab9e-fcc2f7105dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:45:15.685380 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d588c1-2370-489e-ab9e-fcc2f7105dee None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:15.685658 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d588c1-2370-489e-ab9e-fcc2f7105dee None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:15.685926 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d588c1-2370-489e-ab9e-fcc2f7105dee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:15.695915 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d588c1-2370-489e-ab9e-fcc2f7105dee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:45:15.702751 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-63d588c1-2370-489e-ab9e-fcc2f7105dee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:45:15.703863 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 595/1195] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:45:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:45:15.709599 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e4a5a-08e6-4373-92e9-57cbe426e0d3 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:45:15.803884 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e4a5a-08e6-4373-92e9-57cbe426e0d3 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:45:15.835264 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbef1f4-026a-459a-8725-4f809f1e6fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:45:15.835913 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbef1f4-026a-459a-8725-4f809f1e6fba None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:15.836191 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbef1f4-026a-459a-8725-4f809f1e6fba None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:15.836461 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbef1f4-026a-459a-8725-4f809f1e6fba None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:15.837192 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbef1f4-026a-459a-8725-4f809f1e6fba None admin] RBAC: Adding query filter params (name=admin) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:45:15.837487 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbef1f4-026a-459a-8725-4f809f1e6fba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:45:15.838854 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbef1f4-026a-459a-8725-4f809f1e6fba None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:45:15.846614 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 601/1196] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:45:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:45:15.852876 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d588c1-2370-489e-ab9e-fcc2f7105dee None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:45:15.943504 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d588c1-2370-489e-ab9e-fcc2f7105dee None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:45:15.974755 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceace19-8f7b-4666-9de0-5bb3d4af322a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:45:15.975564 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceace19-8f7b-4666-9de0-5bb3d4af322a None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:15.975836 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceace19-8f7b-4666-9de0-5bb3d4af322a None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:15.976105 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceace19-8f7b-4666-9de0-5bb3d4af322a None admin] PATH_INFO: `/v3/users/01dfef958968471da4fa51a74facaa17` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:15.977258 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceace19-8f7b-4666-9de0-5bb3d4af322a None admin] RBAC: Authorizing `identity:get_user(user_id=01dfef958968471da4fa51a74facaa17)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:45:15.978650 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceace19-8f7b-4666-9de0-5bb3d4af322a None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:45:15.980238 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 596/1197] 10.222.0.24 () {56 vars in 1177 bytes} [Mon Apr 11 23:45:15 2022] GET /identity/v3/users/01dfef958968471da4fa51a74facaa17 => generated 311 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:45:15.985626 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbef1f4-026a-459a-8725-4f809f1e6fba None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:45:16.078439 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbef1f4-026a-459a-8725-4f809f1e6fba None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:45:16.111973 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa05a4f-a0f3-493c-b860-8d9f24839d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:45:16.112615 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa05a4f-a0f3-493c-b860-8d9f24839d6f None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:16.112924 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa05a4f-a0f3-493c-b860-8d9f24839d6f None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:16.113195 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa05a4f-a0f3-493c-b860-8d9f24839d6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:16.176272 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa05a4f-a0f3-493c-b860-8d9f24839d6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:45:16.177689 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa05a4f-a0f3-493c-b860-8d9f24839d6f None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:45:16.271269 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 602/1198] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:45:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 23:45:16.277106 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceace19-8f7b-4666-9de0-5bb3d4af322a None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:45:16.368560 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceace19-8f7b-4666-9de0-5bb3d4af322a None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:45:16.399552 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11084814-d2e3-460a-bd03-57fae2b37474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:45:16.400379 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11084814-d2e3-460a-bd03-57fae2b37474 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:16.400652 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11084814-d2e3-460a-bd03-57fae2b37474 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:16.400920 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11084814-d2e3-460a-bd03-57fae2b37474 None admin] PATH_INFO: `/v3/projects/b52c238f032b44c3aa901a8a21f32e8e` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:16.402062 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11084814-d2e3-460a-bd03-57fae2b37474 None admin] RBAC: Authorizing `identity:get_project(project_id=b52c238f032b44c3aa901a8a21f32e8e)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:45:16.403489 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11084814-d2e3-460a-bd03-57fae2b37474 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:45:16.405119 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 597/1199] 10.222.0.24 () {56 vars in 1186 bytes} [Mon Apr 11 23:45:16 2022] GET /identity/v3/projects/b52c238f032b44c3aa901a8a21f32e8e => generated 361 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:45:16.411455 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa05a4f-a0f3-493c-b860-8d9f24839d6f None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:45:16.503682 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa05a4f-a0f3-493c-b860-8d9f24839d6f None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:45:16.534400 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02d906-3a8c-474b-a429-5336f5cbc4c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:45:16.535518 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02d906-3a8c-474b-a429-5336f5cbc4c8 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:45:16.535791 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02d906-3a8c-474b-a429-5336f5cbc4c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:45:16.536086 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02d906-3a8c-474b-a429-5336f5cbc4c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:45:16.536898 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02d906-3a8c-474b-a429-5336f5cbc4c8 None admin] RBAC: Adding query filter params (role.id=c8affbefb4c5462a921650b24b13c80f, scope.project.id=b52c238f032b44c3aa901a8a21f32e8e, user.id=01dfef958968471da4fa51a74facaa17) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:45:16.537199 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02d906-3a8c-474b-a429-5336f5cbc4c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:45:16.538595 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02d906-3a8c-474b-a429-5336f5cbc4c8 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:45:16.544057 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 603/1200] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:45:16 2022] GET /identity/v3/role_assignments?user.id=01dfef958968471da4fa51a74facaa17&scope.project.id=b52c238f032b44c3aa901a8a21f32e8e&role.id=c8affbefb4c5462a921650b24b13c80f => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:32.645085 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bc1fb-7300-41bb-a83b-2526732a9352 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:32.645669 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bc1fb-7300-41bb-a83b-2526732a9352 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:32.645669 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bc1fb-7300-41bb-a83b-2526732a9352 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:32.647447 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 598/1201] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:46:32.652514 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd4c50-3f24-4a00-9c3b-d7b3af052aca None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:32.652949 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd4c50-3f24-4a00-9c3b-d7b3af052aca None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:32.653046 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd4c50-3f24-4a00-9c3b-d7b3af052aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:32.669422 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-a8cd4c50-3f24-4a00-9c3b-d7b3af052aca None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:46:32.674764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a8cd4c50-3f24-4a00-9c3b-d7b3af052aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:46:32.740074 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 604/1202] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:46:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:46:32.770242 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bc1fb-7300-41bb-a83b-2526732a9352 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:32.867356 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bc1fb-7300-41bb-a83b-2526732a9352 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:32.899877 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2969ab-4f41-48cf-9bab-d03b4c24d848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:32.900581 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2969ab-4f41-48cf-9bab-d03b4c24d848 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:32.900853 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2969ab-4f41-48cf-9bab-d03b4c24d848 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:32.901118 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2969ab-4f41-48cf-9bab-d03b4c24d848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:32.910557 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2969ab-4f41-48cf-9bab-d03b4c24d848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:32.912166 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2969ab-4f41-48cf-9bab-d03b4c24d848 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:32.928530 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-cb2969ab-4f41-48cf-9bab-d03b4c24d848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:46:32.929657 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 599/1203] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:46:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:32.936451 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd4c50-3f24-4a00-9c3b-d7b3af052aca None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:33.026905 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd4c50-3f24-4a00-9c3b-d7b3af052aca None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:33.059983 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc332b7-5236-4e5c-946a-a0df2378acfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:33.060623 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc332b7-5236-4e5c-946a-a0df2378acfc None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:33.060899 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc332b7-5236-4e5c-946a-a0df2378acfc None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:33.061170 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc332b7-5236-4e5c-946a-a0df2378acfc None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:33.061912 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc332b7-5236-4e5c-946a-a0df2378acfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:33.062209 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc332b7-5236-4e5c-946a-a0df2378acfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:33.063605 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc332b7-5236-4e5c-946a-a0df2378acfc None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:33.074260 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 605/1204] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:46:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:33.079917 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2969ab-4f41-48cf-9bab-d03b4c24d848 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:33.187265 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2969ab-4f41-48cf-9bab-d03b4c24d848 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:33.219739 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb095ae-a678-4b78-9a61-5599cec448fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:33.220394 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb095ae-a678-4b78-9a61-5599cec448fa None admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:33.220668 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb095ae-a678-4b78-9a61-5599cec448fa None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:33.220940 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb095ae-a678-4b78-9a61-5599cec448fa None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:33.221641 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb095ae-a678-4b78-9a61-5599cec448fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:33.223120 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb095ae-a678-4b78-9a61-5599cec448fa None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:33.366105 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 600/1205] 10.222.0.24 () {60 vars in 1132 bytes} [Mon Apr 11 23:46:33 2022] POST /identity/v3/users => generated 251 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:46:35.661172 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0c779-7b9b-4082-94f0-3f37e3c42053 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:35.661724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0c779-7b9b-4082-94f0-3f37e3c42053 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:35.661724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d0c779-7b9b-4082-94f0-3f37e3c42053 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:35.663569 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 606/1206] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:46:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:46:35.669299 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610022d-99b4-4a6d-8d19-cc20e5c437d3 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:35.674337 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610022d-99b4-4a6d-8d19-cc20e5c437d3 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:35.674337 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610022d-99b4-4a6d-8d19-cc20e5c437d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:35.686224 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-d610022d-99b4-4a6d-8d19-cc20e5c437d3 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:46:35.687423 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d610022d-99b4-4a6d-8d19-cc20e5c437d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:46:35.750867 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 601/1207] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:46:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:46:35.775773 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0c779-7b9b-4082-94f0-3f37e3c42053 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:35.886470 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d0c779-7b9b-4082-94f0-3f37e3c42053 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:35.918367 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b8be8-58bd-44c8-9e1e-21d333f2d8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:35.919169 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b8be8-58bd-44c8-9e1e-21d333f2d8ab None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:35.919449 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b8be8-58bd-44c8-9e1e-21d333f2d8ab None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:35.919719 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b8be8-58bd-44c8-9e1e-21d333f2d8ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:35.929847 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b8be8-58bd-44c8-9e1e-21d333f2d8ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:46:35.936951 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-3a0b8be8-58bd-44c8-9e1e-21d333f2d8ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 23:46:35.938125 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 607/1208] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:46:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:35.944225 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610022d-99b4-4a6d-8d19-cc20e5c437d3 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:36.037569 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610022d-99b4-4a6d-8d19-cc20e5c437d3 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:36.069046 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafb141-7c6a-41b8-a4bd-7eb291618906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:36.069696 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafb141-7c6a-41b8-a4bd-7eb291618906 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:36.069985 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafb141-7c6a-41b8-a4bd-7eb291618906 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:36.070237 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafb141-7c6a-41b8-a4bd-7eb291618906 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:36.071552 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafb141-7c6a-41b8-a4bd-7eb291618906 None admin] RBAC: Adding query filter params (name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:36.071850 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafb141-7c6a-41b8-a4bd-7eb291618906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:36.073186 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fafb141-7c6a-41b8-a4bd-7eb291618906 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:36.080879 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 602/1209] 10.222.0.24 () {56 vars in 1103 bytes} [Mon Apr 11 23:46:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:36.087148 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b8be8-58bd-44c8-9e1e-21d333f2d8ab None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:36.181300 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b8be8-58bd-44c8-9e1e-21d333f2d8ab None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:36.213677 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f38d3-2a40-4eb8-b857-9ad50b777b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:36.214454 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f38d3-2a40-4eb8-b857-9ad50b777b90 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:36.214732 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f38d3-2a40-4eb8-b857-9ad50b777b90 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:36.215034 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f38d3-2a40-4eb8-b857-9ad50b777b90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:36.224994 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f38d3-2a40-4eb8-b857-9ad50b777b90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:36.226414 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f38d3-2a40-4eb8-b857-9ad50b777b90 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:36.244138 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-074f38d3-2a40-4eb8-b857-9ad50b777b90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:46:36.245326 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 608/1210] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:46:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:36.251413 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafb141-7c6a-41b8-a4bd-7eb291618906 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:36.345439 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafb141-7c6a-41b8-a4bd-7eb291618906 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:36.377709 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43937fb3-1147-41f5-aae9-af0d6e81ef95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:36.378369 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43937fb3-1147-41f5-aae9-af0d6e81ef95 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:36.378634 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43937fb3-1147-41f5-aae9-af0d6e81ef95 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:36.378931 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43937fb3-1147-41f5-aae9-af0d6e81ef95 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:36.379648 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43937fb3-1147-41f5-aae9-af0d6e81ef95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:36.379949 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43937fb3-1147-41f5-aae9-af0d6e81ef95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:36.381293 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43937fb3-1147-41f5-aae9-af0d6e81ef95 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:36.393093 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 603/1211] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:46:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:36.398820 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f38d3-2a40-4eb8-b857-9ad50b777b90 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:36.495006 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f38d3-2a40-4eb8-b857-9ad50b777b90 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:36.526728 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c82a01-5c28-4627-a875-2a3026888967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:36.527549 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c82a01-5c28-4627-a875-2a3026888967 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:36.527831 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c82a01-5c28-4627-a875-2a3026888967 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:36.528107 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c82a01-5c28-4627-a875-2a3026888967 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:36.535313 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c82a01-5c28-4627-a875-2a3026888967 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:36.536774 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c82a01-5c28-4627-a875-2a3026888967 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:36.550812 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-f4c82a01-5c28-4627-a875-2a3026888967 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 23:46:36.552007 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 609/1212] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:46:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:36.558438 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43937fb3-1147-41f5-aae9-af0d6e81ef95 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:36.651897 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43937fb3-1147-41f5-aae9-af0d6e81ef95 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:36.684873 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7150c-c5cc-40e7-9bc7-91c22b087910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:36.685525 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7150c-c5cc-40e7-9bc7-91c22b087910 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:36.685802 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7150c-c5cc-40e7-9bc7-91c22b087910 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:36.686072 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7150c-c5cc-40e7-9bc7-91c22b087910 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:36.686918 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7150c-c5cc-40e7-9bc7-91c22b087910 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:36.687221 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7150c-c5cc-40e7-9bc7-91c22b087910 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:36.688623 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7150c-c5cc-40e7-9bc7-91c22b087910 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:36.704540 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 604/1213] 10.222.0.24 () {56 vars in 1143 bytes} [Mon Apr 11 23:46:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:36.710197 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c82a01-5c28-4627-a875-2a3026888967 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:36.808958 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c82a01-5c28-4627-a875-2a3026888967 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:36.839923 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26fcae-f3a7-4c1e-a182-1ce0ef403f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:36.840563 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26fcae-f3a7-4c1e-a182-1ce0ef403f9a None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:36.840846 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26fcae-f3a7-4c1e-a182-1ce0ef403f9a None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:36.841121 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26fcae-f3a7-4c1e-a182-1ce0ef403f9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:36.905702 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26fcae-f3a7-4c1e-a182-1ce0ef403f9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:36.907160 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26fcae-f3a7-4c1e-a182-1ce0ef403f9a None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:36.999662 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 610/1214] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:46:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 23:46:37.005631 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7150c-c5cc-40e7-9bc7-91c22b087910 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:37.099580 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7150c-c5cc-40e7-9bc7-91c22b087910 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:37.131448 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b052666-cd93-4c63-804f-ce876f9f9b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:37.132222 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b052666-cd93-4c63-804f-ce876f9f9b38 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:37.132496 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b052666-cd93-4c63-804f-ce876f9f9b38 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:37.132764 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b052666-cd93-4c63-804f-ce876f9f9b38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:37.142223 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b052666-cd93-4c63-804f-ce876f9f9b38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:37.143677 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b052666-cd93-4c63-804f-ce876f9f9b38 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:37.160216 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-3b052666-cd93-4c63-804f-ce876f9f9b38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:46:37.161359 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 605/1215] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:46:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:37.167642 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26fcae-f3a7-4c1e-a182-1ce0ef403f9a None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:37.261990 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26fcae-f3a7-4c1e-a182-1ce0ef403f9a None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:37.294148 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d9b04-0876-4371-9045-b6c1bc6ed309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:37.294791 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d9b04-0876-4371-9045-b6c1bc6ed309 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:37.295103 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d9b04-0876-4371-9045-b6c1bc6ed309 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:37.295372 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d9b04-0876-4371-9045-b6c1bc6ed309 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:37.296082 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d9b04-0876-4371-9045-b6c1bc6ed309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:37.296380 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d9b04-0876-4371-9045-b6c1bc6ed309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:37.297722 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d9b04-0876-4371-9045-b6c1bc6ed309 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:37.308792 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 611/1216] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:37.314555 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b052666-cd93-4c63-804f-ce876f9f9b38 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:37.414117 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b052666-cd93-4c63-804f-ce876f9f9b38 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:37.446541 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd5958-3f6b-4276-934d-7c9e9d134905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:37.447332 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd5958-3f6b-4276-934d-7c9e9d134905 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:37.447607 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd5958-3f6b-4276-934d-7c9e9d134905 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:37.447872 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bd5958-3f6b-4276-934d-7c9e9d134905 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:37.454236 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd5958-3f6b-4276-934d-7c9e9d134905 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:37.455677 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bd5958-3f6b-4276-934d-7c9e9d134905 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:37.468716 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-75bd5958-3f6b-4276-934d-7c9e9d134905 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:46:37.469851 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 606/1217] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:46:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:37.475923 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d9b04-0876-4371-9045-b6c1bc6ed309 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:37.570644 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d9b04-0876-4371-9045-b6c1bc6ed309 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:37.603067 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e47a1-3e27-4c0b-bc85-831917de2343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:37.603724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e47a1-3e27-4c0b-bc85-831917de2343 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:37.603998 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e47a1-3e27-4c0b-bc85-831917de2343 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:37.604266 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e47a1-3e27-4c0b-bc85-831917de2343 None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:37.605043 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e47a1-3e27-4c0b-bc85-831917de2343 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:37.605348 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e47a1-3e27-4c0b-bc85-831917de2343 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:37.606764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028e47a1-3e27-4c0b-bc85-831917de2343 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:37.618708 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 612/1218] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:46:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:37.624870 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd5958-3f6b-4276-934d-7c9e9d134905 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:37.718278 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bd5958-3f6b-4276-934d-7c9e9d134905 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:37.749790 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88329f9e-a993-4e6b-8649-f2bd5c7a5d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:37.750423 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88329f9e-a993-4e6b-8649-f2bd5c7a5d3c None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:37.750697 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88329f9e-a993-4e6b-8649-f2bd5c7a5d3c None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:37.750992 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88329f9e-a993-4e6b-8649-f2bd5c7a5d3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:37.751816 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88329f9e-a993-4e6b-8649-f2bd5c7a5d3c None admin] RBAC: Adding query filter params (role.id=f4692fa2043d468fae733095d5740686, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=47515442e0e84441bed4bfbb7a3b4ff9) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:37.752140 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88329f9e-a993-4e6b-8649-f2bd5c7a5d3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:37.753561 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88329f9e-a993-4e6b-8649-f2bd5c7a5d3c None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:37.758894 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 607/1219] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:46:37 2022] GET /identity/v3/role_assignments?user.id=47515442e0e84441bed4bfbb7a3b4ff9&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=f4692fa2043d468fae733095d5740686 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:39.999123 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb5dd5-eca7-4a5e-a30a-566c03557865 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:39.999746 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb5dd5-eca7-4a5e-a30a-566c03557865 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:39.999746 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb5dd5-eca7-4a5e-a30a-566c03557865 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:40.001444 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 613/1220] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:46:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:46:40.006590 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32258bb7-8c2b-4312-a68b-dfba63946c65 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:40.007044 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32258bb7-8c2b-4312-a68b-dfba63946c65 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:40.007146 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32258bb7-8c2b-4312-a68b-dfba63946c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:40.024534 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-32258bb7-8c2b-4312-a68b-dfba63946c65 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:46:40.025657 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-32258bb7-8c2b-4312-a68b-dfba63946c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:46:40.088265 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 608/1221] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:46:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:46:40.111150 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb5dd5-eca7-4a5e-a30a-566c03557865 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:40.206908 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb5dd5-eca7-4a5e-a30a-566c03557865 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:40.238080 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de593a87-8e9f-4b94-9ee4-eb6089965f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:40.238872 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de593a87-8e9f-4b94-9ee4-eb6089965f43 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:40.239152 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de593a87-8e9f-4b94-9ee4-eb6089965f43 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:40.239419 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de593a87-8e9f-4b94-9ee4-eb6089965f43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:40.249649 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de593a87-8e9f-4b94-9ee4-eb6089965f43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:46:40.256646 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-de593a87-8e9f-4b94-9ee4-eb6089965f43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 23:46:40.257796 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 614/1222] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:46:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:40.264379 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32258bb7-8c2b-4312-a68b-dfba63946c65 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:40.358159 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32258bb7-8c2b-4312-a68b-dfba63946c65 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:40.390627 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561f221-4187-4016-8c8c-bab7fda6a3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:40.391311 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561f221-4187-4016-8c8c-bab7fda6a3f8 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:40.391588 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561f221-4187-4016-8c8c-bab7fda6a3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:40.391858 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c561f221-4187-4016-8c8c-bab7fda6a3f8 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:40.392596 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561f221-4187-4016-8c8c-bab7fda6a3f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:40.392931 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561f221-4187-4016-8c8c-bab7fda6a3f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:40.394278 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c561f221-4187-4016-8c8c-bab7fda6a3f8 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:40.401730 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 609/1223] 10.222.0.24 () {56 vars in 1103 bytes} [Mon Apr 11 23:46:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:40.407450 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de593a87-8e9f-4b94-9ee4-eb6089965f43 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:40.503128 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de593a87-8e9f-4b94-9ee4-eb6089965f43 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:40.534216 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85c687-d13b-4260-bc3c-f849abf6f409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:40.535069 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85c687-d13b-4260-bc3c-f849abf6f409 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:40.535348 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85c687-d13b-4260-bc3c-f849abf6f409 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:40.535618 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85c687-d13b-4260-bc3c-f849abf6f409 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:40.546244 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85c687-d13b-4260-bc3c-f849abf6f409 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:40.547704 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd85c687-d13b-4260-bc3c-f849abf6f409 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:40.563943 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-bd85c687-d13b-4260-bc3c-f849abf6f409 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:46:40.565087 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 615/1224] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:46:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:40.570812 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561f221-4187-4016-8c8c-bab7fda6a3f8 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:40.665191 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c561f221-4187-4016-8c8c-bab7fda6a3f8 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:40.695848 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f94832-3cb0-4a25-8619-711244e52038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:40.696489 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f94832-3cb0-4a25-8619-711244e52038 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:40.696758 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f94832-3cb0-4a25-8619-711244e52038 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:40.697022 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f94832-3cb0-4a25-8619-711244e52038 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:40.697726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f94832-3cb0-4a25-8619-711244e52038 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:40.698023 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f94832-3cb0-4a25-8619-711244e52038 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:40.699390 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f94832-3cb0-4a25-8619-711244e52038 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:40.710423 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 610/1225] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:46:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:40.716895 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85c687-d13b-4260-bc3c-f849abf6f409 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:40.822511 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd85c687-d13b-4260-bc3c-f849abf6f409 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:40.855208 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2990aa-d29b-4b26-a808-d797a7d022c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:40.856066 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2990aa-d29b-4b26-a808-d797a7d022c1 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:40.856341 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2990aa-d29b-4b26-a808-d797a7d022c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:40.856604 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2990aa-d29b-4b26-a808-d797a7d022c1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:40.863943 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2990aa-d29b-4b26-a808-d797a7d022c1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:40.865366 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2990aa-d29b-4b26-a808-d797a7d022c1 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:40.878452 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-2b2990aa-d29b-4b26-a808-d797a7d022c1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 23:46:40.879630 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 616/1226] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:46:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:40.885400 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f94832-3cb0-4a25-8619-711244e52038 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:40.980306 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f94832-3cb0-4a25-8619-711244e52038 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:41.012538 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf38cb-433e-4d81-b21d-951d1d0a11a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:41.013194 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf38cb-433e-4d81-b21d-951d1d0a11a8 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:41.013471 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf38cb-433e-4d81-b21d-951d1d0a11a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:41.013742 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daf38cb-433e-4d81-b21d-951d1d0a11a8 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:41.014567 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf38cb-433e-4d81-b21d-951d1d0a11a8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:41.014894 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf38cb-433e-4d81-b21d-951d1d0a11a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:41.016319 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daf38cb-433e-4d81-b21d-951d1d0a11a8 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:41.032961 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 611/1227] 10.222.0.24 () {56 vars in 1143 bytes} [Mon Apr 11 23:46:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:41.038610 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2990aa-d29b-4b26-a808-d797a7d022c1 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:41.133226 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2990aa-d29b-4b26-a808-d797a7d022c1 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:41.163868 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec7e56-3344-4fd5-8b92-4a1a571904d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:41.165185 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec7e56-3344-4fd5-8b92-4a1a571904d2 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:41.165449 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec7e56-3344-4fd5-8b92-4a1a571904d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:41.165709 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec7e56-3344-4fd5-8b92-4a1a571904d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:41.175691 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec7e56-3344-4fd5-8b92-4a1a571904d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:41.177191 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec7e56-3344-4fd5-8b92-4a1a571904d2 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:41.193253 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-45ec7e56-3344-4fd5-8b92-4a1a571904d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:46:41.194378 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 617/1228] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:46:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:41.200265 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf38cb-433e-4d81-b21d-951d1d0a11a8 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:41.294021 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daf38cb-433e-4d81-b21d-951d1d0a11a8 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:41.327006 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03535a33-062c-49b3-8185-787e8132a9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:41.327656 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03535a33-062c-49b3-8185-787e8132a9d2 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:41.327932 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03535a33-062c-49b3-8185-787e8132a9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:41.328197 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03535a33-062c-49b3-8185-787e8132a9d2 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:41.328902 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03535a33-062c-49b3-8185-787e8132a9d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:41.329206 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03535a33-062c-49b3-8185-787e8132a9d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:41.330559 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03535a33-062c-49b3-8185-787e8132a9d2 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:41.341286 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 612/1229] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:41.347121 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec7e56-3344-4fd5-8b92-4a1a571904d2 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:41.442760 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec7e56-3344-4fd5-8b92-4a1a571904d2 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:41.475190 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaba4e-64d6-4338-bb4f-c982c532c46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:41.475962 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaba4e-64d6-4338-bb4f-c982c532c46e None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:41.476240 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaba4e-64d6-4338-bb4f-c982c532c46e None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:41.476507 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aaba4e-64d6-4338-bb4f-c982c532c46e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:41.483538 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aaba4e-64d6-4338-bb4f-c982c532c46e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:41.484994 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aaba4e-64d6-4338-bb4f-c982c532c46e None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:41.498297 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-23aaba4e-64d6-4338-bb4f-c982c532c46e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:46:41.499522 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 618/1230] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:46:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:41.505268 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03535a33-062c-49b3-8185-787e8132a9d2 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:41.603199 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03535a33-062c-49b3-8185-787e8132a9d2 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:41.635091 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9495de5-7ede-4340-8452-9fe2d969b70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:41.635739 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9495de5-7ede-4340-8452-9fe2d969b70a None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:41.636014 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9495de5-7ede-4340-8452-9fe2d969b70a None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:41.636284 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9495de5-7ede-4340-8452-9fe2d969b70a None admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:41.637059 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9495de5-7ede-4340-8452-9fe2d969b70a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:41.637380 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9495de5-7ede-4340-8452-9fe2d969b70a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:41.638794 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9495de5-7ede-4340-8452-9fe2d969b70a None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:41.650121 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 613/1231] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:46:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:41.655968 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaba4e-64d6-4338-bb4f-c982c532c46e None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:41.751100 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aaba4e-64d6-4338-bb4f-c982c532c46e None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:41.784479 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78b572-6129-419e-97c2-5fa668d973cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:41.785349 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78b572-6129-419e-97c2-5fa668d973cb None admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:41.785623 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78b572-6129-419e-97c2-5fa668d973cb None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:41.785885 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78b572-6129-419e-97c2-5fa668d973cb None admin] PATH_INFO: `/v3/projects/3563c87e56124c688a8029b4088cb198/users/47515442e0e84441bed4bfbb7a3b4ff9/roles/f4692fa2043d468fae733095d5740686` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:41.799532 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78b572-6129-419e-97c2-5fa668d973cb None admin] RBAC: Authorizing `identity:create_grant(project_id=3563c87e56124c688a8029b4088cb198, user_id=47515442e0e84441bed4bfbb7a3b4ff9, role_id=f4692fa2043d468fae733095d5740686)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:41.800961 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b78b572-6129-419e-97c2-5fa668d973cb None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:41.914986 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 619/1232] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:46:41 2022] PUT /identity/v3/projects/3563c87e56124c688a8029b4088cb198/users/47515442e0e84441bed4bfbb7a3b4ff9/roles/f4692fa2043d468fae733095d5740686 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:46:44.147220 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba4769-7a14-4f19-869d-f1e52edea46d None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:44.147764 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba4769-7a14-4f19-869d-f1e52edea46d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:44.147875 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba4769-7a14-4f19-869d-f1e52edea46d None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:44.150148 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 614/1233] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:46:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:46:44.155632 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec826ef-399e-4d85-96c2-6457011a6a3c None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:44.156052 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec826ef-399e-4d85-96c2-6457011a6a3c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:44.156213 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec826ef-399e-4d85-96c2-6457011a6a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:44.172178 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-3ec826ef-399e-4d85-96c2-6457011a6a3c None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:46:44.173358 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-3ec826ef-399e-4d85-96c2-6457011a6a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:46:44.243261 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 620/1234] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:46:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:46:44.266604 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba4769-7a14-4f19-869d-f1e52edea46d None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:44.362923 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba4769-7a14-4f19-869d-f1e52edea46d None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:44.395307 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d2082-935e-4f54-88a6-d5dfb6d833b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:44.396068 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d2082-935e-4f54-88a6-d5dfb6d833b8 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:44.396342 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d2082-935e-4f54-88a6-d5dfb6d833b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:44.396609 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6d2082-935e-4f54-88a6-d5dfb6d833b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:44.408114 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6d2082-935e-4f54-88a6-d5dfb6d833b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:46:44.413469 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-3f6d2082-935e-4f54-88a6-d5dfb6d833b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Apr 11 23:46:44.415229 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 615/1235] 10.222.0.24 () {56 vars in 1102 bytes} [Mon Apr 11 23:46:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:44.421257 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec826ef-399e-4d85-96c2-6457011a6a3c None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:44.515067 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec826ef-399e-4d85-96c2-6457011a6a3c None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:44.547660 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61225040-8438-426a-8d2a-ec46fdabba37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:44.548327 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61225040-8438-426a-8d2a-ec46fdabba37 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:44.548605 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61225040-8438-426a-8d2a-ec46fdabba37 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:44.548876 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61225040-8438-426a-8d2a-ec46fdabba37 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:44.549634 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61225040-8438-426a-8d2a-ec46fdabba37 None admin] RBAC: Adding query filter params (name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:44.549919 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61225040-8438-426a-8d2a-ec46fdabba37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:44.551308 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61225040-8438-426a-8d2a-ec46fdabba37 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:44.559549 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 621/1236] 10.222.0.24 () {56 vars in 1103 bytes} [Mon Apr 11 23:46:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:44.565655 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d2082-935e-4f54-88a6-d5dfb6d833b8 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:44.660930 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6d2082-935e-4f54-88a6-d5dfb6d833b8 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:44.694187 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08f85b-50fd-496a-a98b-c49e6632d628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:44.694994 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08f85b-50fd-496a-a98b-c49e6632d628 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:44.695272 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08f85b-50fd-496a-a98b-c49e6632d628 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:44.695602 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08f85b-50fd-496a-a98b-c49e6632d628 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:44.705567 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08f85b-50fd-496a-a98b-c49e6632d628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:44.707019 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d08f85b-50fd-496a-a98b-c49e6632d628 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:44.723388 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-0d08f85b-50fd-496a-a98b-c49e6632d628 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:46:44.724523 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 616/1237] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:44.730797 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61225040-8438-426a-8d2a-ec46fdabba37 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:44.834626 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61225040-8438-426a-8d2a-ec46fdabba37 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:44.866797 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cdb2e-e966-4f09-b140-39d3646e31e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:44.867553 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cdb2e-e966-4f09-b140-39d3646e31e3 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:44.867834 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cdb2e-e966-4f09-b140-39d3646e31e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:44.868108 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703cdb2e-e966-4f09-b140-39d3646e31e3 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:44.868817 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cdb2e-e966-4f09-b140-39d3646e31e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:44.869116 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cdb2e-e966-4f09-b140-39d3646e31e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:44.870467 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703cdb2e-e966-4f09-b140-39d3646e31e3 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:44.881099 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 622/1238] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:44.887339 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08f85b-50fd-496a-a98b-c49e6632d628 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:44.981164 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08f85b-50fd-496a-a98b-c49e6632d628 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:45.012756 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728aff1-de91-4841-b229-993f998ee358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:45.013537 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728aff1-de91-4841-b229-993f998ee358 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:45.013814 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728aff1-de91-4841-b229-993f998ee358 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:45.014082 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728aff1-de91-4841-b229-993f998ee358 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:45.021314 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728aff1-de91-4841-b229-993f998ee358 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:45.022725 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728aff1-de91-4841-b229-993f998ee358 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:45.036492 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-c728aff1-de91-4841-b229-993f998ee358 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 23:46:45.037629 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 617/1239] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:46:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:45.043542 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cdb2e-e966-4f09-b140-39d3646e31e3 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:45.138775 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703cdb2e-e966-4f09-b140-39d3646e31e3 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:45.170796 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e86195-4900-4002-bd58-7c29ba8fdb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:45.171487 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e86195-4900-4002-bd58-7c29ba8fdb35 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:45.171762 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e86195-4900-4002-bd58-7c29ba8fdb35 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:45.172033 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e86195-4900-4002-bd58-7c29ba8fdb35 None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:45.172855 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e86195-4900-4002-bd58-7c29ba8fdb35 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:45.173160 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e86195-4900-4002-bd58-7c29ba8fdb35 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:45.174566 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e86195-4900-4002-bd58-7c29ba8fdb35 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:45.191386 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 623/1240] 10.222.0.24 () {56 vars in 1143 bytes} [Mon Apr 11 23:46:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:45.197620 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728aff1-de91-4841-b229-993f998ee358 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:45.291450 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728aff1-de91-4841-b229-993f998ee358 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:45.323634 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663168fd-4499-4f91-ae57-d1823da0a44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:45.324286 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663168fd-4499-4f91-ae57-d1823da0a44c None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:45.324565 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663168fd-4499-4f91-ae57-d1823da0a44c None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:45.324833 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663168fd-4499-4f91-ae57-d1823da0a44c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:45.387732 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663168fd-4499-4f91-ae57-d1823da0a44c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:45.389160 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663168fd-4499-4f91-ae57-d1823da0a44c None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:45.481015 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 618/1241] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:46:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 23:46:45.486783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e86195-4900-4002-bd58-7c29ba8fdb35 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:45.580493 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e86195-4900-4002-bd58-7c29ba8fdb35 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:45.614122 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaece6b-b391-4b02-abb5-60be70cd9bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:45.614931 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaece6b-b391-4b02-abb5-60be70cd9bfc None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:45.615211 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaece6b-b391-4b02-abb5-60be70cd9bfc None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:45.615479 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaece6b-b391-4b02-abb5-60be70cd9bfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:45.625693 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaece6b-b391-4b02-abb5-60be70cd9bfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:45.630978 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaece6b-b391-4b02-abb5-60be70cd9bfc None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:45.643731 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-3eaece6b-b391-4b02-abb5-60be70cd9bfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:46:45.644895 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 624/1242] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:46:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:45.651508 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663168fd-4499-4f91-ae57-d1823da0a44c None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:45.747676 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663168fd-4499-4f91-ae57-d1823da0a44c None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:45.780446 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71be70b-3a09-476c-af72-3969b891ce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:45.781151 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71be70b-3a09-476c-af72-3969b891ce05 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:45.781471 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71be70b-3a09-476c-af72-3969b891ce05 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:45.781742 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71be70b-3a09-476c-af72-3969b891ce05 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:45.782448 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71be70b-3a09-476c-af72-3969b891ce05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:45.782744 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71be70b-3a09-476c-af72-3969b891ce05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:45.784112 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71be70b-3a09-476c-af72-3969b891ce05 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:45.794848 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 619/1243] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:46:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:45.800578 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaece6b-b391-4b02-abb5-60be70cd9bfc None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:45.902019 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaece6b-b391-4b02-abb5-60be70cd9bfc None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:45.933700 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4459f-f91f-4c70-a154-d57679f8d1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:45.934486 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4459f-f91f-4c70-a154-d57679f8d1c7 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:45.934761 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4459f-f91f-4c70-a154-d57679f8d1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:45.935058 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac4459f-f91f-4c70-a154-d57679f8d1c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:45.941526 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4459f-f91f-4c70-a154-d57679f8d1c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:45.942966 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac4459f-f91f-4c70-a154-d57679f8d1c7 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:45.956175 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-dac4459f-f91f-4c70-a154-d57679f8d1c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:46:45.957320 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 625/1244] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:46:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:45.963711 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71be70b-3a09-476c-af72-3969b891ce05 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:46.056817 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71be70b-3a09-476c-af72-3969b891ce05 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:46.088344 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a06ba4-d978-4dc0-8ef0-da687dff2210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:46.088980 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a06ba4-d978-4dc0-8ef0-da687dff2210 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:46.089256 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a06ba4-d978-4dc0-8ef0-da687dff2210 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:46.089524 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a06ba4-d978-4dc0-8ef0-da687dff2210 None admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:46.090343 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a06ba4-d978-4dc0-8ef0-da687dff2210 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:46.090643 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a06ba4-d978-4dc0-8ef0-da687dff2210 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:46.092343 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a06ba4-d978-4dc0-8ef0-da687dff2210 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:46.104195 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 620/1245] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:46:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:46.110100 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4459f-f91f-4c70-a154-d57679f8d1c7 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:46.204261 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac4459f-f91f-4c70-a154-d57679f8d1c7 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:46.236528 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35084649-6870-408f-b087-383b6fb9309f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:46.237173 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35084649-6870-408f-b087-383b6fb9309f None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:46.237451 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35084649-6870-408f-b087-383b6fb9309f None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:46.237728 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35084649-6870-408f-b087-383b6fb9309f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:46.238551 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35084649-6870-408f-b087-383b6fb9309f None admin] RBAC: Adding query filter params (role.id=f4692fa2043d468fae733095d5740686, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=47515442e0e84441bed4bfbb7a3b4ff9) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:46.238877 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35084649-6870-408f-b087-383b6fb9309f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:46.240291 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35084649-6870-408f-b087-383b6fb9309f None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:46.245860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 626/1246] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:46:46 2022] GET /identity/v3/role_assignments?user.id=47515442e0e84441bed4bfbb7a3b4ff9&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=f4692fa2043d468fae733095d5740686 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:46:48.571187 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab60a7-8c48-4539-99c4-abe10e9233d2 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:48.571721 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab60a7-8c48-4539-99c4-abe10e9233d2 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:48.571721 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab60a7-8c48-4539-99c4-abe10e9233d2 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:48.573514 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 621/1247] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:46:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:46:48.579296 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d286d-f88f-4117-af90-19e6b7f5ce0f None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:48.579737 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d286d-f88f-4117-af90-19e6b7f5ce0f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:48.579836 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d286d-f88f-4117-af90-19e6b7f5ce0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:48.596525 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-789d286d-f88f-4117-af90-19e6b7f5ce0f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:46:48.597697 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-789d286d-f88f-4117-af90-19e6b7f5ce0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:46:48.660829 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 627/1248] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:46:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:46:48.684977 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab60a7-8c48-4539-99c4-abe10e9233d2 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:48.781870 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab60a7-8c48-4539-99c4-abe10e9233d2 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:48.814718 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296115c-4586-4802-916c-e9a8d29a19dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:48.815524 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296115c-4586-4802-916c-e9a8d29a19dd None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:48.815830 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296115c-4586-4802-916c-e9a8d29a19dd None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:48.816098 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d296115c-4586-4802-916c-e9a8d29a19dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:48.831699 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d296115c-4586-4802-916c-e9a8d29a19dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:46:48.841202 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-d296115c-4586-4802-916c-e9a8d29a19dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:46:48.842878 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 622/1249] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:46:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:48.848880 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d286d-f88f-4117-af90-19e6b7f5ce0f None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:48.944231 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d286d-f88f-4117-af90-19e6b7f5ce0f None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:48.976464 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bdb95-0f23-43f9-b10e-6d1d45b9cf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:48.977733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bdb95-0f23-43f9-b10e-6d1d45b9cf52 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:48.978008 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bdb95-0f23-43f9-b10e-6d1d45b9cf52 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:48.978275 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5bdb95-0f23-43f9-b10e-6d1d45b9cf52 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:48.979040 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bdb95-0f23-43f9-b10e-6d1d45b9cf52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:48.979339 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bdb95-0f23-43f9-b10e-6d1d45b9cf52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:48.980677 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5bdb95-0f23-43f9-b10e-6d1d45b9cf52 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:48.988306 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 628/1250] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:46:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:48.994016 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296115c-4586-4802-916c-e9a8d29a19dd None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:49.088137 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d296115c-4586-4802-916c-e9a8d29a19dd None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:49.120757 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e17be-34f5-4506-aec3-0f952d380a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:49.121537 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e17be-34f5-4506-aec3-0f952d380a9e None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:49.121819 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e17be-34f5-4506-aec3-0f952d380a9e None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:49.122094 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e17be-34f5-4506-aec3-0f952d380a9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:49.132314 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e17be-34f5-4506-aec3-0f952d380a9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:49.133766 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e17be-34f5-4506-aec3-0f952d380a9e None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:49.150505 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-1a1e17be-34f5-4506-aec3-0f952d380a9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:46:49.151732 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 623/1251] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:46:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:49.157406 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bdb95-0f23-43f9-b10e-6d1d45b9cf52 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:49.258734 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5bdb95-0f23-43f9-b10e-6d1d45b9cf52 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:49.291232 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca7363-1799-48db-8b5a-b5061d63871b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:49.291888 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca7363-1799-48db-8b5a-b5061d63871b None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:49.292227 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca7363-1799-48db-8b5a-b5061d63871b None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:49.292502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ca7363-1799-48db-8b5a-b5061d63871b None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:49.293213 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca7363-1799-48db-8b5a-b5061d63871b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:49.293517 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca7363-1799-48db-8b5a-b5061d63871b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:49.294887 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ca7363-1799-48db-8b5a-b5061d63871b None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:49.306224 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 629/1252] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:46:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:49.311944 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e17be-34f5-4506-aec3-0f952d380a9e None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:49.407254 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e17be-34f5-4506-aec3-0f952d380a9e None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:49.439096 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca069826-9449-4e90-ba64-b031bba167a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:49.439885 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca069826-9449-4e90-ba64-b031bba167a7 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:49.440160 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca069826-9449-4e90-ba64-b031bba167a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:49.440428 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca069826-9449-4e90-ba64-b031bba167a7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:49.448246 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca069826-9449-4e90-ba64-b031bba167a7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:49.449691 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca069826-9449-4e90-ba64-b031bba167a7 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:49.463248 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-ca069826-9449-4e90-ba64-b031bba167a7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 23:46:49.464393 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 624/1253] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:46:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:49.470425 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca7363-1799-48db-8b5a-b5061d63871b None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:49.572362 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ca7363-1799-48db-8b5a-b5061d63871b None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:49.606883 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbacbf-e6e8-4ef0-90ad-86f7ed15f42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:49.607537 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbacbf-e6e8-4ef0-90ad-86f7ed15f42e None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:49.607806 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbacbf-e6e8-4ef0-90ad-86f7ed15f42e None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:49.608071 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cbacbf-e6e8-4ef0-90ad-86f7ed15f42e None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:49.608887 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbacbf-e6e8-4ef0-90ad-86f7ed15f42e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:49.609187 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbacbf-e6e8-4ef0-90ad-86f7ed15f42e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:49.610795 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cbacbf-e6e8-4ef0-90ad-86f7ed15f42e None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:49.627524 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 630/1254] 10.222.0.24 () {56 vars in 1143 bytes} [Mon Apr 11 23:46:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:49.634016 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca069826-9449-4e90-ba64-b031bba167a7 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:49.728289 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca069826-9449-4e90-ba64-b031bba167a7 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:49.760948 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab4974-e127-4ca5-bbe5-26d80f998bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:49.761637 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab4974-e127-4ca5-bbe5-26d80f998bd5 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:49.761907 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab4974-e127-4ca5-bbe5-26d80f998bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:49.762175 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab4974-e127-4ca5-bbe5-26d80f998bd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:49.826774 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab4974-e127-4ca5-bbe5-26d80f998bd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:49.828325 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ab4974-e127-4ca5-bbe5-26d80f998bd5 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:49.921447 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 625/1255] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:46:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Apr 11 23:46:49.927441 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbacbf-e6e8-4ef0-90ad-86f7ed15f42e None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:50.024858 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cbacbf-e6e8-4ef0-90ad-86f7ed15f42e None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:50.057614 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ee28c-d07d-425c-be5a-3182010da7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:50.058392 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ee28c-d07d-425c-be5a-3182010da7d6 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:50.058666 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ee28c-d07d-425c-be5a-3182010da7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:50.058960 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ee28c-d07d-425c-be5a-3182010da7d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:50.068568 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ee28c-d07d-425c-be5a-3182010da7d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:50.069997 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ee28c-d07d-425c-be5a-3182010da7d6 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:50.087409 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-921ee28c-d07d-425c-be5a-3182010da7d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:46:50.088557 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 631/1256] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:46:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:50.094481 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab4974-e127-4ca5-bbe5-26d80f998bd5 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:50.188478 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab4974-e127-4ca5-bbe5-26d80f998bd5 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:50.220401 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65352515-b28c-4628-b9f9-fb99841ffa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:50.221051 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65352515-b28c-4628-b9f9-fb99841ffa53 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:50.221329 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65352515-b28c-4628-b9f9-fb99841ffa53 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:50.221726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65352515-b28c-4628-b9f9-fb99841ffa53 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:50.222475 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65352515-b28c-4628-b9f9-fb99841ffa53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:50.222781 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65352515-b28c-4628-b9f9-fb99841ffa53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:50.224182 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65352515-b28c-4628-b9f9-fb99841ffa53 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:50.236346 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 626/1257] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:46:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:50.242012 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ee28c-d07d-425c-be5a-3182010da7d6 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:50.335157 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ee28c-d07d-425c-be5a-3182010da7d6 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:50.367262 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186750e6-5027-48d1-a26a-537c65b29661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:50.368669 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186750e6-5027-48d1-a26a-537c65b29661 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:50.368944 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186750e6-5027-48d1-a26a-537c65b29661 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:50.369214 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186750e6-5027-48d1-a26a-537c65b29661 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:50.375568 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186750e6-5027-48d1-a26a-537c65b29661 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:50.377015 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186750e6-5027-48d1-a26a-537c65b29661 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:50.389666 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-186750e6-5027-48d1-a26a-537c65b29661 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:46:50.390813 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 632/1258] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:46:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:50.396830 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65352515-b28c-4628-b9f9-fb99841ffa53 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:50.492627 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65352515-b28c-4628-b9f9-fb99841ffa53 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:50.524677 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef90794-3746-4680-b39c-5b03c6b1fe92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:50.525317 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef90794-3746-4680-b39c-5b03c6b1fe92 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:50.525596 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef90794-3746-4680-b39c-5b03c6b1fe92 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:50.525867 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef90794-3746-4680-b39c-5b03c6b1fe92 None admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:50.526643 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef90794-3746-4680-b39c-5b03c6b1fe92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:50.526983 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef90794-3746-4680-b39c-5b03c6b1fe92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:50.528399 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef90794-3746-4680-b39c-5b03c6b1fe92 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:50.540687 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 627/1259] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:46:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:50.546645 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186750e6-5027-48d1-a26a-537c65b29661 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:50.644102 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186750e6-5027-48d1-a26a-537c65b29661 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:50.675620 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3261ba7-b934-440a-8e4b-be8c6f5ee44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:50.676259 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3261ba7-b934-440a-8e4b-be8c6f5ee44e None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:50.676533 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3261ba7-b934-440a-8e4b-be8c6f5ee44e None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:50.676800 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3261ba7-b934-440a-8e4b-be8c6f5ee44e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:50.677618 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3261ba7-b934-440a-8e4b-be8c6f5ee44e None admin] RBAC: Adding query filter params (role.id=c8affbefb4c5462a921650b24b13c80f, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=47515442e0e84441bed4bfbb7a3b4ff9) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:50.677923 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3261ba7-b934-440a-8e4b-be8c6f5ee44e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:50.679408 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3261ba7-b934-440a-8e4b-be8c6f5ee44e None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:50.685201 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 633/1260] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:46:50 2022] GET /identity/v3/role_assignments?user.id=47515442e0e84441bed4bfbb7a3b4ff9&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=c8affbefb4c5462a921650b24b13c80f => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:52.985844 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b8669-8c0a-4c8f-b10e-4f1bd3a7e5a8 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:52.986393 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b8669-8c0a-4c8f-b10e-4f1bd3a7e5a8 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:52.986393 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b8669-8c0a-4c8f-b10e-4f1bd3a7e5a8 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:52.988320 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 628/1261] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:46:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:46:52.993896 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcc929-5142-4ac2-9a59-bafe3b976db9 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:52.994323 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcc929-5142-4ac2-9a59-bafe3b976db9 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:52.994494 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fcc929-5142-4ac2-9a59-bafe3b976db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:53.011592 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-50fcc929-5142-4ac2-9a59-bafe3b976db9 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:46:53.012759 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-50fcc929-5142-4ac2-9a59-bafe3b976db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:46:53.077508 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 634/1262] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:46:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:46:53.100809 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b8669-8c0a-4c8f-b10e-4f1bd3a7e5a8 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:53.197992 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b8669-8c0a-4c8f-b10e-4f1bd3a7e5a8 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:53.229977 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bf9c2-a643-4c21-b09b-3744fe5d221b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:53.230745 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bf9c2-a643-4c21-b09b-3744fe5d221b None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:53.231045 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bf9c2-a643-4c21-b09b-3744fe5d221b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:53.231309 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223bf9c2-a643-4c21-b09b-3744fe5d221b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:53.240904 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223bf9c2-a643-4c21-b09b-3744fe5d221b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:46:53.247797 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-223bf9c2-a643-4c21-b09b-3744fe5d221b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:46:53.250449 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 629/1263] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:46:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:53.255075 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcc929-5142-4ac2-9a59-bafe3b976db9 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:53.348227 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fcc929-5142-4ac2-9a59-bafe3b976db9 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:53.381458 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd14715-0223-4c5b-904a-6594587f0a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:53.382110 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd14715-0223-4c5b-904a-6594587f0a76 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:53.382389 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd14715-0223-4c5b-904a-6594587f0a76 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:53.382657 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd14715-0223-4c5b-904a-6594587f0a76 None admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:53.383460 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd14715-0223-4c5b-904a-6594587f0a76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:53.383768 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd14715-0223-4c5b-904a-6594587f0a76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:53.385110 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd14715-0223-4c5b-904a-6594587f0a76 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:53.392964 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 635/1264] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:46:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:53.399242 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bf9c2-a643-4c21-b09b-3744fe5d221b None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:53.492576 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223bf9c2-a643-4c21-b09b-3744fe5d221b None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:53.524707 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e801e-a8d1-4169-900e-879db36af023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:53.525487 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e801e-a8d1-4169-900e-879db36af023 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:53.525766 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e801e-a8d1-4169-900e-879db36af023 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:53.526034 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e801e-a8d1-4169-900e-879db36af023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:53.536001 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e801e-a8d1-4169-900e-879db36af023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:53.537412 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0e801e-a8d1-4169-900e-879db36af023 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:53.553707 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-4c0e801e-a8d1-4169-900e-879db36af023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:46:53.554900 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 630/1265] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:46:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:46:53.560715 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd14715-0223-4c5b-904a-6594587f0a76 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:53.655731 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd14715-0223-4c5b-904a-6594587f0a76 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:53.688344 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c389c66-7688-4360-8619-daafa9054f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:53.688997 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c389c66-7688-4360-8619-daafa9054f71 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:53.689274 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c389c66-7688-4360-8619-daafa9054f71 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:53.689543 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c389c66-7688-4360-8619-daafa9054f71 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:53.690265 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c389c66-7688-4360-8619-daafa9054f71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:53.690561 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c389c66-7688-4360-8619-daafa9054f71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:53.691941 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c389c66-7688-4360-8619-daafa9054f71 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:53.703748 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 636/1266] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:46:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:53.709636 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e801e-a8d1-4169-900e-879db36af023 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:53.806689 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e801e-a8d1-4169-900e-879db36af023 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:53.837321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27161267-8cd1-471a-8ccf-4b714419ec87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:53.838099 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27161267-8cd1-471a-8ccf-4b714419ec87 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:53.838371 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27161267-8cd1-471a-8ccf-4b714419ec87 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:53.838635 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27161267-8cd1-471a-8ccf-4b714419ec87 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:53.845964 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27161267-8cd1-471a-8ccf-4b714419ec87 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:53.847423 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27161267-8cd1-471a-8ccf-4b714419ec87 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:53.860918 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-27161267-8cd1-471a-8ccf-4b714419ec87 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 23:46:53.862062 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 631/1267] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:46:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:53.868596 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c389c66-7688-4360-8619-daafa9054f71 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:53.963637 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c389c66-7688-4360-8619-daafa9054f71 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:53.996945 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733addd9-6949-4100-a01e-10f195802c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:53.997599 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733addd9-6949-4100-a01e-10f195802c08 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:53.997871 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733addd9-6949-4100-a01e-10f195802c08 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:53.998137 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733addd9-6949-4100-a01e-10f195802c08 None admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:53.999018 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733addd9-6949-4100-a01e-10f195802c08 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:53.999322 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733addd9-6949-4100-a01e-10f195802c08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:54.000720 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733addd9-6949-4100-a01e-10f195802c08 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:54.017811 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 637/1268] 10.222.0.24 () {56 vars in 1143 bytes} [Mon Apr 11 23:46:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:54.023476 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27161267-8cd1-471a-8ccf-4b714419ec87 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:54.119761 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27161267-8cd1-471a-8ccf-4b714419ec87 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:54.151303 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf96e05-67db-46ec-b4a6-d8dded3d866e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:54.152135 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf96e05-67db-46ec-b4a6-d8dded3d866e None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:54.152418 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf96e05-67db-46ec-b4a6-d8dded3d866e None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:54.152692 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf96e05-67db-46ec-b4a6-d8dded3d866e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:54.162701 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf96e05-67db-46ec-b4a6-d8dded3d866e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:54.164148 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf96e05-67db-46ec-b4a6-d8dded3d866e None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:54.180661 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-edf96e05-67db-46ec-b4a6-d8dded3d866e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:46:54.181817 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 632/1269] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:46:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:54.187507 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733addd9-6949-4100-a01e-10f195802c08 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:54.283031 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733addd9-6949-4100-a01e-10f195802c08 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:54.315096 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26e711-5c5f-49b8-8b4f-33d21a010a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:54.315738 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26e711-5c5f-49b8-8b4f-33d21a010a37 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:54.316017 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26e711-5c5f-49b8-8b4f-33d21a010a37 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:54.316291 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26e711-5c5f-49b8-8b4f-33d21a010a37 None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:54.317005 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26e711-5c5f-49b8-8b4f-33d21a010a37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:54.317313 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26e711-5c5f-49b8-8b4f-33d21a010a37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:54.318663 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26e711-5c5f-49b8-8b4f-33d21a010a37 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:54.329344 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 638/1270] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:46:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:54.335024 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf96e05-67db-46ec-b4a6-d8dded3d866e None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:54.429655 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf96e05-67db-46ec-b4a6-d8dded3d866e None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:54.460884 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094df49-61c2-4706-a742-c8e70a752bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:54.462170 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094df49-61c2-4706-a742-c8e70a752bd0 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:54.462451 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094df49-61c2-4706-a742-c8e70a752bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:54.462721 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094df49-61c2-4706-a742-c8e70a752bd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:54.469650 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094df49-61c2-4706-a742-c8e70a752bd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:54.471098 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094df49-61c2-4706-a742-c8e70a752bd0 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:54.484787 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-c094df49-61c2-4706-a742-c8e70a752bd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:46:54.485934 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 633/1271] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:46:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:46:54.491715 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26e711-5c5f-49b8-8b4f-33d21a010a37 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:54.587184 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26e711-5c5f-49b8-8b4f-33d21a010a37 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:54.618661 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc56acb-6e4d-4890-932a-f1fd93c4c326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:54.619332 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc56acb-6e4d-4890-932a-f1fd93c4c326 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:54.619607 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc56acb-6e4d-4890-932a-f1fd93c4c326 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:54.619871 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc56acb-6e4d-4890-932a-f1fd93c4c326 None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:54.620639 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc56acb-6e4d-4890-932a-f1fd93c4c326 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:54.620940 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc56acb-6e4d-4890-932a-f1fd93c4c326 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:54.622412 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc56acb-6e4d-4890-932a-f1fd93c4c326 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:54.634317 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 639/1272] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:46:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:54.640339 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094df49-61c2-4706-a742-c8e70a752bd0 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:54.734511 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094df49-61c2-4706-a742-c8e70a752bd0 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:54.767079 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d72569-a1d9-4a80-93dc-8252f7ed45a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:54.767956 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d72569-a1d9-4a80-93dc-8252f7ed45a8 None admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:54.768231 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d72569-a1d9-4a80-93dc-8252f7ed45a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:54.768495 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d72569-a1d9-4a80-93dc-8252f7ed45a8 None admin] PATH_INFO: `/v3/projects/3563c87e56124c688a8029b4088cb198/users/47515442e0e84441bed4bfbb7a3b4ff9/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:54.770424 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d72569-a1d9-4a80-93dc-8252f7ed45a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=3563c87e56124c688a8029b4088cb198, user_id=47515442e0e84441bed4bfbb7a3b4ff9, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:54.771936 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d72569-a1d9-4a80-93dc-8252f7ed45a8 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:54.833816 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 634/1273] 10.222.0.24 () {58 vars in 1439 bytes} [Mon Apr 11 23:46:54 2022] PUT /identity/v3/projects/3563c87e56124c688a8029b4088cb198/users/47515442e0e84441bed4bfbb7a3b4ff9/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:46:57.093072 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf8cbb-cff3-446e-9efd-57f3079eeb77 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:57.093559 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf8cbb-cff3-446e-9efd-57f3079eeb77 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:57.093559 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccf8cbb-cff3-446e-9efd-57f3079eeb77 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:57.095356 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 640/1274] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:46:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:46:57.100435 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b57fd-acfe-4b46-afd8-3267dd0ecbf0 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:57.100859 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b57fd-acfe-4b46-afd8-3267dd0ecbf0 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:57.100998 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b57fd-acfe-4b46-afd8-3267dd0ecbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:57.118584 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-623b57fd-acfe-4b46-afd8-3267dd0ecbf0 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:46:57.120056 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-623b57fd-acfe-4b46-afd8-3267dd0ecbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:46:57.185356 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 635/1275] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:46:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Apr 11 23:46:57.209726 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf8cbb-cff3-446e-9efd-57f3079eeb77 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:57.319992 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccf8cbb-cff3-446e-9efd-57f3079eeb77 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:57.352796 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5fa6f-8011-480e-ab55-e02257454a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:57.353579 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5fa6f-8011-480e-ab55-e02257454a0b None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:57.353851 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5fa6f-8011-480e-ab55-e02257454a0b None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:57.354116 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5fa6f-8011-480e-ab55-e02257454a0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:57.363623 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa5fa6f-8011-480e-ab55-e02257454a0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Apr 11 23:46:57.370497 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-1aa5fa6f-8011-480e-ab55-e02257454a0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Apr 11 23:46:57.371681 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 641/1276] 10.222.0.24 () {56 vars in 1096 bytes} [Mon Apr 11 23:46:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:57.377770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b57fd-acfe-4b46-afd8-3267dd0ecbf0 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:57.470587 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b57fd-acfe-4b46-afd8-3267dd0ecbf0 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:57.502426 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15098fb0-b6bc-4250-8f8c-999090f141f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:57.503094 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15098fb0-b6bc-4250-8f8c-999090f141f8 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:57.503368 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15098fb0-b6bc-4250-8f8c-999090f141f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:57.503633 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15098fb0-b6bc-4250-8f8c-999090f141f8 None admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:57.504367 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15098fb0-b6bc-4250-8f8c-999090f141f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:57.504664 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15098fb0-b6bc-4250-8f8c-999090f141f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:57.506007 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15098fb0-b6bc-4250-8f8c-999090f141f8 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:57.514126 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 636/1277] 10.222.0.24 () {56 vars in 1099 bytes} [Mon Apr 11 23:46:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:57.519748 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5fa6f-8011-480e-ab55-e02257454a0b None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:57.614757 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa5fa6f-8011-480e-ab55-e02257454a0b None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:57.646186 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7249d-0d45-4b48-841b-ba1a9e42a619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:57.646943 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7249d-0d45-4b48-841b-ba1a9e42a619 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:57.647221 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7249d-0d45-4b48-841b-ba1a9e42a619 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:57.647485 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab7249d-0d45-4b48-841b-ba1a9e42a619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:57.657927 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7249d-0d45-4b48-841b-ba1a9e42a619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:57.659366 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab7249d-0d45-4b48-841b-ba1a9e42a619 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:57.675120 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-bab7249d-0d45-4b48-841b-ba1a9e42a619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:46:57.676255 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 642/1278] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:46:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:57.682210 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15098fb0-b6bc-4250-8f8c-999090f141f8 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:57.779110 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15098fb0-b6bc-4250-8f8c-999090f141f8 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:57.811972 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec989fbc-03cf-4e5b-8a75-65ed9fe2f162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:57.812649 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec989fbc-03cf-4e5b-8a75-65ed9fe2f162 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:57.812929 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec989fbc-03cf-4e5b-8a75-65ed9fe2f162 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:57.813200 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec989fbc-03cf-4e5b-8a75-65ed9fe2f162 None admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:57.813917 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec989fbc-03cf-4e5b-8a75-65ed9fe2f162 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:57.814220 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec989fbc-03cf-4e5b-8a75-65ed9fe2f162 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:57.815610 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec989fbc-03cf-4e5b-8a75-65ed9fe2f162 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:57.826763 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 637/1279] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:46:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:57.832377 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7249d-0d45-4b48-841b-ba1a9e42a619 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:57.926908 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab7249d-0d45-4b48-841b-ba1a9e42a619 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:57.958275 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004df72-00b8-4e1f-9d92-c7b64250db5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:57.959106 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004df72-00b8-4e1f-9d92-c7b64250db5d None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:57.959383 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004df72-00b8-4e1f-9d92-c7b64250db5d None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:57.959653 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004df72-00b8-4e1f-9d92-c7b64250db5d None admin] PATH_INFO: `/v3/users/placement` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:57.967572 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004df72-00b8-4e1f-9d92-c7b64250db5d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:57.968986 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004df72-00b8-4e1f-9d92-c7b64250db5d None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:57.982951 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-5004df72-00b8-4e1f-9d92-c7b64250db5d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Apr 11 23:46:57.984087 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 643/1280] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:46:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:57.989759 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec989fbc-03cf-4e5b-8a75-65ed9fe2f162 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:58.084579 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec989fbc-03cf-4e5b-8a75-65ed9fe2f162 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:58.122667 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0828a-8be0-4869-a481-58fa0ad8d617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:58.123402 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0828a-8be0-4869-a481-58fa0ad8d617 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:58.123678 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0828a-8be0-4869-a481-58fa0ad8d617 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:58.123945 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0828a-8be0-4869-a481-58fa0ad8d617 None admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:58.124816 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0828a-8be0-4869-a481-58fa0ad8d617 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:58.125116 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0828a-8be0-4869-a481-58fa0ad8d617 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:58.126512 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff0828a-8be0-4869-a481-58fa0ad8d617 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:58.143532 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 638/1281] 10.222.0.24 () {56 vars in 1143 bytes} [Mon Apr 11 23:46:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:58.149673 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004df72-00b8-4e1f-9d92-c7b64250db5d None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:58.246396 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004df72-00b8-4e1f-9d92-c7b64250db5d None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:58.280518 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba69805-4a68-45aa-b5de-8bb02a236999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:58.281155 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba69805-4a68-45aa-b5de-8bb02a236999 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:58.281430 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba69805-4a68-45aa-b5de-8bb02a236999 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:58.281699 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba69805-4a68-45aa-b5de-8bb02a236999 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:58.347586 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba69805-4a68-45aa-b5de-8bb02a236999 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:58.349007 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba69805-4a68-45aa-b5de-8bb02a236999 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:58.441556 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 644/1282] 10.222.0.24 () {58 vars in 1282 bytes} [Mon Apr 11 23:46:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Apr 11 23:46:58.447429 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0828a-8be0-4869-a481-58fa0ad8d617 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:58.540172 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0828a-8be0-4869-a481-58fa0ad8d617 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:58.572250 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f225a94-6c51-4069-994d-b11d00daf328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:58.573177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f225a94-6c51-4069-994d-b11d00daf328 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:58.573600 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f225a94-6c51-4069-994d-b11d00daf328 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:58.573871 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f225a94-6c51-4069-994d-b11d00daf328 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:58.583805 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f225a94-6c51-4069-994d-b11d00daf328 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:58.585221 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f225a94-6c51-4069-994d-b11d00daf328 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:58.602437 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-3f225a94-6c51-4069-994d-b11d00daf328 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Apr 11 23:46:58.603599 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 639/1283] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:46:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:58.609289 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba69805-4a68-45aa-b5de-8bb02a236999 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:58.702645 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba69805-4a68-45aa-b5de-8bb02a236999 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:58.735303 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d516f90-0abc-447a-b40f-a03bc3ebd1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:58.736227 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d516f90-0abc-447a-b40f-a03bc3ebd1bb None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:58.736227 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d516f90-0abc-447a-b40f-a03bc3ebd1bb None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:58.736476 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d516f90-0abc-447a-b40f-a03bc3ebd1bb None admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:58.737196 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d516f90-0abc-447a-b40f-a03bc3ebd1bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:58.737497 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d516f90-0abc-447a-b40f-a03bc3ebd1bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:58.738861 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d516f90-0abc-447a-b40f-a03bc3ebd1bb None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:58.749563 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 645/1284] 10.222.0.24 () {56 vars in 1109 bytes} [Mon Apr 11 23:46:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:58.755227 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f225a94-6c51-4069-994d-b11d00daf328 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:58.850732 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f225a94-6c51-4069-994d-b11d00daf328 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:58.888456 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbdde9-5cc1-40fd-9d2b-e46ba3bd05e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:58.889233 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbdde9-5cc1-40fd-9d2b-e46ba3bd05e3 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:58.889506 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbdde9-5cc1-40fd-9d2b-e46ba3bd05e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:58.889772 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbdde9-5cc1-40fd-9d2b-e46ba3bd05e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:58.896203 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbdde9-5cc1-40fd-9d2b-e46ba3bd05e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:58.897620 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbdde9-5cc1-40fd-9d2b-e46ba3bd05e3 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:58.910773 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING keystone.server.flask.application [None req-33cbdde9-5cc1-40fd-9d2b-e46ba3bd05e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Apr 11 23:46:58.911942 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 640/1285] 10.222.0.24 () {56 vars in 1111 bytes} [Mon Apr 11 23:46:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:46:58.922347 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d516f90-0abc-447a-b40f-a03bc3ebd1bb None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:59.017504 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d516f90-0abc-447a-b40f-a03bc3ebd1bb None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:59.049778 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f86f3c-4752-4d2b-8bf0-287fd4c22530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:59.050426 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f86f3c-4752-4d2b-8bf0-287fd4c22530 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:59.050706 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f86f3c-4752-4d2b-8bf0-287fd4c22530 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:59.051006 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f86f3c-4752-4d2b-8bf0-287fd4c22530 None admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:59.051782 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f86f3c-4752-4d2b-8bf0-287fd4c22530 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:59.052098 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f86f3c-4752-4d2b-8bf0-287fd4c22530 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:59.053489 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f86f3c-4752-4d2b-8bf0-287fd4c22530 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:59.065175 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 646/1286] 10.222.0.24 () {56 vars in 1148 bytes} [Mon Apr 11 23:46:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:46:59.071659 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbdde9-5cc1-40fd-9d2b-e46ba3bd05e3 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:46:59.168027 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbdde9-5cc1-40fd-9d2b-e46ba3bd05e3 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:46:59.199755 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c10503-294f-4535-a1a6-3af63f22419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:46:59.200397 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c10503-294f-4535-a1a6-3af63f22419b None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:46:59.200673 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c10503-294f-4535-a1a6-3af63f22419b None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:46:59.200940 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c10503-294f-4535-a1a6-3af63f22419b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:46:59.201757 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c10503-294f-4535-a1a6-3af63f22419b None admin] RBAC: Adding query filter params (role.id=c8affbefb4c5462a921650b24b13c80f, scope.project.id=3563c87e56124c688a8029b4088cb198, user.id=47515442e0e84441bed4bfbb7a3b4ff9) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:46:59.202057 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c10503-294f-4535-a1a6-3af63f22419b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:46:59.203493 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c10503-294f-4535-a1a6-3af63f22419b None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:46:59.209056 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 641/1287] 10.222.0.24 () {56 vars in 1374 bytes} [Mon Apr 11 23:46:59 2022] GET /identity/v3/role_assignments?user.id=47515442e0e84441bed4bfbb7a3b4ff9&scope.project.id=3563c87e56124c688a8029b4088cb198&role.id=c8affbefb4c5462a921650b24b13c80f => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:47:01.495967 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d89e8-b122-4a2c-91db-879586b41eb3 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:47:01.496531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d89e8-b122-4a2c-91db-879586b41eb3 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:47:01.496531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d89e8-b122-4a2c-91db-879586b41eb3 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:47:01.498325 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 647/1288] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:47:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:47:01.503372 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee596f46-4f55-4545-98e4-bedd65b7631a None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:47:01.503779 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee596f46-4f55-4545-98e4-bedd65b7631a None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:47:01.503919 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee596f46-4f55-4545-98e4-bedd65b7631a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:47:01.520247 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-ee596f46-4f55-4545-98e4-bedd65b7631a None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:47:01.521408 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ee596f46-4f55-4545-98e4-bedd65b7631a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:47:01.584148 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 642/1289] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:47:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:47:01.606678 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d89e8-b122-4a2c-91db-879586b41eb3 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:47:01.702635 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d89e8-b122-4a2c-91db-879586b41eb3 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:47:01.735762 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea46b1c-a2db-4014-b62d-bc83f12c470f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:47:01.736550 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea46b1c-a2db-4014-b62d-bc83f12c470f None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:47:01.736829 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea46b1c-a2db-4014-b62d-bc83f12c470f None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:47:01.737103 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea46b1c-a2db-4014-b62d-bc83f12c470f None admin] PATH_INFO: `/v3/services/placement` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:47:01.737754 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea46b1c-a2db-4014-b62d-bc83f12c470f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:47:01.739140 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea46b1c-a2db-4014-b62d-bc83f12c470f None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:47:01.750329 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-2ea46b1c-a2db-4014-b62d-bc83f12c470f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 11 23:47:01.751274 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 648/1290] 10.222.0.24 () {56 vars in 1117 bytes} [Mon Apr 11 23:47:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:47:01.757378 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee596f46-4f55-4545-98e4-bedd65b7631a None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:47:01.853285 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee596f46-4f55-4545-98e4-bedd65b7631a None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:47:01.885577 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1e1f4-d780-4b3e-ac26-3a9f1735fec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:47:01.886229 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1e1f4-d780-4b3e-ac26-3a9f1735fec2 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:47:01.886510 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1e1f4-d780-4b3e-ac26-3a9f1735fec2 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:47:01.886784 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1e1f4-d780-4b3e-ac26-3a9f1735fec2 None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:47:01.887519 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1e1f4-d780-4b3e-ac26-3a9f1735fec2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:47:01.887822 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1e1f4-d780-4b3e-ac26-3a9f1735fec2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:47:01.889177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f1e1f4-d780-4b3e-ac26-3a9f1735fec2 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:47:01.893859 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 643/1291] 10.222.0.24 () {56 vars in 1116 bytes} [Mon Apr 11 23:47:01 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:47:01.900061 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea46b1c-a2db-4014-b62d-bc83f12c470f None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:47:01.995584 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea46b1c-a2db-4014-b62d-bc83f12c470f None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:47:02.027658 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c24e76-ea6c-4bfd-b1ce-69a90e33fd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:47:02.028251 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c24e76-ea6c-4bfd-b1ce-69a90e33fd4c None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:47:02.028530 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c24e76-ea6c-4bfd-b1ce-69a90e33fd4c None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:47:02.028802 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c24e76-ea6c-4bfd-b1ce-69a90e33fd4c None admin] PATH_INFO: `/v3/services` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:47:02.029503 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c24e76-ea6c-4bfd-b1ce-69a90e33fd4c None admin] RBAC: Adding query filter params (type=placement) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:47:02.029806 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c24e76-ea6c-4bfd-b1ce-69a90e33fd4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:47:02.031185 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c24e76-ea6c-4bfd-b1ce-69a90e33fd4c None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:47:02.035523 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 649/1292] 10.222.0.24 () {56 vars in 1116 bytes} [Mon Apr 11 23:47:01 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:47:04.281078 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db32fa-8ea1-492a-af0d-995f0d4007c0 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:47:04.281635 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db32fa-8ea1-492a-af0d-995f0d4007c0 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:47:04.281635 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db32fa-8ea1-492a-af0d-995f0d4007c0 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:47:04.283468 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 644/1293] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:47:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:47:04.288590 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4130829-7d3d-4086-97b0-7982cef75277 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:47:04.289527 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4130829-7d3d-4086-97b0-7982cef75277 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:47:04.289632 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4130829-7d3d-4086-97b0-7982cef75277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:47:04.306670 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-f4130829-7d3d-4086-97b0-7982cef75277 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:47:04.307882 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-f4130829-7d3d-4086-97b0-7982cef75277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:47:04.376930 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 650/1294] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:47:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:47:04.399897 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db32fa-8ea1-492a-af0d-995f0d4007c0 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:47:04.498716 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db32fa-8ea1-492a-af0d-995f0d4007c0 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:47:04.529739 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4770d10a-2463-45c8-8dcc-c6f8fffb1869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:47:04.530383 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770d10a-2463-45c8-8dcc-c6f8fffb1869 None admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:47:04.530655 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770d10a-2463-45c8-8dcc-c6f8fffb1869 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:47:04.530954 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4770d10a-2463-45c8-8dcc-c6f8fffb1869 None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:47:04.531704 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770d10a-2463-45c8-8dcc-c6f8fffb1869 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:47:04.532997 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4770d10a-2463-45c8-8dcc-c6f8fffb1869 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:47:04.634696 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 645/1295] 10.222.0.24 () {60 vars in 1141 bytes} [Mon Apr 11 23:47:04 2022] POST /identity/v3/services => generated 246 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:47:07.002676 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33185b77-bbcd-46f7-be71-a75924289ac1 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:47:07.003246 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33185b77-bbcd-46f7-be71-a75924289ac1 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:47:07.003246 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33185b77-bbcd-46f7-be71-a75924289ac1 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:47:07.005124 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 651/1296] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:47:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:47:07.011146 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbec127-5797-4865-b327-3d04f261711b None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:47:07.011578 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbec127-5797-4865-b327-3d04f261711b None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:47:07.011698 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbec127-5797-4865-b327-3d04f261711b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:47:07.028294 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-3dbec127-5797-4865-b327-3d04f261711b None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:47:07.029403 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-3dbec127-5797-4865-b327-3d04f261711b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:47:07.098039 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 646/1297] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:47:07 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:47:07.121656 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33185b77-bbcd-46f7-be71-a75924289ac1 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:47:07.218824 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33185b77-bbcd-46f7-be71-a75924289ac1 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:47:07.251013 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03efa93-2dc8-4c12-848b-801b15e18efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:47:07.251797 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03efa93-2dc8-4c12-848b-801b15e18efe None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:47:07.252071 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03efa93-2dc8-4c12-848b-801b15e18efe None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:47:07.252340 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03efa93-2dc8-4c12-848b-801b15e18efe None admin] PATH_INFO: `/v3/services/placement` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:47:07.252983 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03efa93-2dc8-4c12-848b-801b15e18efe None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:47:07.254327 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03efa93-2dc8-4c12-848b-801b15e18efe None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:47:07.265184 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-f03efa93-2dc8-4c12-848b-801b15e18efe None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 11 23:47:07.266317 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 652/1298] 10.222.0.24 () {56 vars in 1117 bytes} [Mon Apr 11 23:47:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Apr 11 23:47:07.272336 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbec127-5797-4865-b327-3d04f261711b None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:47:07.366050 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbec127-5797-4865-b327-3d04f261711b None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:47:07.398055 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518755c7-ff92-4382-b810-b75a37c8d6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:47:07.398814 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518755c7-ff92-4382-b810-b75a37c8d6f5 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:47:07.399118 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518755c7-ff92-4382-b810-b75a37c8d6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:47:07.399386 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518755c7-ff92-4382-b810-b75a37c8d6f5 None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:47:07.400080 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518755c7-ff92-4382-b810-b75a37c8d6f5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:47:07.400380 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518755c7-ff92-4382-b810-b75a37c8d6f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:47:07.401726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518755c7-ff92-4382-b810-b75a37c8d6f5 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:47:07.406607 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 647/1299] 10.222.0.24 () {56 vars in 1116 bytes} [Mon Apr 11 23:47:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:47:07.412603 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03efa93-2dc8-4c12-848b-801b15e18efe None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:47:07.506792 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03efa93-2dc8-4c12-848b-801b15e18efe None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:47:07.537811 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804c4db-14f4-4052-8642-a8a989b42e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:47:07.538448 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804c4db-14f4-4052-8642-a8a989b42e08 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:47:07.538727 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804c4db-14f4-4052-8642-a8a989b42e08 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:47:07.539527 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804c4db-14f4-4052-8642-a8a989b42e08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:47:07.540300 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804c4db-14f4-4052-8642-a8a989b42e08 None admin] RBAC: Adding query filter params (interface=public, service_id=3bb5a61330ad4addace83355428cba13, region_id=RegionOne) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:47:07.540605 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804c4db-14f4-4052-8642-a8a989b42e08 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:47:07.542038 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804c4db-14f4-4052-8642-a8a989b42e08 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:47:07.546791 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 653/1300] 10.222.0.24 () {56 vars in 1251 bytes} [Mon Apr 11 23:47:07 2022] GET /identity/v3/endpoints?service_id=3bb5a61330ad4addace83355428cba13&interface=public®ion_id=RegionOne => generated 194 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 11 23:47:07.552280 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518755c7-ff92-4382-b810-b75a37c8d6f5 None admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:47:07.646084 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518755c7-ff92-4382-b810-b75a37c8d6f5 None admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:47:07.678354 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1593045e-607a-4aec-a3ce-e0e917554630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:47:07.679035 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593045e-607a-4aec-a3ce-e0e917554630 None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:47:07.679322 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593045e-607a-4aec-a3ce-e0e917554630 None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:47:07.679622 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1593045e-607a-4aec-a3ce-e0e917554630 None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:47:07.680300 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593045e-607a-4aec-a3ce-e0e917554630 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:47:07.681657 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1593045e-607a-4aec-a3ce-e0e917554630 None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:47:07.688453 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 648/1301] 10.222.0.24 () {56 vars in 1087 bytes} [Mon Apr 11 23:47:07 2022] GET /identity/v3/services => generated 2191 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 23:47:09.975920 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d73f7b-82f8-47ae-8913-243ad220484c None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:47:09.976494 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d73f7b-82f8-47ae-8913-243ad220484c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:47:09.976494 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d73f7b-82f8-47ae-8913-243ad220484c None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:47:09.978788 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 654/1302] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:47:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:47:09.984002 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216b834-630c-45ef-bc43-a7ef6d1f9abc None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:47:09.984421 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216b834-630c-45ef-bc43-a7ef6d1f9abc None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:47:09.984555 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216b834-630c-45ef-bc43-a7ef6d1f9abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:47:10.001254 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-7216b834-630c-45ef-bc43-a7ef6d1f9abc None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:47:10.002432 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-7216b834-630c-45ef-bc43-a7ef6d1f9abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:47:10.065797 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 649/1303] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:47:09 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Apr 11 23:47:10.088908 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d73f7b-82f8-47ae-8913-243ad220484c None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:47:10.185781 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d73f7b-82f8-47ae-8913-243ad220484c None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:47:10.217769 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4bddc-df32-4001-9d1e-ff21a032c9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:47:10.218615 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4bddc-df32-4001-9d1e-ff21a032c9f5 None admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:47:10.218917 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4bddc-df32-4001-9d1e-ff21a032c9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:47:10.219188 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4bddc-df32-4001-9d1e-ff21a032c9f5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:47:10.219864 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4bddc-df32-4001-9d1e-ff21a032c9f5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:47:10.221262 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c4bddc-df32-4001-9d1e-ff21a032c9f5 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:47:10.232979 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING keystone.server.flask.application [None req-31c4bddc-df32-4001-9d1e-ff21a032c9f5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Apr 11 23:47:10.234127 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 655/1304] 10.222.0.24 () {56 vars in 1117 bytes} [Mon Apr 11 23:47:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Apr 11 23:47:10.240123 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216b834-630c-45ef-bc43-a7ef6d1f9abc None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:47:10.333679 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216b834-630c-45ef-bc43-a7ef6d1f9abc None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:47:10.366367 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b1ac5-8202-4f87-b3b3-59088102566f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:47:10.367075 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b1ac5-8202-4f87-b3b3-59088102566f None admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:47:10.367359 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b1ac5-8202-4f87-b3b3-59088102566f None admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:47:10.367629 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b1ac5-8202-4f87-b3b3-59088102566f None admin] PATH_INFO: `/v3/services` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:47:10.368329 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b1ac5-8202-4f87-b3b3-59088102566f None admin] RBAC: Adding query filter params (name=placement) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:47:10.368630 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b1ac5-8202-4f87-b3b3-59088102566f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:47:10.369979 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b1ac5-8202-4f87-b3b3-59088102566f None admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:47:10.374860 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 650/1305] 10.222.0.24 () {56 vars in 1116 bytes} [Mon Apr 11 23:47:10 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:47:10.380699 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4bddc-df32-4001-9d1e-ff21a032c9f5 None admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:47:10.474882 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4bddc-df32-4001-9d1e-ff21a032c9f5 None admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:47:10.505811 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a5c34-1b83-484b-b786-c95bbb162f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:47:10.506453 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a5c34-1b83-484b-b786-c95bbb162f41 None admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:47:10.506735 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a5c34-1b83-484b-b786-c95bbb162f41 None admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:47:10.507035 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a5c34-1b83-484b-b786-c95bbb162f41 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:47:10.508311 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a5c34-1b83-484b-b786-c95bbb162f41 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:47:10.509662 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a5c34-1b83-484b-b786-c95bbb162f41 None admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:47:10.611343 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 656/1306] 10.222.0.24 () {60 vars in 1144 bytes} [Mon Apr 11 23:47:10 2022] POST /identity/v3/endpoints => generated 331 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:52:57.887816 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7042c1b-c1a5-4c01-a9f1-45f00a061ebf None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:52:57.888367 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7042c1b-c1a5-4c01-a9f1-45f00a061ebf None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:52:57.888786 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7042c1b-c1a5-4c01-a9f1-45f00a061ebf None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:52:57.891662 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 651/1307] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:52:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:52:57.896973 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7d5de-401a-499d-b066-67b375a9e695 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:52:57.897387 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7d5de-401a-499d-b066-67b375a9e695 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:52:57.897527 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da7d5de-401a-499d-b066-67b375a9e695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:52:57.983555 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-2da7d5de-401a-499d-b066-67b375a9e695 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:52:57.984753 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-2da7d5de-401a-499d-b066-67b375a9e695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:52:58.112675 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 657/1308] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:52:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:52:58.135554 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7042c1b-c1a5-4c01-a9f1-45f00a061ebf None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:52:58.139692 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-e7042c1b-c1a5-4c01-a9f1-45f00a061ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:52:58.284179 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7042c1b-c1a5-4c01-a9f1-45f00a061ebf None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:52:58.376071 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a839f4-9c01-431e-8817-f6f2fc2b03cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:52:58.376725 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a839f4-9c01-431e-8817-f6f2fc2b03cb admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:52:58.377002 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a839f4-9c01-431e-8817-f6f2fc2b03cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:52:58.377272 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a839f4-9c01-431e-8817-f6f2fc2b03cb admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:52:58.377996 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a839f4-9c01-431e-8817-f6f2fc2b03cb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:52:58.379800 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING py.warnings [None req-12a839f4-9c01-431e-8817-f6f2fc2b03cb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 23:52:58.379800 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: warnings.warn(msg) Apr 11 23:52:58.379800 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: Apr 11 23:52:58.380919 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a839f4-9c01-431e-8817-f6f2fc2b03cb admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:52:58.413262 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 652/1309] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:52:58 2022] GET /identity/v3/projects => generated 2553 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 23:53:00.736432 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ba1da-1d4c-409a-84a9-504c0b4d0ed2 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:00.736926 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ba1da-1d4c-409a-84a9-504c0b4d0ed2 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:00.737051 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ba1da-1d4c-409a-84a9-504c0b4d0ed2 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:00.738775 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 658/1310] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:53:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:53:00.744036 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8695851-611b-4165-afce-87dbdc48d134 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:00.744472 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8695851-611b-4165-afce-87dbdc48d134 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:00.744595 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8695851-611b-4165-afce-87dbdc48d134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:00.812383 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-f8695851-611b-4165-afce-87dbdc48d134 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:53:00.813586 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-f8695851-611b-4165-afce-87dbdc48d134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:00.904978 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 653/1311] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:53:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:53:00.955718 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab882020-ee44-4f2d-a11f-d9ee79f92020 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:00.956007 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab882020-ee44-4f2d-a11f-d9ee79f92020 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:00.956288 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab882020-ee44-4f2d-a11f-d9ee79f92020 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:00.959053 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 659/1312] 10.222.0.24 () {54 vars in 963 bytes} [Mon Apr 11 23:53:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:53:00.970175 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abd0c8-1cd9-4296-bddc-23845921f18d None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:00.970409 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abd0c8-1cd9-4296-bddc-23845921f18d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:00.970689 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abd0c8-1cd9-4296-bddc-23845921f18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:01.044941 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-d9abd0c8-1cd9-4296-bddc-23845921f18d None None] MFA Rules not processed for user `c6936272118b49a9baa19f3bd5066f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:53:01.046774 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d9abd0c8-1cd9-4296-bddc-23845921f18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:01.127392 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 654/1313] 10.222.0.24 () {58 vars in 1060 bytes} [Mon Apr 11 23:53:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:53:01.136843 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab882020-ee44-4f2d-a11f-d9ee79f92020 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:53:01.138397 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-ab882020-ee44-4f2d-a11f-d9ee79f92020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:01.262750 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab882020-ee44-4f2d-a11f-d9ee79f92020 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:53:01.362786 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f569a0-ae2b-4acb-a209-ba01fd99bb90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:53:01.363551 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f569a0-ae2b-4acb-a209-ba01fd99bb90 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:01.364017 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f569a0-ae2b-4acb-a209-ba01fd99bb90 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:01.364393 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f569a0-ae2b-4acb-a209-ba01fd99bb90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:01.366347 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-54f569a0-ae2b-4acb-a209-ba01fd99bb90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:01.476830 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f569a0-ae2b-4acb-a209-ba01fd99bb90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:53:01.478249 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f569a0-ae2b-4acb-a209-ba01fd99bb90 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:53:01.497172 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 660/1314] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:53:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:53:04.090281 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdff125-c0fb-4004-9e5c-a7ea41a75372 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:04.090828 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdff125-c0fb-4004-9e5c-a7ea41a75372 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:04.090828 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdff125-c0fb-4004-9e5c-a7ea41a75372 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:04.093172 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 655/1315] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:53:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:53:04.098621 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6be81a-f888-44f6-a435-2c36fa851a71 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:04.099097 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6be81a-f888-44f6-a435-2c36fa851a71 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:04.099200 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6be81a-f888-44f6-a435-2c36fa851a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:04.162347 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-dc6be81a-f888-44f6-a435-2c36fa851a71 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:53:04.163969 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-dc6be81a-f888-44f6-a435-2c36fa851a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:04.257493 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 661/1316] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:53:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:53:04.295459 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdff125-c0fb-4004-9e5c-a7ea41a75372 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:53:04.297009 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-4cdff125-c0fb-4004-9e5c-a7ea41a75372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:04.396777 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdff125-c0fb-4004-9e5c-a7ea41a75372 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:53:04.470088 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a282a429-abbc-4402-b0cd-8658d5d45ad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:53:04.470718 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282a429-abbc-4402-b0cd-8658d5d45ad4 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:04.471022 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282a429-abbc-4402-b0cd-8658d5d45ad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:04.471295 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a282a429-abbc-4402-b0cd-8658d5d45ad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:04.473161 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-a282a429-abbc-4402-b0cd-8658d5d45ad4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:04.573969 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282a429-abbc-4402-b0cd-8658d5d45ad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:53:04.575414 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a282a429-abbc-4402-b0cd-8658d5d45ad4 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:53:04.592756 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 656/1317] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:53:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:53:07.382537 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61049bc0-fd53-4d5b-ada1-dba75d7480f9 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:07.383229 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61049bc0-fd53-4d5b-ada1-dba75d7480f9 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:07.383229 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61049bc0-fd53-4d5b-ada1-dba75d7480f9 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:07.384879 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 662/1318] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:53:07.390046 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc053d67-7c57-49b0-bbb6-35084d3a756a None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:07.390489 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc053d67-7c57-49b0-bbb6-35084d3a756a None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:07.390593 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc053d67-7c57-49b0-bbb6-35084d3a756a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:07.453510 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-fc053d67-7c57-49b0-bbb6-35084d3a756a None None] MFA Rules not processed for user `417f9e3fafbd4d549108c326f06391c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:53:07.454748 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-fc053d67-7c57-49b0-bbb6-35084d3a756a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:07.548642 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 657/1319] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:53:07 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:53:07.589774 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61049bc0-fd53-4d5b-ada1-dba75d7480f9 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:53:07.591355 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-61049bc0-fd53-4d5b-ada1-dba75d7480f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:07.692890 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61049bc0-fd53-4d5b-ada1-dba75d7480f9 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:53:07.762949 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9642662-e644-42be-b07a-1579f7526b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:53:07.763590 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9642662-e644-42be-b07a-1579f7526b88 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:07.763870 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9642662-e644-42be-b07a-1579f7526b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:07.764143 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9642662-e644-42be-b07a-1579f7526b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:07.766063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-f9642662-e644-42be-b07a-1579f7526b88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:07.870473 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9642662-e644-42be-b07a-1579f7526b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:53:07.871948 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9642662-e644-42be-b07a-1579f7526b88 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:53:07.889852 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 663/1320] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:53:07 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 23:53:10.968770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a7549-164f-4868-80d2-698e950df5c3 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:10.969340 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a7549-164f-4868-80d2-698e950df5c3 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:10.969340 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a7549-164f-4868-80d2-698e950df5c3 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:10.971158 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 658/1321] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:53:10.976445 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041f8aa-b61b-4d30-8a1f-334671413b29 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:10.976877 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041f8aa-b61b-4d30-8a1f-334671413b29 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:10.977000 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2041f8aa-b61b-4d30-8a1f-334671413b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:11.041244 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-2041f8aa-b61b-4d30-8a1f-334671413b29 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:53:11.042366 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-2041f8aa-b61b-4d30-8a1f-334671413b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:11.133693 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 664/1322] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:53:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 23:53:11.172136 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a7549-164f-4868-80d2-698e950df5c3 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:53:11.173640 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-3e3a7549-164f-4868-80d2-698e950df5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:11.270521 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a7549-164f-4868-80d2-698e950df5c3 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:53:11.338750 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88633b38-9ee7-43d1-8214-fea0159bda11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:53:11.339456 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88633b38-9ee7-43d1-8214-fea0159bda11 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:11.339734 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88633b38-9ee7-43d1-8214-fea0159bda11 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:11.340001 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88633b38-9ee7-43d1-8214-fea0159bda11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:11.341614 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-88633b38-9ee7-43d1-8214-fea0159bda11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:11.444412 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88633b38-9ee7-43d1-8214-fea0159bda11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:53:11.445812 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88633b38-9ee7-43d1-8214-fea0159bda11 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:53:11.463071 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 659/1323] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:53:11 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:53:14.824351 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7946e7d-fa9d-4ae1-9b7e-fb98eb706afa None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:14.824876 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7946e7d-fa9d-4ae1-9b7e-fb98eb706afa None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:14.824876 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7946e7d-fa9d-4ae1-9b7e-fb98eb706afa None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:14.827253 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 665/1324] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:53:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:53:14.832461 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fb3a5-021c-4e00-8a7e-86ed556f108e None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:14.832856 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fb3a5-021c-4e00-8a7e-86ed556f108e None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:14.833024 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865fb3a5-021c-4e00-8a7e-86ed556f108e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:14.896277 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-865fb3a5-021c-4e00-8a7e-86ed556f108e None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:53:14.897468 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-865fb3a5-021c-4e00-8a7e-86ed556f108e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:14.990129 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 660/1325] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:53:15.042386 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e78a6a-4647-41c9-8461-1a2e2bba5c29 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:15.042672 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e78a6a-4647-41c9-8461-1a2e2bba5c29 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:15.043007 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e78a6a-4647-41c9-8461-1a2e2bba5c29 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:15.044829 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 666/1326] 10.222.0.24 () {54 vars in 963 bytes} [Mon Apr 11 23:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:53:15.051162 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5af95-dd50-4860-bfc5-d6430ec83a2d None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:15.051476 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5af95-dd50-4860-bfc5-d6430ec83a2d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:15.051753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5af95-dd50-4860-bfc5-d6430ec83a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:15.127084 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-d0f5af95-dd50-4860-bfc5-d6430ec83a2d None None] MFA Rules not processed for user `c6936272118b49a9baa19f3bd5066f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:53:15.128293 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d0f5af95-dd50-4860-bfc5-d6430ec83a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:15.200818 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 661/1327] 10.222.0.24 () {58 vars in 1060 bytes} [Mon Apr 11 23:53:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:53:15.210391 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e78a6a-4647-41c9-8461-1a2e2bba5c29 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:53:15.212032 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d3e78a6a-4647-41c9-8461-1a2e2bba5c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:15.315335 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e78a6a-4647-41c9-8461-1a2e2bba5c29 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:53:15.389784 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a66866-6886-4b82-a942-4c49669f2171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:53:15.390431 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a66866-6886-4b82-a942-4c49669f2171 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:15.390808 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a66866-6886-4b82-a942-4c49669f2171 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:15.391019 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a66866-6886-4b82-a942-4c49669f2171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:15.392666 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-65a66866-6886-4b82-a942-4c49669f2171 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:15.496687 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a66866-6886-4b82-a942-4c49669f2171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:53:15.498713 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a66866-6886-4b82-a942-4c49669f2171 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:53:15.515922 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 667/1328] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:53:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:53:18.080768 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986b40f-d1c1-404c-bc64-edb818481039 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:18.081283 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986b40f-d1c1-404c-bc64-edb818481039 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:18.081283 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c986b40f-d1c1-404c-bc64-edb818481039 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:18.083085 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 662/1329] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:53:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:53:18.088445 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f1cd0-2736-4e3c-a5b9-35fdb69978a2 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:18.088882 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f1cd0-2736-4e3c-a5b9-35fdb69978a2 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:18.089158 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f1cd0-2736-4e3c-a5b9-35fdb69978a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:18.152539 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-2e0f1cd0-2736-4e3c-a5b9-35fdb69978a2 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:53:18.153720 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-2e0f1cd0-2736-4e3c-a5b9-35fdb69978a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:18.246159 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 668/1330] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:53:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 23:53:18.283062 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986b40f-d1c1-404c-bc64-edb818481039 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:53:18.284598 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-c986b40f-d1c1-404c-bc64-edb818481039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:18.391712 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c986b40f-d1c1-404c-bc64-edb818481039 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:53:18.464502 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d1a94-36b6-4ce9-9b71-d6e3a3ce7188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:53:18.465150 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d1a94-36b6-4ce9-9b71-d6e3a3ce7188 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:18.465430 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d1a94-36b6-4ce9-9b71-d6e3a3ce7188 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:18.465699 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d1a94-36b6-4ce9-9b71-d6e3a3ce7188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:18.468054 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-526d1a94-36b6-4ce9-9b71-d6e3a3ce7188 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:18.571928 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d1a94-36b6-4ce9-9b71-d6e3a3ce7188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:53:18.573351 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d1a94-36b6-4ce9-9b71-d6e3a3ce7188 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:53:18.591307 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 663/1331] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:53:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:53:20.951311 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac874dc8-871d-4b3d-9920-7cd21902b532 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:20.951858 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac874dc8-871d-4b3d-9920-7cd21902b532 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:20.951858 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac874dc8-871d-4b3d-9920-7cd21902b532 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:20.953651 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 669/1332] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:53:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:53:20.958879 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53e21b-4c07-4110-858e-d01a61f10c81 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:20.959279 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53e21b-4c07-4110-858e-d01a61f10c81 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:20.959433 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53e21b-4c07-4110-858e-d01a61f10c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:21.023702 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-6f53e21b-4c07-4110-858e-d01a61f10c81 None None] MFA Rules not processed for user `417f9e3fafbd4d549108c326f06391c6`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:53:21.024834 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-6f53e21b-4c07-4110-858e-d01a61f10c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:21.120792 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 664/1333] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:53:20 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:53:21.157907 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac874dc8-871d-4b3d-9920-7cd21902b532 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:53:21.159466 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-ac874dc8-871d-4b3d-9920-7cd21902b532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:21.260089 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac874dc8-871d-4b3d-9920-7cd21902b532 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:53:21.332291 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83a00a4-0c92-4d39-b62a-9612e38bcb8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:53:21.332856 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a00a4-0c92-4d39-b62a-9612e38bcb8b service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:21.333135 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a00a4-0c92-4d39-b62a-9612e38bcb8b service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:21.333408 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83a00a4-0c92-4d39-b62a-9612e38bcb8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:21.335077 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-c83a00a4-0c92-4d39-b62a-9612e38bcb8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:21.440452 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a00a4-0c92-4d39-b62a-9612e38bcb8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:53:21.441886 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83a00a4-0c92-4d39-b62a-9612e38bcb8b service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:53:21.460383 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 670/1334] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:53:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:53:24.202664 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05eae3-65af-4093-ad33-42f5060db13a None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:24.203198 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05eae3-65af-4093-ad33-42f5060db13a None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:24.203298 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd05eae3-65af-4093-ad33-42f5060db13a None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:24.205173 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 665/1335] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:53:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:53:24.210283 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad933081-5929-423e-b1e2-d8005fd81203 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:24.210737 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad933081-5929-423e-b1e2-d8005fd81203 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:24.211134 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad933081-5929-423e-b1e2-d8005fd81203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:24.276613 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-ad933081-5929-423e-b1e2-d8005fd81203 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:53:24.277831 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-ad933081-5929-423e-b1e2-d8005fd81203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:24.379615 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 671/1336] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:53:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 23:53:24.414702 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05eae3-65af-4093-ad33-42f5060db13a None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:53:24.416246 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-dd05eae3-65af-4093-ad33-42f5060db13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:24.515529 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd05eae3-65af-4093-ad33-42f5060db13a None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:53:24.585685 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8b9fa-bf2a-4f33-b3f9-5288c85b937d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:53:24.586323 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8b9fa-bf2a-4f33-b3f9-5288c85b937d service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:24.586601 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8b9fa-bf2a-4f33-b3f9-5288c85b937d service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:24.586892 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8b9fa-bf2a-4f33-b3f9-5288c85b937d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:24.588512 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-c6c8b9fa-bf2a-4f33-b3f9-5288c85b937d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:24.693010 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8b9fa-bf2a-4f33-b3f9-5288c85b937d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:53:24.694342 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8b9fa-bf2a-4f33-b3f9-5288c85b937d service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:53:24.713645 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 666/1337] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:53:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:53:27.045842 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65384557-aba1-4984-9ff5-5f790393d50e None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:27.046372 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65384557-aba1-4984-9ff5-5f790393d50e None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:27.046372 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65384557-aba1-4984-9ff5-5f790393d50e None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:27.048099 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 672/1338] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:53:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:53:27.053250 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce84761-bde7-4edf-8129-8b558f53cf6e None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:27.061069 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce84761-bde7-4edf-8129-8b558f53cf6e None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:27.061069 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce84761-bde7-4edf-8129-8b558f53cf6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:27.118342 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-6ce84761-bde7-4edf-8129-8b558f53cf6e None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:53:27.120112 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-6ce84761-bde7-4edf-8129-8b558f53cf6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:27.211840 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 667/1339] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:53:27.251241 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65384557-aba1-4984-9ff5-5f790393d50e None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:53:27.252769 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-65384557-aba1-4984-9ff5-5f790393d50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:27.352233 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65384557-aba1-4984-9ff5-5f790393d50e None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:53:27.424987 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1562b9c2-4180-4b6e-9fdf-b90c84697c66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:53:27.425622 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562b9c2-4180-4b6e-9fdf-b90c84697c66 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:27.425897 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562b9c2-4180-4b6e-9fdf-b90c84697c66 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:27.426165 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1562b9c2-4180-4b6e-9fdf-b90c84697c66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:27.427808 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1562b9c2-4180-4b6e-9fdf-b90c84697c66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:27.530847 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562b9c2-4180-4b6e-9fdf-b90c84697c66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:53:27.532262 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1562b9c2-4180-4b6e-9fdf-b90c84697c66 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:53:27.549730 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 673/1340] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:53:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 23:53:30.355694 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c939e81-ca10-4c9f-85e6-3d3fb9d1e296 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:30.356244 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c939e81-ca10-4c9f-85e6-3d3fb9d1e296 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:30.356244 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c939e81-ca10-4c9f-85e6-3d3fb9d1e296 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:30.358044 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 668/1341] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:53:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:53:30.363297 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56f455-583d-42ab-b2d6-7ff54d69b835 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:30.363725 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56f455-583d-42ab-b2d6-7ff54d69b835 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:30.363852 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56f455-583d-42ab-b2d6-7ff54d69b835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:30.431451 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-5f56f455-583d-42ab-b2d6-7ff54d69b835 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:53:30.432642 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-5f56f455-583d-42ab-b2d6-7ff54d69b835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:30.534695 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 674/1342] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:53:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:53:30.570017 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c939e81-ca10-4c9f-85e6-3d3fb9d1e296 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:53:30.572123 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-1c939e81-ca10-4c9f-85e6-3d3fb9d1e296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:30.665467 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c939e81-ca10-4c9f-85e6-3d3fb9d1e296 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:53:30.668948 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764a9af-49a9-4797-a214-3fa4a198bb7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:53:30.669584 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764a9af-49a9-4797-a214-3fa4a198bb7e service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:30.669865 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764a9af-49a9-4797-a214-3fa4a198bb7e service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:30.670141 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764a9af-49a9-4797-a214-3fa4a198bb7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:30.678991 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764a9af-49a9-4797-a214-3fa4a198bb7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:53:30.680408 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764a9af-49a9-4797-a214-3fa4a198bb7e service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:53:30.690170 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 669/1343] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:53:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:53:35.241549 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572b961-bafe-429b-ac79-feb3e7ca0e5b None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:35.242068 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572b961-bafe-429b-ac79-feb3e7ca0e5b None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:35.242068 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8572b961-bafe-429b-ac79-feb3e7ca0e5b None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:35.243857 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 675/1344] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:53:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:53:35.249545 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705e158-ba4e-4ad6-b963-f744fe2c2ffe None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:35.249963 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705e158-ba4e-4ad6-b963-f744fe2c2ffe None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:35.250219 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705e158-ba4e-4ad6-b963-f744fe2c2ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:35.278713 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-7705e158-ba4e-4ad6-b963-f744fe2c2ffe None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:53:35.279886 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-7705e158-ba4e-4ad6-b963-f744fe2c2ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:35.354191 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 670/1345] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:53:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:53:35.394143 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572b961-bafe-429b-ac79-feb3e7ca0e5b None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:53:35.395888 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-8572b961-bafe-429b-ac79-feb3e7ca0e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:35.408529 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8572b961-bafe-429b-ac79-feb3e7ca0e5b None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:53:35.411979 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd674f-099c-4b66-9417-cbce04326ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:53:35.412602 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd674f-099c-4b66-9417-cbce04326ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:35.412878 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd674f-099c-4b66-9417-cbce04326ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:35.413201 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd674f-099c-4b66-9417-cbce04326ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:35.421889 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd674f-099c-4b66-9417-cbce04326ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:53:35.423331 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd674f-099c-4b66-9417-cbce04326ed1 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:53:35.432444 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 676/1346] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:53:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:53:38.988554 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d10d5b-a792-4e75-a6d2-ea7fe397800d None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:38.989144 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d10d5b-a792-4e75-a6d2-ea7fe397800d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:38.989144 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d10d5b-a792-4e75-a6d2-ea7fe397800d None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:38.990962 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 671/1347] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:53:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:53:38.996328 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8824705-bd89-4105-a637-899b3eb2150f None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:38.996733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8824705-bd89-4105-a637-899b3eb2150f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:38.996886 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8824705-bd89-4105-a637-899b3eb2150f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:39.014238 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-b8824705-bd89-4105-a637-899b3eb2150f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:53:39.015435 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-b8824705-bd89-4105-a637-899b3eb2150f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:39.023210 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 677/1348] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:53:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:53:39.061792 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d10d5b-a792-4e75-a6d2-ea7fe397800d None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:53:39.072293 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d10d5b-a792-4e75-a6d2-ea7fe397800d None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:53:39.076434 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b62c40-a910-42ed-84f9-450541385aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:53:39.077074 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b62c40-a910-42ed-84f9-450541385aba service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:39.077354 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b62c40-a910-42ed-84f9-450541385aba service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:39.077626 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b62c40-a910-42ed-84f9-450541385aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:39.086429 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b62c40-a910-42ed-84f9-450541385aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:53:39.087869 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b62c40-a910-42ed-84f9-450541385aba service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:53:39.097418 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 672/1349] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:53:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:53:43.952461 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828599ff-0990-44a5-9047-fb869ab03468 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:43.953014 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828599ff-0990-44a5-9047-fb869ab03468 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:43.953014 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828599ff-0990-44a5-9047-fb869ab03468 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:43.954953 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 678/1350] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:53:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:53:43.960027 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e792f97-ff72-4bd4-930e-2ad29e95e859 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:43.960433 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e792f97-ff72-4bd4-930e-2ad29e95e859 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:43.960577 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e792f97-ff72-4bd4-930e-2ad29e95e859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:43.979121 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-1e792f97-ff72-4bd4-930e-2ad29e95e859 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:53:43.980319 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-1e792f97-ff72-4bd4-930e-2ad29e95e859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:43.988080 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 673/1351] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:53:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:53:44.026038 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828599ff-0990-44a5-9047-fb869ab03468 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:53:44.036811 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828599ff-0990-44a5-9047-fb869ab03468 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:53:44.040610 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bd03a4-ff79-41d1-9a8c-ebb142cfa358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:53:44.040859 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd03a4-ff79-41d1-9a8c-ebb142cfa358 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:44.041131 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd03a4-ff79-41d1-9a8c-ebb142cfa358 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:44.041397 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bd03a4-ff79-41d1-9a8c-ebb142cfa358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:44.050338 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd03a4-ff79-41d1-9a8c-ebb142cfa358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:53:44.051782 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bd03a4-ff79-41d1-9a8c-ebb142cfa358 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:53:44.061068 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 679/1352] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:53:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:53:49.408856 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552d604-5538-46b2-8a5f-84871cae6c9f None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:49.409387 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552d604-5538-46b2-8a5f-84871cae6c9f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:49.409387 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552d604-5538-46b2-8a5f-84871cae6c9f None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:49.411209 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 674/1353] 10.222.0.24 () {54 vars in 921 bytes} [Mon Apr 11 23:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:53:49.416273 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6c178-2693-4e02-b02c-d95fdeff849c None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:49.416675 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6c178-2693-4e02-b02c-d95fdeff849c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:49.416829 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6c178-2693-4e02-b02c-d95fdeff849c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:49.510819 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-27f6c178-2693-4e02-b02c-d95fdeff849c None None] MFA Rules not processed for user `47515442e0e84441bed4bfbb7a3b4ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:53:49.516601 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-27f6c178-2693-4e02-b02c-d95fdeff849c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:49.585134 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 680/1354] 10.222.0.24 () {58 vars in 1018 bytes} [Mon Apr 11 23:53:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:53:54.066173 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdf872-c1d0-4f07-9c04-90fd5a0abcc5 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:54.066658 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdf872-c1d0-4f07-9c04-90fd5a0abcc5 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:54.066658 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdf872-c1d0-4f07-9c04-90fd5a0abcc5 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:54.068468 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 675/1355] 10.222.0.24 () {54 vars in 921 bytes} [Mon Apr 11 23:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:53:54.074055 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507ff52-fae8-4981-b415-15d9a7bc038d None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:54.074600 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507ff52-fae8-4981-b415-15d9a7bc038d None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:54.074824 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e507ff52-fae8-4981-b415-15d9a7bc038d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:54.094151 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-e507ff52-fae8-4981-b415-15d9a7bc038d None None] MFA Rules not processed for user `47515442e0e84441bed4bfbb7a3b4ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:53:54.095677 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-e507ff52-fae8-4981-b415-15d9a7bc038d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:54.104480 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 681/1356] 10.222.0.24 () {58 vars in 1018 bytes} [Mon Apr 11 23:53:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:53:55.584225 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555c2cf-fa1f-44b1-a574-9b10a7c4c36d None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:55.584772 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555c2cf-fa1f-44b1-a574-9b10a7c4c36d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:55.584772 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555c2cf-fa1f-44b1-a574-9b10a7c4c36d None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:55.586571 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 676/1357] 10.222.0.24 () {54 vars in 921 bytes} [Mon Apr 11 23:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:53:55.592868 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071651c8-47cb-4df0-8a1a-8ba54fcc27d8 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:55.593436 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071651c8-47cb-4df0-8a1a-8ba54fcc27d8 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:55.593436 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071651c8-47cb-4df0-8a1a-8ba54fcc27d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:55.612515 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-071651c8-47cb-4df0-8a1a-8ba54fcc27d8 None None] MFA Rules not processed for user `47515442e0e84441bed4bfbb7a3b4ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:53:55.613713 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-071651c8-47cb-4df0-8a1a-8ba54fcc27d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:55.623154 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 682/1358] 10.222.0.24 () {58 vars in 1018 bytes} [Mon Apr 11 23:53:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:53:59.463662 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b5f9e-6f6c-476c-87fb-dc1e876e0ff6 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:59.464163 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b5f9e-6f6c-476c-87fb-dc1e876e0ff6 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:59.464163 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b5f9e-6f6c-476c-87fb-dc1e876e0ff6 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:59.466589 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 677/1359] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:53:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:53:59.471495 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbd71e-2581-4cc0-a5ce-83bac7740c49 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:59.471882 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbd71e-2581-4cc0-a5ce-83bac7740c49 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:59.472054 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebbd71e-2581-4cc0-a5ce-83bac7740c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:59.491378 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-6ebbd71e-2581-4cc0-a5ce-83bac7740c49 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:53:59.492556 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-6ebbd71e-2581-4cc0-a5ce-83bac7740c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:59.500994 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 683/1360] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:53:59.548038 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5db10-37f6-4555-b15c-3b849de76c29 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:59.548325 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5db10-37f6-4555-b15c-3b849de76c29 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:59.548594 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf5db10-37f6-4555-b15c-3b849de76c29 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:59.550480 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 678/1361] 10.222.0.24 () {54 vars in 959 bytes} [Mon Apr 11 23:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:53:59.555672 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b9cf2-d995-47f8-8b1d-ac79198bcb22 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:59.555966 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b9cf2-d995-47f8-8b1d-ac79198bcb22 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:59.556247 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b9cf2-d995-47f8-8b1d-ac79198bcb22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:59.608937 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-5a8b9cf2-d995-47f8-8b1d-ac79198bcb22 None None] MFA Rules not processed for user `a9519f49f897415a894c1121278dda9c`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:53:59.610128 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-5a8b9cf2-d995-47f8-8b1d-ac79198bcb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:53:59.694403 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 684/1362] 10.222.0.24 () {58 vars in 1056 bytes} [Mon Apr 11 23:53:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:53:59.704515 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5db10-37f6-4555-b15c-3b849de76c29 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:53:59.721143 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf5db10-37f6-4555-b15c-3b849de76c29 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:53:59.727777 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06aec5-85bd-42ae-9e77-c238a39e607b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:53:59.728546 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06aec5-85bd-42ae-9e77-c238a39e607b service nova] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:53:59.729046 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06aec5-85bd-42ae-9e77-c238a39e607b service nova] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:53:59.729481 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06aec5-85bd-42ae-9e77-c238a39e607b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:53:59.739259 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06aec5-85bd-42ae-9e77-c238a39e607b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:53:59.741120 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06aec5-85bd-42ae-9e77-c238a39e607b service nova] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:53:59.752354 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 679/1363] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:53:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:54:02.312022 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59717f5d-b63a-4712-81fb-811a0adb552d None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:02.312565 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59717f5d-b63a-4712-81fb-811a0adb552d None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:02.312565 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59717f5d-b63a-4712-81fb-811a0adb552d None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:02.314348 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 685/1364] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:54:02.319708 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed45149-c1de-4103-a0db-141a10eb2535 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:02.320109 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed45149-c1de-4103-a0db-141a10eb2535 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:02.320324 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed45149-c1de-4103-a0db-141a10eb2535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:02.338281 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-eed45149-c1de-4103-a0db-141a10eb2535 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:02.339626 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-eed45149-c1de-4103-a0db-141a10eb2535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:02.348586 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 680/1365] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:54:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:02.394129 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59717f5d-b63a-4712-81fb-811a0adb552d None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:54:02.410799 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59717f5d-b63a-4712-81fb-811a0adb552d None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:54:02.416394 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd98cb5-5600-4721-ae60-6d9767a81966 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:54:02.417125 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd98cb5-5600-4721-ae60-6d9767a81966 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:02.417471 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd98cb5-5600-4721-ae60-6d9767a81966 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:02.417811 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd98cb5-5600-4721-ae60-6d9767a81966 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:02.426811 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd98cb5-5600-4721-ae60-6d9767a81966 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:54:02.428627 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd98cb5-5600-4721-ae60-6d9767a81966 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:54:02.438162 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 686/1366] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:54:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:54:05.213388 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee134d-319f-4ccb-9260-1329b6479e76 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:05.213935 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee134d-319f-4ccb-9260-1329b6479e76 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:05.213935 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bee134d-319f-4ccb-9260-1329b6479e76 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:05.216285 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 681/1367] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:54:05.221583 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956634d-52c2-40be-ae63-27d7715ad9bf None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:05.222033 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956634d-52c2-40be-ae63-27d7715ad9bf None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:05.222131 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b956634d-52c2-40be-ae63-27d7715ad9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:05.242289 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-b956634d-52c2-40be-ae63-27d7715ad9bf None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:05.244067 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-b956634d-52c2-40be-ae63-27d7715ad9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:05.255614 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 687/1368] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:54:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:05.302520 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1dcb0b-3cee-4edc-bcdf-86fe5bad7969 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:05.302873 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1dcb0b-3cee-4edc-bcdf-86fe5bad7969 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:05.303150 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1dcb0b-3cee-4edc-bcdf-86fe5bad7969 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:05.304914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 682/1369] 10.222.0.24 () {54 vars in 959 bytes} [Mon Apr 11 23:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:54:05.310627 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c7d27-5900-4030-9a17-92d018092905 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:05.311009 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c7d27-5900-4030-9a17-92d018092905 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:05.311281 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c7d27-5900-4030-9a17-92d018092905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:05.329709 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-f96c7d27-5900-4030-9a17-92d018092905 None None] MFA Rules not processed for user `a9519f49f897415a894c1121278dda9c`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:05.330905 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-f96c7d27-5900-4030-9a17-92d018092905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:05.340157 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 688/1370] 10.222.0.24 () {58 vars in 1056 bytes} [Mon Apr 11 23:54:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 23:54:05.348643 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1dcb0b-3cee-4edc-bcdf-86fe5bad7969 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:54:05.363524 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1dcb0b-3cee-4edc-bcdf-86fe5bad7969 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:54:05.368985 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff3243-08fb-49be-8ac7-afba3c675bb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:54:05.369615 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff3243-08fb-49be-8ac7-afba3c675bb2 service nova] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:05.369894 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff3243-08fb-49be-8ac7-afba3c675bb2 service nova] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:05.370170 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff3243-08fb-49be-8ac7-afba3c675bb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:05.378252 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff3243-08fb-49be-8ac7-afba3c675bb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:54:05.379846 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff3243-08fb-49be-8ac7-afba3c675bb2 service nova] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:54:05.389124 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 683/1371] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:54:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:54:07.872600 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037f2b1-281a-4572-8fcc-b9f58d6eec77 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:07.873136 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037f2b1-281a-4572-8fcc-b9f58d6eec77 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:07.873136 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037f2b1-281a-4572-8fcc-b9f58d6eec77 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:07.874951 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 689/1372] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:54:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:54:07.878392 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20eda2-f312-4a40-b83d-5cfd540f6108 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:07.879149 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20eda2-f312-4a40-b83d-5cfd540f6108 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:07.879149 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20eda2-f312-4a40-b83d-5cfd540f6108 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:07.880765 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 684/1373] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:54:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:54:07.882051 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5cf10-bddc-4d08-ac15-e0650a0e82bd None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:07.882335 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5cf10-bddc-4d08-ac15-e0650a0e82bd None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:07.882606 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5cf10-bddc-4d08-ac15-e0650a0e82bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:07.885779 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bb4ad-2679-4d87-8d6d-66bb679b9f1c None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:07.886060 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bb4ad-2679-4d87-8d6d-66bb679b9f1c None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:07.886338 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bb4ad-2679-4d87-8d6d-66bb679b9f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:07.904720 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-7cd5cf10-bddc-4d08-ac15-e0650a0e82bd None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:07.904912 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-af7bb4ad-2679-4d87-8d6d-66bb679b9f1c None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:07.905933 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-7cd5cf10-bddc-4d08-ac15-e0650a0e82bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:07.906277 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-af7bb4ad-2679-4d87-8d6d-66bb679b9f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:07.914072 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 690/1374] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:07.922099 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 685/1375] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:54:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:07.958628 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5cf10-bddc-4d08-ac15-e0650a0e82bd None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:54:07.971936 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5cf10-bddc-4d08-ac15-e0650a0e82bd None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:54:07.977913 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5ae6b7-3e29-442a-8e00-39fc935e3bc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:54:07.978559 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ae6b7-3e29-442a-8e00-39fc935e3bc4 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:07.978854 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ae6b7-3e29-442a-8e00-39fc935e3bc4 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:07.979254 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ae6b7-3e29-442a-8e00-39fc935e3bc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:07.988008 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ae6b7-3e29-442a-8e00-39fc935e3bc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:54:07.989629 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5ae6b7-3e29-442a-8e00-39fc935e3bc4 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:54:07.999843 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 691/1376] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:54:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 23:54:08.210459 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03dfe3-3915-47f7-9a95-fdd002981fc3 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:08.210459 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03dfe3-3915-47f7-9a95-fdd002981fc3 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:08.210459 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03dfe3-3915-47f7-9a95-fdd002981fc3 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:08.213990 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 686/1377] 10.222.0.24 () {54 vars in 961 bytes} [Mon Apr 11 23:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:54:08.219466 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b7679-e34b-4c35-9cf6-08b76c400b5c None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:08.219466 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b7679-e34b-4c35-9cf6-08b76c400b5c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:08.219466 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0b7679-e34b-4c35-9cf6-08b76c400b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:08.274196 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-3e0b7679-e34b-4c35-9cf6-08b76c400b5c None None] MFA Rules not processed for user `3a09a31262e54eec84580c7259902df1`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:08.275626 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-3e0b7679-e34b-4c35-9cf6-08b76c400b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:08.342738 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 692/1378] 10.222.0.24 () {58 vars in 1058 bytes} [Mon Apr 11 23:54:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:08.350569 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03dfe3-3915-47f7-9a95-fdd002981fc3 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:54:08.362351 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee03dfe3-3915-47f7-9a95-fdd002981fc3 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:54:08.366031 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f5e0a-df71-4757-9921-0c4cd0c70d5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:54:08.366867 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f5e0a-df71-4757-9921-0c4cd0c70d5b service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:08.367157 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f5e0a-df71-4757-9921-0c4cd0c70d5b service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:08.367408 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f5e0a-df71-4757-9921-0c4cd0c70d5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:08.378261 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f5e0a-df71-4757-9921-0c4cd0c70d5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:54:08.380090 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f5e0a-df71-4757-9921-0c4cd0c70d5b service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:54:08.402962 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 687/1379] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:54:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:54:10.521379 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c089d1-98d9-4ad5-b40d-04ff5a2c763c None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:10.521950 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c089d1-98d9-4ad5-b40d-04ff5a2c763c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:10.521950 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c089d1-98d9-4ad5-b40d-04ff5a2c763c None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:10.523751 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 693/1380] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:54:10.529654 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc005ea-2400-43b3-a384-9e931dfc10f8 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:10.530121 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc005ea-2400-43b3-a384-9e931dfc10f8 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:10.530215 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc005ea-2400-43b3-a384-9e931dfc10f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:10.548637 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-0dc005ea-2400-43b3-a384-9e931dfc10f8 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:10.549856 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-0dc005ea-2400-43b3-a384-9e931dfc10f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:10.557900 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 688/1381] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:54:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:10.606059 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c089d1-98d9-4ad5-b40d-04ff5a2c763c None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:54:10.621141 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c089d1-98d9-4ad5-b40d-04ff5a2c763c None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:54:10.626870 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74680f0-325f-4fde-be08-507e6717e9d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:54:10.627728 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74680f0-325f-4fde-be08-507e6717e9d7 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:10.628012 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74680f0-325f-4fde-be08-507e6717e9d7 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:10.628290 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74680f0-325f-4fde-be08-507e6717e9d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:10.636881 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74680f0-325f-4fde-be08-507e6717e9d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:54:10.638491 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74680f0-325f-4fde-be08-507e6717e9d7 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:54:10.648195 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 694/1382] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:54:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:54:13.116619 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1859467-0e76-4ddd-9d75-b20445197b04 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:13.117152 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1859467-0e76-4ddd-9d75-b20445197b04 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:13.117152 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1859467-0e76-4ddd-9d75-b20445197b04 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:13.118973 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 689/1383] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:54:13.124705 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527e0bc-b663-4f53-ae32-4f3a15a4c457 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:13.125106 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527e0bc-b663-4f53-ae32-4f3a15a4c457 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:13.125262 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527e0bc-b663-4f53-ae32-4f3a15a4c457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:13.142871 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-8527e0bc-b663-4f53-ae32-4f3a15a4c457 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:13.144057 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-8527e0bc-b663-4f53-ae32-4f3a15a4c457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:13.152080 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 695/1384] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:54:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:13.196036 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1859467-0e76-4ddd-9d75-b20445197b04 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:54:13.211823 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1859467-0e76-4ddd-9d75-b20445197b04 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:54:13.218179 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91e1d7-e031-41dc-b1f5-1793d64b09ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:54:13.218807 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91e1d7-e031-41dc-b1f5-1793d64b09ca service nova] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:13.219116 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91e1d7-e031-41dc-b1f5-1793d64b09ca service nova] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:13.219392 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91e1d7-e031-41dc-b1f5-1793d64b09ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:13.227989 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91e1d7-e031-41dc-b1f5-1793d64b09ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:54:13.229520 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91e1d7-e031-41dc-b1f5-1793d64b09ca service nova] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:54:13.239202 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 690/1385] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:54:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:54:15.733985 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c06b3-4a68-4fd1-94d0-69d83637a4a5 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:15.735041 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c06b3-4a68-4fd1-94d0-69d83637a4a5 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:15.735545 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c06b3-4a68-4fd1-94d0-69d83637a4a5 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:15.738377 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 696/1386] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:54:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:54:15.742771 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d406a3-c804-400e-a228-9d4afa226bb8 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:15.743236 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d406a3-c804-400e-a228-9d4afa226bb8 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:15.743362 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d406a3-c804-400e-a228-9d4afa226bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:15.761703 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-b4d406a3-c804-400e-a228-9d4afa226bb8 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:15.763532 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-b4d406a3-c804-400e-a228-9d4afa226bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:15.774483 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 691/1387] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:54:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:15.815418 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c06b3-4a68-4fd1-94d0-69d83637a4a5 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:54:15.831598 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c06b3-4a68-4fd1-94d0-69d83637a4a5 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:54:15.838325 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1242bc-b614-4008-961f-4fc278fb9744 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:54:15.839883 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1242bc-b614-4008-961f-4fc278fb9744 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:15.840230 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1242bc-b614-4008-961f-4fc278fb9744 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:15.840590 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1242bc-b614-4008-961f-4fc278fb9744 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:15.849259 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1242bc-b614-4008-961f-4fc278fb9744 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:54:15.850915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1242bc-b614-4008-961f-4fc278fb9744 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:54:15.860578 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 697/1388] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:54:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:54:18.176873 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f7a50-c1f7-41a3-ad8b-c7313364bc13 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:18.177521 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f7a50-c1f7-41a3-ad8b-c7313364bc13 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:18.177521 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f7a50-c1f7-41a3-ad8b-c7313364bc13 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:18.179242 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 692/1389] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:54:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:54:18.186192 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae029a-b262-49b0-a2a4-59715e7bdf2a None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:18.186619 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae029a-b262-49b0-a2a4-59715e7bdf2a None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:18.187068 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae029a-b262-49b0-a2a4-59715e7bdf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:18.210854 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-b1ae029a-b262-49b0-a2a4-59715e7bdf2a None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:18.212460 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-b1ae029a-b262-49b0-a2a4-59715e7bdf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:18.224404 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 698/1390] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:18.271234 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f7a50-c1f7-41a3-ad8b-c7313364bc13 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:54:18.285440 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f7a50-c1f7-41a3-ad8b-c7313364bc13 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:54:18.292090 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391c42b-69c3-4fb0-8adc-4cd3d29b979c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:54:18.292771 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391c42b-69c3-4fb0-8adc-4cd3d29b979c service nova] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:18.293013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391c42b-69c3-4fb0-8adc-4cd3d29b979c service nova] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:18.293286 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391c42b-69c3-4fb0-8adc-4cd3d29b979c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:18.302342 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391c42b-69c3-4fb0-8adc-4cd3d29b979c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:54:18.303949 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391c42b-69c3-4fb0-8adc-4cd3d29b979c service nova] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:54:18.314045 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 693/1391] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:54:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 23:54:20.810766 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55041f-51f1-4bde-96f9-9f588314eb4e None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:20.811335 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55041f-51f1-4bde-96f9-9f588314eb4e None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:20.811335 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55041f-51f1-4bde-96f9-9f588314eb4e None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:20.813116 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 699/1392] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:54:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:54:20.818247 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca8f20-4bc9-42f6-83bc-2c6f10cb26d2 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:20.819033 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca8f20-4bc9-42f6-83bc-2c6f10cb26d2 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:20.819315 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca8f20-4bc9-42f6-83bc-2c6f10cb26d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:20.837042 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-6aca8f20-4bc9-42f6-83bc-2c6f10cb26d2 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:20.838233 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-6aca8f20-4bc9-42f6-83bc-2c6f10cb26d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:20.846165 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 694/1393] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:54:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:20.890611 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55041f-51f1-4bde-96f9-9f588314eb4e None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:54:20.905570 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55041f-51f1-4bde-96f9-9f588314eb4e None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:54:20.910881 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb2f8c-5a0c-425a-89e0-5d8e8a0bb9c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:54:20.911514 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb2f8c-5a0c-425a-89e0-5d8e8a0bb9c6 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:20.911794 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb2f8c-5a0c-425a-89e0-5d8e8a0bb9c6 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:20.912075 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb2f8c-5a0c-425a-89e0-5d8e8a0bb9c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:20.920745 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb2f8c-5a0c-425a-89e0-5d8e8a0bb9c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:54:20.922313 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fb2f8c-5a0c-425a-89e0-5d8e8a0bb9c6 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:54:20.931707 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 700/1394] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:54:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:54:23.714099 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcfa56-e7a6-4d86-9830-fa4577228eb8 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:23.714731 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcfa56-e7a6-4d86-9830-fa4577228eb8 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:23.714731 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcfa56-e7a6-4d86-9830-fa4577228eb8 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:23.717109 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 695/1395] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:54:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:54:23.722232 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe02e5c-1f03-45b0-be65-a4d17d707289 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:23.722676 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe02e5c-1f03-45b0-be65-a4d17d707289 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:23.722790 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe02e5c-1f03-45b0-be65-a4d17d707289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:23.740590 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-4fe02e5c-1f03-45b0-be65-a4d17d707289 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:23.742417 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-4fe02e5c-1f03-45b0-be65-a4d17d707289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:23.750275 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 701/1396] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:54:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:23.794618 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcfa56-e7a6-4d86-9830-fa4577228eb8 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:54:23.809403 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fcfa56-e7a6-4d86-9830-fa4577228eb8 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:54:23.814816 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6910b06-1d85-4ccc-aac7-3ac2f43516af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:54:23.815467 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6910b06-1d85-4ccc-aac7-3ac2f43516af service nova] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:23.816175 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6910b06-1d85-4ccc-aac7-3ac2f43516af service nova] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:23.816175 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6910b06-1d85-4ccc-aac7-3ac2f43516af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:23.826282 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6910b06-1d85-4ccc-aac7-3ac2f43516af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:54:23.827880 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6910b06-1d85-4ccc-aac7-3ac2f43516af service nova] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:54:23.837271 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 696/1397] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:54:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:54:24.698764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78829e-7af9-478a-a5cc-a90f2019858f None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:24.699249 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78829e-7af9-478a-a5cc-a90f2019858f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:24.699526 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f78829e-7af9-478a-a5cc-a90f2019858f None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:24.702099 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 702/1398] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:54:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:54:24.707404 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21650730-88a1-4f0e-9aa3-014987a25ab1 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:24.707714 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21650730-88a1-4f0e-9aa3-014987a25ab1 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:24.707993 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21650730-88a1-4f0e-9aa3-014987a25ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:24.726910 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-21650730-88a1-4f0e-9aa3-014987a25ab1 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:24.728121 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-21650730-88a1-4f0e-9aa3-014987a25ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:24.736844 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 697/1399] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:24.794282 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15087d24-6865-4dba-857a-5ad7873c054d None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:24.794723 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15087d24-6865-4dba-857a-5ad7873c054d None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:24.794914 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15087d24-6865-4dba-857a-5ad7873c054d None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:24.796606 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 703/1400] 10.222.0.24 () {54 vars in 961 bytes} [Mon Apr 11 23:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:54:24.801580 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75b661-2983-46c7-9237-f488ad22f8c6 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:24.802254 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75b661-2983-46c7-9237-f488ad22f8c6 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:24.802460 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75b661-2983-46c7-9237-f488ad22f8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:24.854306 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-aa75b661-2983-46c7-9237-f488ad22f8c6 None None] MFA Rules not processed for user `a2ad9c7f930e426bb908237f72c04a2e`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:24.855568 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-aa75b661-2983-46c7-9237-f488ad22f8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:24.913392 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 698/1401] 10.222.0.24 () {58 vars in 1058 bytes} [Mon Apr 11 23:54:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:24.920847 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15087d24-6865-4dba-857a-5ad7873c054d None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:54:24.931335 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15087d24-6865-4dba-857a-5ad7873c054d None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:54:24.935394 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb25ec2-4857-4adb-b686-728505db3326 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2ad9c7f930e426bb908237f72c04a2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:54:24.936032 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb25ec2-4857-4adb-b686-728505db3326 service glance] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:24.936312 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb25ec2-4857-4adb-b686-728505db3326 service glance] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:24.936589 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb25ec2-4857-4adb-b686-728505db3326 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:24.945583 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb25ec2-4857-4adb-b686-728505db3326 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:54:24.947053 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb25ec2-4857-4adb-b686-728505db3326 service glance] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:54:24.957216 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 704/1402] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:54:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:54:25.510140 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadf9c7-a215-4e17-85a0-5941678721a2 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:25.510432 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadf9c7-a215-4e17-85a0-5941678721a2 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:25.510711 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadf9c7-a215-4e17-85a0-5941678721a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:25.558124 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-baadf9c7-a215-4e17-85a0-5941678721a2 None None] MFA Rules not processed for user `5c7b25e0e29143d783553859a0583d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:25.559894 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-baadf9c7-a215-4e17-85a0-5941678721a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:25.620759 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 699/1403] 10.222.0.24 () {58 vars in 1009 bytes} [Mon Apr 11 23:54:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:25.665218 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7243a9e-6aae-4976-ae9f-cc9e79bd7976 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:25.665509 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7243a9e-6aae-4976-ae9f-cc9e79bd7976 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:25.665787 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7243a9e-6aae-4976-ae9f-cc9e79bd7976 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:25.667616 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 705/1404] 10.222.0.24 () {54 vars in 942 bytes} [Mon Apr 11 23:54:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:54:25.674123 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdd48a-03e6-4549-b350-7cd1720c2121 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:25.674414 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdd48a-03e6-4549-b350-7cd1720c2121 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:25.674686 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fdd48a-03e6-4549-b350-7cd1720c2121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:25.722249 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-d8fdd48a-03e6-4549-b350-7cd1720c2121 None None] MFA Rules not processed for user `189d616b38304d91bf1c7aded81205e3`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:25.723735 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d8fdd48a-03e6-4549-b350-7cd1720c2121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:25.793285 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 700/1405] 10.222.0.24 () {58 vars in 1039 bytes} [Mon Apr 11 23:54:25 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:25.803146 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7243a9e-6aae-4976-ae9f-cc9e79bd7976 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:54:25.816799 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7243a9e-6aae-4976-ae9f-cc9e79bd7976 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:54:25.821777 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac55ef8-bd53-4ecf-a573-741f17f8c4d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d616b38304d91bf1c7aded81205e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:54:25.822409 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac55ef8-bd53-4ecf-a573-741f17f8c4d1 service swift] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:25.822690 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac55ef8-bd53-4ecf-a573-741f17f8c4d1 service swift] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:25.823006 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac55ef8-bd53-4ecf-a573-741f17f8c4d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:25.830948 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac55ef8-bd53-4ecf-a573-741f17f8c4d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:54:25.832549 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac55ef8-bd53-4ecf-a573-741f17f8c4d1 service swift] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:54:25.840393 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 706/1406] 10.222.0.24 () {60 vars in 1384 bytes} [Mon Apr 11 23:54:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 11 23:54:26.268900 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0bcd3-39d7-41c0-aea2-3199590a3a05 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:26.269215 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0bcd3-39d7-41c0-aea2-3199590a3a05 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:26.269491 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf0bcd3-39d7-41c0-aea2-3199590a3a05 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:26.271510 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 701/1407] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:54:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:54:26.276726 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c9b4-83af-4a6c-a293-cc47c0380321 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:26.277021 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c9b4-83af-4a6c-a293-cc47c0380321 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:26.277305 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462c9b4-83af-4a6c-a293-cc47c0380321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:26.297600 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-d462c9b4-83af-4a6c-a293-cc47c0380321 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:26.298966 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d462c9b4-83af-4a6c-a293-cc47c0380321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:26.310880 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 707/1408] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:54:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:26.351500 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0bcd3-39d7-41c0-aea2-3199590a3a05 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:54:26.365740 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf0bcd3-39d7-41c0-aea2-3199590a3a05 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:54:26.371274 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5cee0-c8f0-4aab-9031-451162d21aa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:54:26.371947 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5cee0-c8f0-4aab-9031-451162d21aa4 service nova] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:26.372279 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5cee0-c8f0-4aab-9031-451162d21aa4 service nova] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:26.372594 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5cee0-c8f0-4aab-9031-451162d21aa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:26.382727 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5cee0-c8f0-4aab-9031-451162d21aa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:54:26.384392 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b5cee0-c8f0-4aab-9031-451162d21aa4 service nova] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:54:26.395044 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 702/1409] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:54:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:54:28.887064 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba35c95-93ca-4418-afa4-8db0c0fc1458 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:28.888167 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba35c95-93ca-4418-afa4-8db0c0fc1458 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:28.888167 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba35c95-93ca-4418-afa4-8db0c0fc1458 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:28.890401 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 708/1410] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:54:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:54:28.896054 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76eddb0-658f-4f8f-a8ad-87f20068d099 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:28.896555 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76eddb0-658f-4f8f-a8ad-87f20068d099 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:28.896805 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76eddb0-658f-4f8f-a8ad-87f20068d099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:28.915599 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-d76eddb0-658f-4f8f-a8ad-87f20068d099 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:28.916908 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d76eddb0-658f-4f8f-a8ad-87f20068d099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:28.933958 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 703/1411] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:54:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:28.969839 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba35c95-93ca-4418-afa4-8db0c0fc1458 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:54:28.984356 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba35c95-93ca-4418-afa4-8db0c0fc1458 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:54:28.989774 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2053322-15c9-4543-8ee3-c96ceba23fbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:54:28.990407 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2053322-15c9-4543-8ee3-c96ceba23fbf service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:28.990686 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2053322-15c9-4543-8ee3-c96ceba23fbf service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:28.990990 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2053322-15c9-4543-8ee3-c96ceba23fbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:28.999662 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2053322-15c9-4543-8ee3-c96ceba23fbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:54:29.001346 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2053322-15c9-4543-8ee3-c96ceba23fbf service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:54:29.011826 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 709/1412] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:54:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:54:50.313979 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af938f70-e309-45f4-b616-5c07f167a5b4 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:50.314646 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af938f70-e309-45f4-b616-5c07f167a5b4 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:50.314646 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af938f70-e309-45f4-b616-5c07f167a5b4 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:50.316428 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 704/1413] 10.222.0.24 () {54 vars in 918 bytes} [Mon Apr 11 23:54:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:54:50.321690 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae139c-7d6a-4348-8f1a-3684fe81b977 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:50.322117 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae139c-7d6a-4348-8f1a-3684fe81b977 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:50.322219 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae139c-7d6a-4348-8f1a-3684fe81b977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:50.340472 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-d4ae139c-7d6a-4348-8f1a-3684fe81b977 None None] MFA Rules not processed for user `47515442e0e84441bed4bfbb7a3b4ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:50.341666 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d4ae139c-7d6a-4348-8f1a-3684fe81b977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:50.350565 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 710/1414] 10.222.0.24 () {58 vars in 1015 bytes} [Mon Apr 11 23:54:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:50.365239 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d717866-87b9-4096-b52c-bf7c46015d52 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:50.365527 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d717866-87b9-4096-b52c-bf7c46015d52 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:50.365809 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d717866-87b9-4096-b52c-bf7c46015d52 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:50.367702 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 705/1415] 10.222.0.24 () {54 vars in 918 bytes} [Mon Apr 11 23:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:54:50.372383 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e8a70-ea72-4877-b36e-3eba6de82392 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:50.372671 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e8a70-ea72-4877-b36e-3eba6de82392 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:50.372946 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e8a70-ea72-4877-b36e-3eba6de82392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:50.390507 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-202e8a70-ea72-4877-b36e-3eba6de82392 None None] MFA Rules not processed for user `a9519f49f897415a894c1121278dda9c`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:50.391785 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-202e8a70-ea72-4877-b36e-3eba6de82392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:50.400745 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 711/1416] 10.222.0.24 () {58 vars in 1015 bytes} [Mon Apr 11 23:54:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 23:54:53.172738 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f1f33-87e4-40a4-ab17-c152212e0025 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:53.173287 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f1f33-87e4-40a4-ab17-c152212e0025 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:53.173287 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f1f33-87e4-40a4-ab17-c152212e0025 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:53.175225 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 23:54:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:54:53.180416 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640da90-bdcc-462b-82fc-074473a0febc None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:53.180813 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640da90-bdcc-462b-82fc-074473a0febc None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:53.180971 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640da90-bdcc-462b-82fc-074473a0febc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:53.198734 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-c640da90-bdcc-462b-82fc-074473a0febc None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:53.200523 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-c640da90-bdcc-462b-82fc-074473a0febc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:53.209114 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 23:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:53.253934 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f1f33-87e4-40a4-ab17-c152212e0025 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:54:53.268600 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f1f33-87e4-40a4-ab17-c152212e0025 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:54:53.273973 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4b2a2-93a0-41a8-afd5-8e25ff92cd67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:54:53.274592 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4b2a2-93a0-41a8-afd5-8e25ff92cd67 service nova] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:53.274900 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4b2a2-93a0-41a8-afd5-8e25ff92cd67 service nova] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:53.275175 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4b2a2-93a0-41a8-afd5-8e25ff92cd67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:53.283146 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4b2a2-93a0-41a8-afd5-8e25ff92cd67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:54:53.284709 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4b2a2-93a0-41a8-afd5-8e25ff92cd67 service nova] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:54:53.293889 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 707/1419] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:54:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:54:54.635327 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570e3d2-d0f6-4484-b7dc-a4bdbbbb966b None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:54.635899 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570e3d2-d0f6-4484-b7dc-a4bdbbbb966b None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:54.635899 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570e3d2-d0f6-4484-b7dc-a4bdbbbb966b None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:54.637696 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 23:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:54:54.642757 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56794b09-9a92-4558-8628-04006669c752 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:54.643210 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56794b09-9a92-4558-8628-04006669c752 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:54.643320 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56794b09-9a92-4558-8628-04006669c752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:54.660923 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-56794b09-9a92-4558-8628-04006669c752 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:54.662111 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-56794b09-9a92-4558-8628-04006669c752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:54.670382 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 23:54:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:54.861358 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570e3d2-d0f6-4484-b7dc-a4bdbbbb966b None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:54:54.876014 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570e3d2-d0f6-4484-b7dc-a4bdbbbb966b None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:54:54.881354 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4302d952-d8ba-4a36-aeec-00fd008cc1b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:54:54.881986 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302d952-d8ba-4a36-aeec-00fd008cc1b5 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:54.882259 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302d952-d8ba-4a36-aeec-00fd008cc1b5 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:54.882522 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4302d952-d8ba-4a36-aeec-00fd008cc1b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:54.891389 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302d952-d8ba-4a36-aeec-00fd008cc1b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:54:54.892872 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4302d952-d8ba-4a36-aeec-00fd008cc1b5 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:54:54.903107 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 714/1422] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:54:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:54:56.203118 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd663034-c50e-404f-968d-e0785f5bab78 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:56.203717 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd663034-c50e-404f-968d-e0785f5bab78 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:56.203717 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd663034-c50e-404f-968d-e0785f5bab78 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:56.205454 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 23:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:54:56.210354 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58547af-54a4-41dc-96c9-b434090b32f5 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:56.210758 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58547af-54a4-41dc-96c9-b434090b32f5 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:56.210998 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58547af-54a4-41dc-96c9-b434090b32f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:56.229833 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-a58547af-54a4-41dc-96c9-b434090b32f5 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:56.231652 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a58547af-54a4-41dc-96c9-b434090b32f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:56.239345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 23:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:56.388577 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd663034-c50e-404f-968d-e0785f5bab78 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:54:56.403215 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd663034-c50e-404f-968d-e0785f5bab78 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:54:56.408514 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c79d76-fcfc-499d-8280-8b683d851fc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:54:56.409141 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c79d76-fcfc-499d-8280-8b683d851fc0 service nova] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:56.409425 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c79d76-fcfc-499d-8280-8b683d851fc0 service nova] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:56.409695 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c79d76-fcfc-499d-8280-8b683d851fc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:56.417669 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c79d76-fcfc-499d-8280-8b683d851fc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:54:56.419864 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c79d76-fcfc-499d-8280-8b683d851fc0 service nova] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:54:56.429013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 710/1425] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:54:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:54:57.729555 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee99b8-9cc5-462b-bb8f-a596c284e48b None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:57.730119 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee99b8-9cc5-462b-bb8f-a596c284e48b None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:57.730119 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ee99b8-9cc5-462b-bb8f-a596c284e48b None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:57.731991 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 23:54:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:54:57.736822 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e7992-06be-4047-835e-ecc8c7c2ec00 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:57.737261 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e7992-06be-4047-835e-ecc8c7c2ec00 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:57.737368 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e7992-06be-4047-835e-ecc8c7c2ec00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:57.755409 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-cd4e7992-06be-4047-835e-ecc8c7c2ec00 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:57.756580 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-cd4e7992-06be-4047-835e-ecc8c7c2ec00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:57.764914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 23:54:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:57.914509 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee99b8-9cc5-462b-bb8f-a596c284e48b None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:54:57.928278 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ee99b8-9cc5-462b-bb8f-a596c284e48b None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:54:57.935319 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a64d4c-465e-409b-9b86-aba9e0710b00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:54:57.935954 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a64d4c-465e-409b-9b86-aba9e0710b00 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:57.936233 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a64d4c-465e-409b-9b86-aba9e0710b00 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:57.936506 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a64d4c-465e-409b-9b86-aba9e0710b00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:57.944685 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a64d4c-465e-409b-9b86-aba9e0710b00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:54:57.946239 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a64d4c-465e-409b-9b86-aba9e0710b00 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:54:57.956114 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 717/1428] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:54:59.270578 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd165b7f-dd1c-45e6-81d3-37bba732fb01 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:59.271202 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd165b7f-dd1c-45e6-81d3-37bba732fb01 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:59.271202 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd165b7f-dd1c-45e6-81d3-37bba732fb01 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:59.272929 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 23:54:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 11 23:54:59.278424 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6292cf-3cec-4cf1-a9ac-ab94a8afdd32 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:59.278927 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6292cf-3cec-4cf1-a9ac-ab94a8afdd32 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:59.279025 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6292cf-3cec-4cf1-a9ac-ab94a8afdd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:59.297466 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-ba6292cf-3cec-4cf1-a9ac-ab94a8afdd32 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:54:59.298650 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-ba6292cf-3cec-4cf1-a9ac-ab94a8afdd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:54:59.306405 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 23:54:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:54:59.454021 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd165b7f-dd1c-45e6-81d3-37bba732fb01 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:54:59.468600 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd165b7f-dd1c-45e6-81d3-37bba732fb01 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:54:59.474212 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be684bea-8484-443a-a9b7-a7daf42d1cf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:54:59.474850 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be684bea-8484-443a-a9b7-a7daf42d1cf3 service nova] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:54:59.475133 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be684bea-8484-443a-a9b7-a7daf42d1cf3 service nova] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:54:59.475402 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be684bea-8484-443a-a9b7-a7daf42d1cf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:54:59.483895 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be684bea-8484-443a-a9b7-a7daf42d1cf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:54:59.485445 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be684bea-8484-443a-a9b7-a7daf42d1cf3 service nova] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:54:59.494558 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 713/1431] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:54:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:55:00.799096 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a042387-2a52-4bcd-a844-f104aba4f734 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:00.799541 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a042387-2a52-4bcd-a844-f104aba4f734 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:00.799655 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a042387-2a52-4bcd-a844-f104aba4f734 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:00.801437 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 23:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:55:00.806433 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e5dee-dc42-47da-9f4b-6dd99c891d27 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:00.806888 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e5dee-dc42-47da-9f4b-6dd99c891d27 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:00.806993 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251e5dee-dc42-47da-9f4b-6dd99c891d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:00.825352 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-251e5dee-dc42-47da-9f4b-6dd99c891d27 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:55:00.826517 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-251e5dee-dc42-47da-9f4b-6dd99c891d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:55:00.834073 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 23:55:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:55:00.982096 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a042387-2a52-4bcd-a844-f104aba4f734 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:55:00.995930 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a042387-2a52-4bcd-a844-f104aba4f734 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:55:01.001660 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b7cd0-ff78-439c-93e4-4855231176e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:55:01.002280 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b7cd0-ff78-439c-93e4-4855231176e1 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:01.002554 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b7cd0-ff78-439c-93e4-4855231176e1 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:01.002825 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b7cd0-ff78-439c-93e4-4855231176e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:01.010617 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b7cd0-ff78-439c-93e4-4855231176e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:55:01.012845 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b7cd0-ff78-439c-93e4-4855231176e1 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:55:01.022163 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 720/1434] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:55:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:55:02.328523 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec81fb-cd58-477c-af88-4e71c96019a3 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:02.329061 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec81fb-cd58-477c-af88-4e71c96019a3 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:02.329061 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec81fb-cd58-477c-af88-4e71c96019a3 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:02.331048 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 23:55:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:55:02.338144 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a5dc6-c6de-45d2-8677-4b2ddc65b673 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:02.338144 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a5dc6-c6de-45d2-8677-4b2ddc65b673 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:02.338144 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a5dc6-c6de-45d2-8677-4b2ddc65b673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:02.355320 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-d88a5dc6-c6de-45d2-8677-4b2ddc65b673 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:55:02.357107 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d88a5dc6-c6de-45d2-8677-4b2ddc65b673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:55:02.364905 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 23:55:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:55:02.512562 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec81fb-cd58-477c-af88-4e71c96019a3 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:55:02.526382 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec81fb-cd58-477c-af88-4e71c96019a3 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:55:02.532160 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66b88a4-58a7-4468-a1a0-ff3b3400d365 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:55:02.532779 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b88a4-58a7-4468-a1a0-ff3b3400d365 service nova] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:02.533054 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b88a4-58a7-4468-a1a0-ff3b3400d365 service nova] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:02.533326 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66b88a4-58a7-4468-a1a0-ff3b3400d365 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:02.541196 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b88a4-58a7-4468-a1a0-ff3b3400d365 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:55:02.542742 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66b88a4-58a7-4468-a1a0-ff3b3400d365 service nova] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:55:02.552389 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 716/1437] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:55:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:55:03.876560 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2067481-2028-4c90-b6eb-286dbba8f431 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:03.877087 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2067481-2028-4c90-b6eb-286dbba8f431 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:03.877214 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2067481-2028-4c90-b6eb-286dbba8f431 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:03.878993 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 23:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:55:03.883923 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcfb49-f591-4acf-9645-980479b55d3c None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:03.884331 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcfb49-f591-4acf-9645-980479b55d3c None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:03.884469 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dcfb49-f591-4acf-9645-980479b55d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:03.903491 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-88dcfb49-f591-4acf-9645-980479b55d3c None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:55:03.904667 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-88dcfb49-f591-4acf-9645-980479b55d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:55:03.912242 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 23:55:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:55:04.060104 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2067481-2028-4c90-b6eb-286dbba8f431 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:55:04.074562 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2067481-2028-4c90-b6eb-286dbba8f431 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:55:04.080059 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718d2560-4925-4897-b6e5-eb76a8acba11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:55:04.080700 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d2560-4925-4897-b6e5-eb76a8acba11 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:04.080979 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d2560-4925-4897-b6e5-eb76a8acba11 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:04.081252 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718d2560-4925-4897-b6e5-eb76a8acba11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:04.090947 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d2560-4925-4897-b6e5-eb76a8acba11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:55:04.091514 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718d2560-4925-4897-b6e5-eb76a8acba11 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:55:04.101078 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 723/1440] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:55:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:55:05.586756 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6eb5b4-8661-42bf-8381-9f06b9961457 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:05.587355 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6eb5b4-8661-42bf-8381-9f06b9961457 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:05.587355 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6eb5b4-8661-42bf-8381-9f06b9961457 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:05.589125 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 23:55:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:55:05.594603 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73632c11-9c97-4361-98a3-507a09071052 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:05.595005 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73632c11-9c97-4361-98a3-507a09071052 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:05.595208 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73632c11-9c97-4361-98a3-507a09071052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:05.613162 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-73632c11-9c97-4361-98a3-507a09071052 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:55:05.614365 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-73632c11-9c97-4361-98a3-507a09071052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:55:05.622024 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 23:55:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:55:05.769974 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6eb5b4-8661-42bf-8381-9f06b9961457 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:55:05.784622 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6eb5b4-8661-42bf-8381-9f06b9961457 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:55:05.789978 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3021bee-9a0f-41f9-a1a9-eeec257e23d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:55:05.790606 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3021bee-9a0f-41f9-a1a9-eeec257e23d6 service nova] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:05.790910 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3021bee-9a0f-41f9-a1a9-eeec257e23d6 service nova] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:05.791188 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3021bee-9a0f-41f9-a1a9-eeec257e23d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:05.799123 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3021bee-9a0f-41f9-a1a9-eeec257e23d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:55:05.800687 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3021bee-9a0f-41f9-a1a9-eeec257e23d6 service nova] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:55:05.809918 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 719/1443] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:55:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:55:07.977767 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf81190-32b6-479a-9892-d556dc9a0168 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:07.978243 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf81190-32b6-479a-9892-d556dc9a0168 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:07.978339 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf81190-32b6-479a-9892-d556dc9a0168 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:07.980133 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 23:55:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:55:07.986647 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe9e4b-325b-46d4-a325-172ed178531e None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:07.987105 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe9e4b-325b-46d4-a325-172ed178531e None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:07.987221 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe9e4b-325b-46d4-a325-172ed178531e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:08.005087 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-6cbe9e4b-325b-46d4-a325-172ed178531e None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:55:08.006265 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-6cbe9e4b-325b-46d4-a325-172ed178531e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:55:08.013978 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 23:55:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 23:55:08.050964 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf81190-32b6-479a-9892-d556dc9a0168 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:55:08.061926 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf81190-32b6-479a-9892-d556dc9a0168 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:55:08.065502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bbd85-18e9-4991-8888-9b12984d0c23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:55:08.066127 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bbd85-18e9-4991-8888-9b12984d0c23 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:08.066403 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bbd85-18e9-4991-8888-9b12984d0c23 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:08.066675 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bbd85-18e9-4991-8888-9b12984d0c23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:08.075350 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bbd85-18e9-4991-8888-9b12984d0c23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:55:08.076756 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bbd85-18e9-4991-8888-9b12984d0c23 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:55:08.085875 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 726/1446] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:55:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:55:10.481668 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350ecfc-dbcc-4267-934f-f2d4057fa7e5 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:10.482275 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350ecfc-dbcc-4267-934f-f2d4057fa7e5 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:10.482275 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350ecfc-dbcc-4267-934f-f2d4057fa7e5 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:10.484123 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 23:55:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:55:10.489235 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b82584-e530-446b-8e1d-84b7319a5887 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:10.489674 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b82584-e530-446b-8e1d-84b7319a5887 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:10.489818 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b82584-e530-446b-8e1d-84b7319a5887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:10.507138 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-51b82584-e530-446b-8e1d-84b7319a5887 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:55:10.508316 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-51b82584-e530-446b-8e1d-84b7319a5887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:55:10.515889 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 23:55:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:55:10.554286 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350ecfc-dbcc-4267-934f-f2d4057fa7e5 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:55:10.564880 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350ecfc-dbcc-4267-934f-f2d4057fa7e5 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:55:10.568319 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80e8918-7957-4887-a45c-9fc720a40cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:55:10.568941 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e8918-7957-4887-a45c-9fc720a40cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:10.569220 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e8918-7957-4887-a45c-9fc720a40cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:10.569490 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80e8918-7957-4887-a45c-9fc720a40cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:10.578617 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e8918-7957-4887-a45c-9fc720a40cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:55:10.580055 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80e8918-7957-4887-a45c-9fc720a40cc2 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:55:10.589235 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 722/1449] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:55:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:55:13.243681 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f03ad2-df68-4dce-8aad-616180002cef None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:13.244245 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f03ad2-df68-4dce-8aad-616180002cef None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:13.244245 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f03ad2-df68-4dce-8aad-616180002cef None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:13.246138 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 23:55:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:55:13.251562 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162e2f5-1a80-450b-bb74-1d384e3989cd None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:13.252006 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162e2f5-1a80-450b-bb74-1d384e3989cd None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:13.252104 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162e2f5-1a80-450b-bb74-1d384e3989cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:13.270174 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-c162e2f5-1a80-450b-bb74-1d384e3989cd None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:55:13.271398 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-c162e2f5-1a80-450b-bb74-1d384e3989cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:55:13.279809 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 23:55:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:55:13.317291 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f03ad2-df68-4dce-8aad-616180002cef None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:55:13.328202 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f03ad2-df68-4dce-8aad-616180002cef None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:55:13.331768 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827efed2-350a-4f42-b4b8-959f8ca8a9db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:55:13.332395 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827efed2-350a-4f42-b4b8-959f8ca8a9db service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:13.332674 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827efed2-350a-4f42-b4b8-959f8ca8a9db service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:13.332946 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827efed2-350a-4f42-b4b8-959f8ca8a9db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:13.342276 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827efed2-350a-4f42-b4b8-959f8ca8a9db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:55:13.343724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827efed2-350a-4f42-b4b8-959f8ca8a9db service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:55:13.353149 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 729/1452] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:55:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:55:15.767774 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513f7a7-8a2e-4f1b-9ec2-bddf6a0d38e9 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:15.768321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513f7a7-8a2e-4f1b-9ec2-bddf6a0d38e9 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:15.768321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513f7a7-8a2e-4f1b-9ec2-bddf6a0d38e9 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:15.770410 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 23:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:55:15.775507 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7fd14-83a0-413a-85c1-b7e2adff4d77 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:15.775901 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7fd14-83a0-413a-85c1-b7e2adff4d77 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:15.776047 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd7fd14-83a0-413a-85c1-b7e2adff4d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:15.794361 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-3fd7fd14-83a0-413a-85c1-b7e2adff4d77 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:55:15.795558 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-3fd7fd14-83a0-413a-85c1-b7e2adff4d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:55:15.803241 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 23:55:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:55:15.841113 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513f7a7-8a2e-4f1b-9ec2-bddf6a0d38e9 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:55:15.851952 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513f7a7-8a2e-4f1b-9ec2-bddf6a0d38e9 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:55:15.856150 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d7764-7863-4a22-bd8d-2212b57083a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:55:15.856774 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d7764-7863-4a22-bd8d-2212b57083a0 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:15.857052 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d7764-7863-4a22-bd8d-2212b57083a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:15.857327 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d7764-7863-4a22-bd8d-2212b57083a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:15.866071 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d7764-7863-4a22-bd8d-2212b57083a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:55:15.867516 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6d7764-7863-4a22-bd8d-2212b57083a0 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:55:15.876695 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 725/1455] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:55:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:55:18.204672 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4148d00-1293-407e-96b5-7999019b9e2c None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:18.205206 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4148d00-1293-407e-96b5-7999019b9e2c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:18.205206 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4148d00-1293-407e-96b5-7999019b9e2c None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:18.207038 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 23:55:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:55:18.212131 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ce6a3-3f59-4c4e-b635-7f79e7aed9da None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:18.212535 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ce6a3-3f59-4c4e-b635-7f79e7aed9da None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:18.212674 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ce6a3-3f59-4c4e-b635-7f79e7aed9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:18.230249 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-229ce6a3-3f59-4c4e-b635-7f79e7aed9da None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:55:18.231457 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-229ce6a3-3f59-4c4e-b635-7f79e7aed9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:55:18.239087 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 23:55:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:55:18.276362 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4148d00-1293-407e-96b5-7999019b9e2c None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:55:18.286729 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4148d00-1293-407e-96b5-7999019b9e2c None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:55:18.290211 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff6777-4bdd-4f3e-ad12-08f47de4ecbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:55:18.290848 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff6777-4bdd-4f3e-ad12-08f47de4ecbd service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:18.291139 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff6777-4bdd-4f3e-ad12-08f47de4ecbd service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:18.291411 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff6777-4bdd-4f3e-ad12-08f47de4ecbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:18.300509 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff6777-4bdd-4f3e-ad12-08f47de4ecbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:55:18.301915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff6777-4bdd-4f3e-ad12-08f47de4ecbd service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:55:18.311685 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 732/1458] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:55:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:55:20.631772 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a348d-fb14-4a7f-8f42-17a8739c4cbb None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:20.632309 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a348d-fb14-4a7f-8f42-17a8739c4cbb None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:20.632309 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a348d-fb14-4a7f-8f42-17a8739c4cbb None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:20.634090 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 23:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:55:20.640074 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3a4a2-9c18-427a-8964-f8f37810a6dd None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:20.640489 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3a4a2-9c18-427a-8964-f8f37810a6dd None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:20.640615 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3a4a2-9c18-427a-8964-f8f37810a6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:20.658459 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-74f3a4a2-9c18-427a-8964-f8f37810a6dd None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:55:20.659655 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-74f3a4a2-9c18-427a-8964-f8f37810a6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:55:20.667193 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 23:55:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:55:20.704701 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a348d-fb14-4a7f-8f42-17a8739c4cbb None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:55:20.715477 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a348d-fb14-4a7f-8f42-17a8739c4cbb None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:55:20.718890 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e9d2b-7d5e-40b0-a439-37762f59fba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:55:20.719508 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e9d2b-7d5e-40b0-a439-37762f59fba0 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:20.719782 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e9d2b-7d5e-40b0-a439-37762f59fba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:20.720050 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e9d2b-7d5e-40b0-a439-37762f59fba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:20.728830 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e9d2b-7d5e-40b0-a439-37762f59fba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:55:20.730247 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e9d2b-7d5e-40b0-a439-37762f59fba0 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:55:20.739333 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 728/1461] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:55:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:55:23.060732 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4d1ca-d241-4e22-ad81-5f9b43523a99 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:23.061284 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4d1ca-d241-4e22-ad81-5f9b43523a99 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:23.061284 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4d1ca-d241-4e22-ad81-5f9b43523a99 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:23.063024 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 23:55:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:55:23.068163 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168bfc3-2299-4366-ba16-2dc4cb65d2c0 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:23.068572 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168bfc3-2299-4366-ba16-2dc4cb65d2c0 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:23.068710 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168bfc3-2299-4366-ba16-2dc4cb65d2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:23.089078 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-8168bfc3-2299-4366-ba16-2dc4cb65d2c0 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:55:23.091868 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-8168bfc3-2299-4366-ba16-2dc4cb65d2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:55:23.100938 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 23:55:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:55:23.138462 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4d1ca-d241-4e22-ad81-5f9b43523a99 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:55:23.149111 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4d1ca-d241-4e22-ad81-5f9b43523a99 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:55:23.153283 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476561df-de17-4ef6-97f1-f39912a37e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:55:23.153912 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476561df-de17-4ef6-97f1-f39912a37e85 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:23.154194 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476561df-de17-4ef6-97f1-f39912a37e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:23.154471 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476561df-de17-4ef6-97f1-f39912a37e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:23.163266 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476561df-de17-4ef6-97f1-f39912a37e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:55:23.164671 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476561df-de17-4ef6-97f1-f39912a37e85 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:55:23.173831 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 735/1464] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:55:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:55:25.478447 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73584a7e-0016-4027-914b-fbc1fc8622c8 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:25.479038 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73584a7e-0016-4027-914b-fbc1fc8622c8 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:25.479038 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73584a7e-0016-4027-914b-fbc1fc8622c8 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:25.480909 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 23:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:55:25.486158 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b90d3e-23b6-4b5a-ad22-3bf63ee44cae None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:25.486602 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b90d3e-23b6-4b5a-ad22-3bf63ee44cae None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:25.486713 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b90d3e-23b6-4b5a-ad22-3bf63ee44cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:25.504384 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-57b90d3e-23b6-4b5a-ad22-3bf63ee44cae None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:55:25.505541 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-57b90d3e-23b6-4b5a-ad22-3bf63ee44cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:55:25.513570 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 23:55:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:55:25.549072 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73584a7e-0016-4027-914b-fbc1fc8622c8 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:55:25.559978 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73584a7e-0016-4027-914b-fbc1fc8622c8 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:55:25.563570 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0a7af5-19ba-470c-bfe4-4f3c81bff3ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:55:25.564182 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a7af5-19ba-470c-bfe4-4f3c81bff3ae service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:25.564455 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a7af5-19ba-470c-bfe4-4f3c81bff3ae service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:25.564726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0a7af5-19ba-470c-bfe4-4f3c81bff3ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:25.573262 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a7af5-19ba-470c-bfe4-4f3c81bff3ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:55:25.575306 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0a7af5-19ba-470c-bfe4-4f3c81bff3ae service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:55:25.584338 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 731/1467] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:55:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:55:27.888187 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb88d72-8b3e-4f95-b975-bc9a102a9831 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:27.888730 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb88d72-8b3e-4f95-b975-bc9a102a9831 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:27.888730 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb88d72-8b3e-4f95-b975-bc9a102a9831 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:27.890489 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 23:55:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:55:27.895672 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b2255-2533-4980-9f12-0d75fb26c494 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:27.896103 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b2255-2533-4980-9f12-0d75fb26c494 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:27.896218 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b2255-2533-4980-9f12-0d75fb26c494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:27.913551 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-3f4b2255-2533-4980-9f12-0d75fb26c494 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:55:27.914726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-3f4b2255-2533-4980-9f12-0d75fb26c494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:55:27.922517 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 23:55:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 23:55:27.958723 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb88d72-8b3e-4f95-b975-bc9a102a9831 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:55:27.969154 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb88d72-8b3e-4f95-b975-bc9a102a9831 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:55:27.972693 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a4569-695d-465d-ac16-8313a4eb015d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:55:27.973316 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a4569-695d-465d-ac16-8313a4eb015d service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:27.973596 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a4569-695d-465d-ac16-8313a4eb015d service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:27.974129 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a4569-695d-465d-ac16-8313a4eb015d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:27.982747 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a4569-695d-465d-ac16-8313a4eb015d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:55:27.984187 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a4569-695d-465d-ac16-8313a4eb015d service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:55:27.993408 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 738/1470] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:55:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:55:30.283999 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18555c44-83d7-4451-b5f7-a3e985e6c02a None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:30.284527 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18555c44-83d7-4451-b5f7-a3e985e6c02a None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:30.284527 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18555c44-83d7-4451-b5f7-a3e985e6c02a None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:30.286270 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 733/1471] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 23:55:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:55:30.291760 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c214e51-aa7a-4d06-a8d8-54dea7d9dd32 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:30.292142 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c214e51-aa7a-4d06-a8d8-54dea7d9dd32 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:30.292314 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c214e51-aa7a-4d06-a8d8-54dea7d9dd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:30.311458 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-1c214e51-aa7a-4d06-a8d8-54dea7d9dd32 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:55:30.312639 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1c214e51-aa7a-4d06-a8d8-54dea7d9dd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:55:30.321374 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 739/1472] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 23:55:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:55:30.358248 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18555c44-83d7-4451-b5f7-a3e985e6c02a None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:55:30.369016 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18555c44-83d7-4451-b5f7-a3e985e6c02a None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:55:30.372648 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb3af8e-e74d-47f6-8cb1-bcc6ef27f25f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:55:30.373269 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3af8e-e74d-47f6-8cb1-bcc6ef27f25f service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:30.373542 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3af8e-e74d-47f6-8cb1-bcc6ef27f25f service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:30.373810 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb3af8e-e74d-47f6-8cb1-bcc6ef27f25f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:30.382806 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3af8e-e74d-47f6-8cb1-bcc6ef27f25f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:55:30.384309 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb3af8e-e74d-47f6-8cb1-bcc6ef27f25f service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:55:30.394107 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 734/1473] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:55:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:55:47.552281 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3023c2-d152-434d-b3b7-422f23a1f55c None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:47.552879 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3023c2-d152-434d-b3b7-422f23a1f55c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:47.552879 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3023c2-d152-434d-b3b7-422f23a1f55c None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:47.554594 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 740/1474] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:55:47.560232 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3ce23-51d7-4036-bd55-70e89fded911 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:47.560683 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3ce23-51d7-4036-bd55-70e89fded911 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:47.560784 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3ce23-51d7-4036-bd55-70e89fded911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:47.578003 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-d3a3ce23-51d7-4036-bd55-70e89fded911 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:55:47.579216 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d3a3ce23-51d7-4036-bd55-70e89fded911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:55:47.586862 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 735/1475] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:55:47.633323 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd0951-d9dc-4730-912b-b4f8cd7f8a5f None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:47.633606 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd0951-d9dc-4730-912b-b4f8cd7f8a5f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:47.633880 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd0951-d9dc-4730-912b-b4f8cd7f8a5f None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:47.635665 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 741/1476] 10.222.0.24 () {54 vars in 961 bytes} [Mon Apr 11 23:55:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:55:47.640392 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44f834-d8c9-4395-9a37-479f8a034a1f None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:47.640680 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44f834-d8c9-4395-9a37-479f8a034a1f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:47.640955 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44f834-d8c9-4395-9a37-479f8a034a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:47.659081 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-6a44f834-d8c9-4395-9a37-479f8a034a1f None None] MFA Rules not processed for user `a2ad9c7f930e426bb908237f72c04a2e`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:55:47.660262 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-6a44f834-d8c9-4395-9a37-479f8a034a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:55:47.666613 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 736/1477] 10.222.0.24 () {58 vars in 1058 bytes} [Mon Apr 11 23:55:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:55:47.674309 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd0951-d9dc-4730-912b-b4f8cd7f8a5f None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:55:47.685359 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd0951-d9dc-4730-912b-b4f8cd7f8a5f None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:55:47.688812 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e8551-dd1f-41d5-a90f-5e4728973e66 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2ad9c7f930e426bb908237f72c04a2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:55:47.689434 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e8551-dd1f-41d5-a90f-5e4728973e66 service glance] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:47.689708 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e8551-dd1f-41d5-a90f-5e4728973e66 service glance] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:47.689981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e8551-dd1f-41d5-a90f-5e4728973e66 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:47.698857 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e8551-dd1f-41d5-a90f-5e4728973e66 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:55:47.700307 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e8551-dd1f-41d5-a90f-5e4728973e66 service glance] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:55:47.709714 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 742/1478] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:55:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 23:55:50.043679 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ecaae-4acc-4ee0-96fb-de3e023d4ebc None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:50.044166 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ecaae-4acc-4ee0-96fb-de3e023d4ebc None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:50.044166 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ecaae-4acc-4ee0-96fb-de3e023d4ebc None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:50.045941 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 737/1479] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:55:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:55:50.051040 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684305ec-0276-4754-b61a-9a460925fbfc None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:50.051453 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684305ec-0276-4754-b61a-9a460925fbfc None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:50.051592 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684305ec-0276-4754-b61a-9a460925fbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:50.069405 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-684305ec-0276-4754-b61a-9a460925fbfc None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:55:50.070578 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-684305ec-0276-4754-b61a-9a460925fbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:55:50.078259 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 743/1480] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 23:55:50.101099 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ecaae-4acc-4ee0-96fb-de3e023d4ebc None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:55:50.113812 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ecaae-4acc-4ee0-96fb-de3e023d4ebc None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:55:50.118215 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ad429-911f-4d37-b24e-3ab9cb528720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:55:50.118899 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ad429-911f-4d37-b24e-3ab9cb528720 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:50.119181 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ad429-911f-4d37-b24e-3ab9cb528720 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:50.119453 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ad429-911f-4d37-b24e-3ab9cb528720 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:50.120226 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ad429-911f-4d37-b24e-3ab9cb528720 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:55:50.122574 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ad429-911f-4d37-b24e-3ab9cb528720 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:55:50.141546 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 738/1481] 10.222.0.24 () {56 vars in 1108 bytes} [Mon Apr 11 23:55:50 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 23:55:52.462231 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531dfe9-b1f0-46f2-a928-43c98404b87a None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:52.462811 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531dfe9-b1f0-46f2-a928-43c98404b87a None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:52.462811 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531dfe9-b1f0-46f2-a928-43c98404b87a None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:52.464643 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 744/1482] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:55:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:55:52.469796 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7a4e8-3118-4679-828e-9c76539d8237 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:52.470182 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7a4e8-3118-4679-828e-9c76539d8237 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:52.470332 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7a4e8-3118-4679-828e-9c76539d8237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:52.487868 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-e6c7a4e8-3118-4679-828e-9c76539d8237 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:55:52.489042 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-e6c7a4e8-3118-4679-828e-9c76539d8237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:55:52.497197 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 739/1483] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:55:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:55:52.537970 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531dfe9-b1f0-46f2-a928-43c98404b87a None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:55:52.551915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531dfe9-b1f0-46f2-a928-43c98404b87a None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:55:52.557169 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb619e5d-50bc-43d4-b240-dc301734664c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:55:52.558316 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb619e5d-50bc-43d4-b240-dc301734664c service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:52.558603 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb619e5d-50bc-43d4-b240-dc301734664c service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:52.558905 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb619e5d-50bc-43d4-b240-dc301734664c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:52.566763 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb619e5d-50bc-43d4-b240-dc301734664c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:55:52.568354 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb619e5d-50bc-43d4-b240-dc301734664c service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:55:52.578350 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 745/1484] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:55:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:55:55.010258 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975632a-d033-4528-901e-73e8e32adb7d None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:55.010798 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975632a-d033-4528-901e-73e8e32adb7d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:55.010798 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975632a-d033-4528-901e-73e8e32adb7d None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:55.013077 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 740/1485] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:55:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:55:55.018320 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fc5f5-875c-4ea6-80f3-7cc86fcc48bc None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:55.018756 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fc5f5-875c-4ea6-80f3-7cc86fcc48bc None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:55.018915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fc5f5-875c-4ea6-80f3-7cc86fcc48bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:55.036289 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-320fc5f5-875c-4ea6-80f3-7cc86fcc48bc None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:55:55.037464 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-320fc5f5-875c-4ea6-80f3-7cc86fcc48bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:55:55.045698 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 746/1486] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 23:55:55.081813 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975632a-d033-4528-901e-73e8e32adb7d None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:55:55.092334 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975632a-d033-4528-901e-73e8e32adb7d None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:55:55.095826 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db06310-53d2-42dd-a202-d89a6002ae6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:55:55.096448 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db06310-53d2-42dd-a202-d89a6002ae6d service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:55.096726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db06310-53d2-42dd-a202-d89a6002ae6d service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:55.096998 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db06310-53d2-42dd-a202-d89a6002ae6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:55.106359 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db06310-53d2-42dd-a202-d89a6002ae6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:55:55.107797 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db06310-53d2-42dd-a202-d89a6002ae6d service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:55:55.116869 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 741/1487] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:55:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:55:57.430303 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd701a70-93f7-49bf-95e4-6b16cdcd440f None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:57.430876 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd701a70-93f7-49bf-95e4-6b16cdcd440f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:57.430876 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd701a70-93f7-49bf-95e4-6b16cdcd440f None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:57.433245 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 747/1488] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:55:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:55:57.438743 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c665524-5ac9-491d-9a9e-bad7e26e09b3 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:57.439202 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c665524-5ac9-491d-9a9e-bad7e26e09b3 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:57.439334 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c665524-5ac9-491d-9a9e-bad7e26e09b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:57.456757 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-5c665524-5ac9-491d-9a9e-bad7e26e09b3 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:55:57.457949 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-5c665524-5ac9-491d-9a9e-bad7e26e09b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:55:57.465782 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 742/1489] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:55:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:55:57.504048 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd701a70-93f7-49bf-95e4-6b16cdcd440f None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:55:57.514511 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd701a70-93f7-49bf-95e4-6b16cdcd440f None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:55:57.517999 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba05155e-b3b4-430d-aa86-73b4d627582b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:55:57.518625 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05155e-b3b4-430d-aa86-73b4d627582b service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:57.518928 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05155e-b3b4-430d-aa86-73b4d627582b service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:57.519197 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba05155e-b3b4-430d-aa86-73b4d627582b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:57.527817 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05155e-b3b4-430d-aa86-73b4d627582b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:55:57.529220 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba05155e-b3b4-430d-aa86-73b4d627582b service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:55:57.538306 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 748/1490] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:55:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:55:59.889094 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49c488-0628-4b70-96e7-eea6c6ea1bbd None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:59.889616 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49c488-0628-4b70-96e7-eea6c6ea1bbd None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:59.889616 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f49c488-0628-4b70-96e7-eea6c6ea1bbd None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:59.891373 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 743/1491] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:55:59.896451 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31d724-d36e-490c-9e4d-41e4b5e18bf7 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:59.896860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31d724-d36e-490c-9e4d-41e4b5e18bf7 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:59.896989 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e31d724-d36e-490c-9e4d-41e4b5e18bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:59.914193 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-7e31d724-d36e-490c-9e4d-41e4b5e18bf7 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:55:59.915393 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-7e31d724-d36e-490c-9e4d-41e4b5e18bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:55:59.923510 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 749/1492] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 23:55:59.963596 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49c488-0628-4b70-96e7-eea6c6ea1bbd None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:55:59.974042 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f49c488-0628-4b70-96e7-eea6c6ea1bbd None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:55:59.977725 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb291cf-4491-465e-ab85-a6c948e5ba95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:55:59.978340 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb291cf-4491-465e-ab85-a6c948e5ba95 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:55:59.978613 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb291cf-4491-465e-ab85-a6c948e5ba95 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:55:59.978902 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb291cf-4491-465e-ab85-a6c948e5ba95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:55:59.987983 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb291cf-4491-465e-ab85-a6c948e5ba95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:55:59.989383 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb291cf-4491-465e-ab85-a6c948e5ba95 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:55:59.998539 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 744/1493] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:55:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:56:02.774621 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c249c56-4b0f-466b-ae7e-99bd50bb8d88 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:56:02.775068 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c249c56-4b0f-466b-ae7e-99bd50bb8d88 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:56:02.775209 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c249c56-4b0f-466b-ae7e-99bd50bb8d88 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:56:02.777102 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 750/1494] 10.222.0.24 () {54 vars in 926 bytes} [Mon Apr 11 23:56:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:56:02.782242 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3680ef7-a3e1-4208-968d-72626d55fa48 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:56:02.782694 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3680ef7-a3e1-4208-968d-72626d55fa48 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:56:02.782800 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3680ef7-a3e1-4208-968d-72626d55fa48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:56:02.800559 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-c3680ef7-a3e1-4208-968d-72626d55fa48 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:56:02.801726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-c3680ef7-a3e1-4208-968d-72626d55fa48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:56:02.809880 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 745/1495] 10.222.0.24 () {58 vars in 1023 bytes} [Mon Apr 11 23:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:56:02.847537 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c249c56-4b0f-466b-ae7e-99bd50bb8d88 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:56:02.858668 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c249c56-4b0f-466b-ae7e-99bd50bb8d88 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:56:02.862158 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8023a8-cf1d-49b0-a6be-57b79b4f502d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:56:02.862782 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8023a8-cf1d-49b0-a6be-57b79b4f502d service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:56:02.863086 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8023a8-cf1d-49b0-a6be-57b79b4f502d service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:56:02.863356 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8023a8-cf1d-49b0-a6be-57b79b4f502d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:56:02.872611 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8023a8-cf1d-49b0-a6be-57b79b4f502d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:56:02.874015 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8023a8-cf1d-49b0-a6be-57b79b4f502d service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:56:02.883337 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 751/1496] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:57:42.457658 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64725ae7-082b-4252-bba9-7f4be5bfcad9 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:57:42.458242 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64725ae7-082b-4252-bba9-7f4be5bfcad9 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:57:42.458242 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64725ae7-082b-4252-bba9-7f4be5bfcad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:57:42.475754 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-64725ae7-082b-4252-bba9-7f4be5bfcad9 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:57:42.477191 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-64725ae7-082b-4252-bba9-7f4be5bfcad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:57:42.485428 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 746/1497] 10.222.0.24 () {58 vars in 957 bytes} [Mon Apr 11 23:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:57:42.493104 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1994915-458a-43d4-962f-f5acd0641d75 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:57:42.493586 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1994915-458a-43d4-962f-f5acd0641d75 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:57:42.493713 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1994915-458a-43d4-962f-f5acd0641d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:57:42.511999 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-b1994915-458a-43d4-962f-f5acd0641d75 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:57:42.513161 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-b1994915-458a-43d4-962f-f5acd0641d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:57:42.520861 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 752/1498] 10.222.0.24 () {58 vars in 957 bytes} [Mon Apr 11 23:57:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:57:42.525211 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64725ae7-082b-4252-bba9-7f4be5bfcad9 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:57:42.534554 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64725ae7-082b-4252-bba9-7f4be5bfcad9 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:57:42.539131 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058c349-011d-40af-83c0-2c1ca9edef36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:57:42.539771 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058c349-011d-40af-83c0-2c1ca9edef36 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:57:42.540051 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058c349-011d-40af-83c0-2c1ca9edef36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:57:42.540326 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058c349-011d-40af-83c0-2c1ca9edef36 admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:57:42.541043 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058c349-011d-40af-83c0-2c1ca9edef36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 11 23:57:42.541346 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058c349-011d-40af-83c0-2c1ca9edef36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:57:42.542882 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING py.warnings [None req-8058c349-011d-40af-83c0-2c1ca9edef36 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 23:57:42.542882 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: warnings.warn(msg) Apr 11 23:57:42.542882 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: Apr 11 23:57:42.543754 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058c349-011d-40af-83c0-2c1ca9edef36 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:57:42.554824 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 747/1499] 10.222.0.24 () {58 vars in 1152 bytes} [Mon Apr 11 23:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:57:42.563302 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1994915-458a-43d4-962f-f5acd0641d75 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:57:42.572154 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1994915-458a-43d4-962f-f5acd0641d75 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:57:42.576894 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee0ba6-a7ad-4b5d-9593-83a8a4550cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:57:42.577539 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee0ba6-a7ad-4b5d-9593-83a8a4550cfa admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:57:42.577819 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee0ba6-a7ad-4b5d-9593-83a8a4550cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:57:42.578087 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee0ba6-a7ad-4b5d-9593-83a8a4550cfa admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:57:42.578777 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee0ba6-a7ad-4b5d-9593-83a8a4550cfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:57:42.580484 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING py.warnings [None req-66ee0ba6-a7ad-4b5d-9593-83a8a4550cfa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 23:57:42.580484 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: warnings.warn(msg) Apr 11 23:57:42.580484 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: Apr 11 23:57:42.581663 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ee0ba6-a7ad-4b5d-9593-83a8a4550cfa admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:57:42.697836 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 753/1500] 10.222.0.24 () {60 vars in 1152 bytes} [Mon Apr 11 23:57:42 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 11 23:57:42.702810 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058c349-011d-40af-83c0-2c1ca9edef36 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:57:42.712981 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058c349-011d-40af-83c0-2c1ca9edef36 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:57:42.772360 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad01dc-f78c-4016-b3ef-38bd75aae594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:57:42.773030 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad01dc-f78c-4016-b3ef-38bd75aae594 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:57:42.773312 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad01dc-f78c-4016-b3ef-38bd75aae594 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:57:42.773580 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ad01dc-f78c-4016-b3ef-38bd75aae594 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:57:42.774264 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad01dc-f78c-4016-b3ef-38bd75aae594 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:57:42.775313 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING py.warnings [None req-c5ad01dc-f78c-4016-b3ef-38bd75aae594 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 23:57:42.775313 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: warnings.warn(msg) Apr 11 23:57:42.775313 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: Apr 11 23:57:42.776500 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ad01dc-f78c-4016-b3ef-38bd75aae594 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:57:42.844542 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 748/1501] 10.222.0.24 () {60 vars in 1143 bytes} [Mon Apr 11 23:57:42 2022] POST /identity/v3/users => generated 290 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 11 23:57:42.848556 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee0ba6-a7ad-4b5d-9593-83a8a4550cfa admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:57:42.858800 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee0ba6-a7ad-4b5d-9593-83a8a4550cfa admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:57:42.863311 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00a558-d4c7-4549-bd6a-14b7db61d680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:57:42.863965 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00a558-d4c7-4549-bd6a-14b7db61d680 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:57:42.864245 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00a558-d4c7-4549-bd6a-14b7db61d680 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:57:42.864517 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00a558-d4c7-4549-bd6a-14b7db61d680 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:57:42.865243 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00a558-d4c7-4549-bd6a-14b7db61d680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:57:42.866501 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING py.warnings [None req-2f00a558-d4c7-4549-bd6a-14b7db61d680 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 23:57:42.866501 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: warnings.warn(msg) Apr 11 23:57:42.866501 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: Apr 11 23:57:42.867403 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00a558-d4c7-4549-bd6a-14b7db61d680 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:57:42.880174 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 754/1502] 10.222.0.24 () {58 vars in 1121 bytes} [Mon Apr 11 23:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 23:57:42.884047 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad01dc-f78c-4016-b3ef-38bd75aae594 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:57:42.894388 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ad01dc-f78c-4016-b3ef-38bd75aae594 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:57:42.898905 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a1be8-f4a0-410b-939a-46d4d1a0d7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:57:42.903332 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a1be8-f4a0-410b-939a-46d4d1a0d7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:57:42.903332 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a1be8-f4a0-410b-939a-46d4d1a0d7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:57:42.903332 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a1be8-f4a0-410b-939a-46d4d1a0d7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:57:42.903332 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a1be8-f4a0-410b-939a-46d4d1a0d7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:57:42.903332 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING py.warnings [None req-c61a1be8-f4a0-410b-939a-46d4d1a0d7c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 11 23:57:42.903332 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: warnings.warn(msg) Apr 11 23:57:42.903332 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: Apr 11 23:57:42.903893 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61a1be8-f4a0-410b-939a-46d4d1a0d7c5 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:57:42.915623 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 749/1503] 10.222.0.24 () {58 vars in 1121 bytes} [Mon Apr 11 23:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 11 23:57:42.919698 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00a558-d4c7-4549-bd6a-14b7db61d680 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:57:42.929410 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00a558-d4c7-4549-bd6a-14b7db61d680 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:57:42.934475 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89a117-005e-49b7-b657-fb37d87933a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:57:42.935376 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89a117-005e-49b7-b657-fb37d87933a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:57:42.935673 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89a117-005e-49b7-b657-fb37d87933a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:57:42.935926 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee89a117-005e-49b7-b657-fb37d87933a8 admin admin] PATH_INFO: `/v3/projects/9bb792bf5ccf4b8fb5a5130b560e795d/users/1104386d916c4a6fa37ba849a4e9a743/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:57:42.950515 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89a117-005e-49b7-b657-fb37d87933a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb792bf5ccf4b8fb5a5130b560e795d, user_id=1104386d916c4a6fa37ba849a4e9a743, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:57:42.951553 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING py.warnings [None req-ee89a117-005e-49b7-b657-fb37d87933a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 23:57:42.951553 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: warnings.warn(msg) Apr 11 23:57:42.951553 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: Apr 11 23:57:42.953463 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee89a117-005e-49b7-b657-fb37d87933a8 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:57:43.051840 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 755/1504] 10.222.0.24 () {60 vars in 1482 bytes} [Mon Apr 11 23:57:42 2022] PUT /identity/v3/projects/9bb792bf5ccf4b8fb5a5130b560e795d/users/1104386d916c4a6fa37ba849a4e9a743/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 11 23:57:43.063599 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376e971-2531-4b3c-9cb9-2bf40e98eea6 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:57:43.063883 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376e971-2531-4b3c-9cb9-2bf40e98eea6 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:57:43.064156 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376e971-2531-4b3c-9cb9-2bf40e98eea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:57:43.089265 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-8376e971-2531-4b3c-9cb9-2bf40e98eea6 None None] MFA Rules not processed for user `1104386d916c4a6fa37ba849a4e9a743`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:57:43.090662 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-8376e971-2531-4b3c-9cb9-2bf40e98eea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:57:43.150776 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 750/1505] 10.222.0.24 () {58 vars in 957 bytes} [Mon Apr 11 23:57:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:57:43.161817 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89a117-005e-49b7-b657-fb37d87933a8 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:57:43.228144 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee89a117-005e-49b7-b657-fb37d87933a8 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:57:43.234016 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488c7fa-f317-4108-bd8b-571b341dfaea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:57:43.234650 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488c7fa-f317-4108-bd8b-571b341dfaea service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:57:43.234967 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488c7fa-f317-4108-bd8b-571b341dfaea service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:57:43.235241 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488c7fa-f317-4108-bd8b-571b341dfaea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:57:43.242731 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488c7fa-f317-4108-bd8b-571b341dfaea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:57:43.244321 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488c7fa-f317-4108-bd8b-571b341dfaea service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:57:43.253404 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 756/1506] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:57:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:57:43.322327 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111b4f0-03c9-4425-85aa-c41af8cc1df1 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:57:43.322614 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111b4f0-03c9-4425-85aa-c41af8cc1df1 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:57:43.322994 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111b4f0-03c9-4425-85aa-c41af8cc1df1 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:57:43.324754 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 751/1507] 10.222.0.24 () {52 vars in 829 bytes} [Mon Apr 11 23:57:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:57:43.328327 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488c7fa-f317-4108-bd8b-571b341dfaea service nova] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:57:43.388336 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488c7fa-f317-4108-bd8b-571b341dfaea service nova] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:57:43.392910 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b374b-5ada-41ec-90b6-4faf2c32709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:57:43.398921 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b374b-5ada-41ec-90b6-4faf2c32709a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:57:43.398921 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b374b-5ada-41ec-90b6-4faf2c32709a admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:57:43.398921 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b374b-5ada-41ec-90b6-4faf2c32709a admin admin] PATH_INFO: `/v3/users/1104386d916c4a6fa37ba849a4e9a743` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:57:43.398921 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b374b-5ada-41ec-90b6-4faf2c32709a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1104386d916c4a6fa37ba849a4e9a743)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:57:43.398921 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING py.warnings [None req-765b374b-5ada-41ec-90b6-4faf2c32709a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 23:57:43.398921 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: warnings.warn(msg) Apr 11 23:57:43.398921 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: Apr 11 23:57:43.399657 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b374b-5ada-41ec-90b6-4faf2c32709a admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:57:43.919465 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-765b374b-5ada-41ec-90b6-4faf2c32709a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1104386d916c4a6fa37ba849a4e9a743'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 23:57:43.931318 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-765b374b-5ada-41ec-90b6-4faf2c32709a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1104386d916c4a6fa37ba849a4e9a743'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 23:57:44.010444 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-765b374b-5ada-41ec-90b6-4faf2c32709a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1104386d916c4a6fa37ba849a4e9a743'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 23:57:44.011619 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-765b374b-5ada-41ec-90b6-4faf2c32709a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1104386d916c4a6fa37ba849a4e9a743'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 23:57:44.033106 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-765b374b-5ada-41ec-90b6-4faf2c32709a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1104386d916c4a6fa37ba849a4e9a743'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 23:57:44.039413 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 757/1508] 10.222.0.24 () {58 vars in 1223 bytes} [Mon Apr 11 23:57:43 2022] DELETE /identity/v3/users/1104386d916c4a6fa37ba849a4e9a743 => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:57:44.043759 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba987d2-89e4-4760-b16d-3f55c9c73e7d None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:57:44.044220 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba987d2-89e4-4760-b16d-3f55c9c73e7d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:57:44.044330 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba987d2-89e4-4760-b16d-3f55c9c73e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:57:44.066182 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-6ba987d2-89e4-4760-b16d-3f55c9c73e7d None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:57:44.067380 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-6ba987d2-89e4-4760-b16d-3f55c9c73e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:57:44.123516 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 752/1509] 10.222.0.24 () {58 vars in 957 bytes} [Mon Apr 11 23:57:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:57:44.132822 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b374b-5ada-41ec-90b6-4faf2c32709a admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:57:44.134226 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-765b374b-5ada-41ec-90b6-4faf2c32709a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:57:44.188266 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b374b-5ada-41ec-90b6-4faf2c32709a admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:57:44.191805 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b6bd0-06a5-4aec-91e3-deebcf04fdef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:57:44.192441 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b6bd0-06a5-4aec-91e3-deebcf04fdef service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:57:44.192718 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b6bd0-06a5-4aec-91e3-deebcf04fdef service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:57:44.192990 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b6bd0-06a5-4aec-91e3-deebcf04fdef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:57:44.202190 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b6bd0-06a5-4aec-91e3-deebcf04fdef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:57:44.203642 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b6bd0-06a5-4aec-91e3-deebcf04fdef service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:57:44.212809 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 758/1510] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:57:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:57:44.671507 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba987d2-89e4-4760-b16d-3f55c9c73e7d None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:57:44.673108 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-6ba987d2-89e4-4760-b16d-3f55c9c73e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:57:44.685582 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba987d2-89e4-4760-b16d-3f55c9c73e7d None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:57:44.691223 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69dd380-b640-41a8-b230-4c51360e86ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:57:44.692087 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69dd380-b640-41a8-b230-4c51360e86ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:57:44.692365 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69dd380-b640-41a8-b230-4c51360e86ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:57:44.692637 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69dd380-b640-41a8-b230-4c51360e86ae admin admin] PATH_INFO: `/v3/projects/9bb792bf5ccf4b8fb5a5130b560e795d` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:57:44.693920 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69dd380-b640-41a8-b230-4c51360e86ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb792bf5ccf4b8fb5a5130b560e795d)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:57:44.694915 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING py.warnings [None req-e69dd380-b640-41a8-b230-4c51360e86ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 11 23:57:44.694915 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: warnings.warn(msg) Apr 11 23:57:44.694915 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: Apr 11 23:57:44.696118 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69dd380-b640-41a8-b230-4c51360e86ae admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:57:44.821096 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e69dd380-b640-41a8-b230-4c51360e86ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb792bf5ccf4b8fb5a5130b560e795d', 'request_id': 'req-e69dd380-b640-41a8-b230-4c51360e86ae'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 23:57:44.886410 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e69dd380-b640-41a8-b230-4c51360e86ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb792bf5ccf4b8fb5a5130b560e795d', 'request_id': 'req-e69dd380-b640-41a8-b230-4c51360e86ae'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 23:57:44.892660 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e69dd380-b640-41a8-b230-4c51360e86ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb792bf5ccf4b8fb5a5130b560e795d', 'request_id': 'req-e69dd380-b640-41a8-b230-4c51360e86ae'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 23:57:44.911208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e69dd380-b640-41a8-b230-4c51360e86ae admin admin] The token cache is being invalidate because project 9bb792bf5ccf4b8fb5a5130b560e795d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 11 23:57:44.911495 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e69dd380-b640-41a8-b230-4c51360e86ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 23:57:44.912141 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e69dd380-b640-41a8-b230-4c51360e86ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 11 23:57:44.913868 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 753/1511] 10.222.0.24 () {58 vars in 1232 bytes} [Mon Apr 11 23:57:44 2022] DELETE /identity/v3/projects/9bb792bf5ccf4b8fb5a5130b560e795d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 11 23:59:27.244845 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2648e8-ee1a-4843-b079-9da1c9fe033d None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:27.245428 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2648e8-ee1a-4843-b079-9da1c9fe033d None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:27.245428 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2648e8-ee1a-4843-b079-9da1c9fe033d None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:27.247207 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 759/1512] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 23:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:59:27.252220 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77281d6-7da8-414a-bfa5-597bf8a868ed None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:27.252653 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77281d6-7da8-414a-bfa5-597bf8a868ed None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:27.252755 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77281d6-7da8-414a-bfa5-597bf8a868ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:27.276203 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-f77281d6-7da8-414a-bfa5-597bf8a868ed None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:59:27.277425 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-f77281d6-7da8-414a-bfa5-597bf8a868ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:59:27.338189 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 754/1513] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 23:59:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:59:27.489088 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2648e8-ee1a-4843-b079-9da1c9fe033d None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:59:27.490671 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-2c2648e8-ee1a-4843-b079-9da1c9fe033d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:59:27.566750 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2648e8-ee1a-4843-b079-9da1c9fe033d None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:59:27.572205 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59890803-5ac3-4a58-b364-c832b3026fc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:59:27.572845 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59890803-5ac3-4a58-b364-c832b3026fc1 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:27.573124 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59890803-5ac3-4a58-b364-c832b3026fc1 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:27.573397 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59890803-5ac3-4a58-b364-c832b3026fc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:27.582022 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59890803-5ac3-4a58-b364-c832b3026fc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:59:27.583672 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59890803-5ac3-4a58-b364-c832b3026fc1 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:59:27.593180 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 760/1514] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:59:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:59:27.954469 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9767db7-54f3-42c4-bc49-977b37eafddb None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:27.954751 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9767db7-54f3-42c4-bc49-977b37eafddb None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:27.955076 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9767db7-54f3-42c4-bc49-977b37eafddb None None] PATH_INFO: `/v3` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:27.956581 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 755/1515] 10.222.0.20 () {54 vars in 925 bytes} [Mon Apr 11 23:59:27 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 11 23:59:27.963058 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec6a50-7734-446e-89ae-617b1f085bcd None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:27.963344 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec6a50-7734-446e-89ae-617b1f085bcd None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:27.963623 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ec6a50-7734-446e-89ae-617b1f085bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:27.982536 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-99ec6a50-7734-446e-89ae-617b1f085bcd None None] MFA Rules not processed for user `47515442e0e84441bed4bfbb7a3b4ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:59:27.991456 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-99ec6a50-7734-446e-89ae-617b1f085bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:59:28.044878 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 761/1516] 10.222.0.20 () {58 vars in 1015 bytes} [Mon Apr 11 23:59:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:59:28.882596 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340516d-18e3-4457-977f-34667588e8ae None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:28.883165 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340516d-18e3-4457-977f-34667588e8ae None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:28.883165 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340516d-18e3-4457-977f-34667588e8ae None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:28.884978 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 756/1517] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 23:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:59:28.889905 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ae8b8-5c89-4360-82a7-0bc3a8776278 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:28.890343 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ae8b8-5c89-4360-82a7-0bc3a8776278 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:28.890450 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ae8b8-5c89-4360-82a7-0bc3a8776278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:28.908630 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-a19ae8b8-5c89-4360-82a7-0bc3a8776278 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:59:28.909793 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a19ae8b8-5c89-4360-82a7-0bc3a8776278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:59:28.917689 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 762/1518] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 23:59:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 11 23:59:29.069788 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340516d-18e3-4457-977f-34667588e8ae None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:59:29.083815 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340516d-18e3-4457-977f-34667588e8ae None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:59:29.089153 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80aad66-ebbb-4c4a-a37a-f4307d7ef5d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:59:29.089777 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aad66-ebbb-4c4a-a37a-f4307d7ef5d3 service nova] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:29.090056 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aad66-ebbb-4c4a-a37a-f4307d7ef5d3 service nova] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:29.090328 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80aad66-ebbb-4c4a-a37a-f4307d7ef5d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:29.098667 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80aad66-ebbb-4c4a-a37a-f4307d7ef5d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:59:29.100660 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80aad66-ebbb-4c4a-a37a-f4307d7ef5d3 service nova] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:59:29.110059 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 757/1519] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:59:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:59:32.218154 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cc741-9ce9-4a57-ad0d-740ffd50bc96 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:32.218706 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cc741-9ce9-4a57-ad0d-740ffd50bc96 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:32.218706 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cc741-9ce9-4a57-ad0d-740ffd50bc96 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:32.220537 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 763/1520] 10.222.0.24 () {54 vars in 960 bytes} [Mon Apr 11 23:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:59:32.225728 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9dfa9-9756-4f1c-b8c5-38bbb6cf3f76 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:32.226143 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9dfa9-9756-4f1c-b8c5-38bbb6cf3f76 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:32.226303 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9dfa9-9756-4f1c-b8c5-38bbb6cf3f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:32.244312 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-7bf9dfa9-9756-4f1c-b8c5-38bbb6cf3f76 None None] MFA Rules not processed for user `47515442e0e84441bed4bfbb7a3b4ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:59:32.245486 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-7bf9dfa9-9756-4f1c-b8c5-38bbb6cf3f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:59:32.254416 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 758/1521] 10.222.0.24 () {58 vars in 1057 bytes} [Mon Apr 11 23:59:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:59:32.263439 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cc741-9ce9-4a57-ad0d-740ffd50bc96 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:59:32.277195 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cc741-9ce9-4a57-ad0d-740ffd50bc96 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:59:32.282043 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75121971-b848-42be-9b63-5ee1c8f35f2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47515442e0e84441bed4bfbb7a3b4ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:59:32.282693 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75121971-b848-42be-9b63-5ee1c8f35f2c service placement] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:32.283003 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75121971-b848-42be-9b63-5ee1c8f35f2c service placement] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:32.283282 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75121971-b848-42be-9b63-5ee1c8f35f2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:32.291351 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75121971-b848-42be-9b63-5ee1c8f35f2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:59:32.292909 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75121971-b848-42be-9b63-5ee1c8f35f2c service placement] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:59:32.302272 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 764/1522] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:59:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 23:59:40.781464 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccae323-0da9-4b82-b2ee-707a8c6cd83e None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:40.781959 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccae323-0da9-4b82-b2ee-707a8c6cd83e None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:40.782066 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccae323-0da9-4b82-b2ee-707a8c6cd83e None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:40.783839 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 759/1523] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 23:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:59:40.789384 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fb3f0-ed3b-4c76-805a-3cecb75205f2 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:40.789786 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fb3f0-ed3b-4c76-805a-3cecb75205f2 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:40.789932 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2fb3f0-ed3b-4c76-805a-3cecb75205f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:40.807385 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-4c2fb3f0-ed3b-4c76-805a-3cecb75205f2 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:59:40.808562 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-4c2fb3f0-ed3b-4c76-805a-3cecb75205f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:59:40.816191 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 765/1524] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 23:59:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:59:40.966388 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccae323-0da9-4b82-b2ee-707a8c6cd83e None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:59:40.980927 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccae323-0da9-4b82-b2ee-707a8c6cd83e None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:59:40.986366 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49475ef-6cc6-4aaa-9b50-f796c4587ead service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:59:40.987019 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49475ef-6cc6-4aaa-9b50-f796c4587ead service nova] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:40.987300 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49475ef-6cc6-4aaa-9b50-f796c4587ead service nova] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:40.987572 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49475ef-6cc6-4aaa-9b50-f796c4587ead service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:40.995552 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49475ef-6cc6-4aaa-9b50-f796c4587ead service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:59:40.997138 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49475ef-6cc6-4aaa-9b50-f796c4587ead service nova] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:59:41.006638 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 760/1525] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:59:42.253019 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a751c-ecb6-4465-bf24-5ca6dd8451e2 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:42.253582 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a751c-ecb6-4465-bf24-5ca6dd8451e2 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:42.253582 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a751c-ecb6-4465-bf24-5ca6dd8451e2 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:42.255471 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 766/1526] 127.0.0.1 () {54 vars in 901 bytes} [Mon Apr 11 23:59:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:59:42.260251 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9d665-da76-421b-b939-c6b503f79c19 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:42.260659 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9d665-da76-421b-b939-c6b503f79c19 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:42.260802 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9d665-da76-421b-b939-c6b503f79c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:42.280687 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-43d9d665-da76-421b-b939-c6b503f79c19 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:59:42.282157 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-43d9d665-da76-421b-b939-c6b503f79c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:59:42.291945 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 761/1527] 127.0.0.1 () {58 vars in 998 bytes} [Mon Apr 11 23:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:59:42.441185 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a751c-ecb6-4465-bf24-5ca6dd8451e2 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:59:42.460945 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a751c-ecb6-4465-bf24-5ca6dd8451e2 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:59:42.466205 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179aad4-bdc9-4a1a-ad15-0d0b6aa8c223 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:59:42.466859 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179aad4-bdc9-4a1a-ad15-0d0b6aa8c223 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:42.467153 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179aad4-bdc9-4a1a-ad15-0d0b6aa8c223 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:42.467425 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179aad4-bdc9-4a1a-ad15-0d0b6aa8c223 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:42.475435 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179aad4-bdc9-4a1a-ad15-0d0b6aa8c223 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:59:42.477047 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179aad4-bdc9-4a1a-ad15-0d0b6aa8c223 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:59:42.486460 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 767/1528] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:59:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:59:46.547316 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea338b65-25c5-4ac4-bb46-a33bc4f12e14 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:46.547899 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea338b65-25c5-4ac4-bb46-a33bc4f12e14 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:46.547899 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea338b65-25c5-4ac4-bb46-a33bc4f12e14 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:46.549621 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 762/1529] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 23:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:59:46.555285 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bc618-9677-4b5a-baf9-44c20b2c754c None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:46.555672 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bc618-9677-4b5a-baf9-44c20b2c754c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:46.555844 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bc618-9677-4b5a-baf9-44c20b2c754c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:46.574259 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-a52bc618-9677-4b5a-baf9-44c20b2c754c None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:59:46.575492 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a52bc618-9677-4b5a-baf9-44c20b2c754c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:59:46.583194 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 768/1530] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 23:59:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:59:46.621705 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea338b65-25c5-4ac4-bb46-a33bc4f12e14 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:59:46.623480 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ea338b65-25c5-4ac4-bb46-a33bc4f12e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:59:46.678632 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea338b65-25c5-4ac4-bb46-a33bc4f12e14 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:59:46.682212 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb545564-c3e8-4680-9f94-0f024c8af1a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:59:46.682864 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb545564-c3e8-4680-9f94-0f024c8af1a4 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:46.683143 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb545564-c3e8-4680-9f94-0f024c8af1a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:46.683408 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb545564-c3e8-4680-9f94-0f024c8af1a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:46.692557 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb545564-c3e8-4680-9f94-0f024c8af1a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:59:46.693969 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb545564-c3e8-4680-9f94-0f024c8af1a4 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:59:46.702993 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 763/1531] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 11 23:59:48.959047 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca45ad1-5559-4f52-9c6f-91b4035f93cc None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:48.959642 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca45ad1-5559-4f52-9c6f-91b4035f93cc None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:48.959642 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca45ad1-5559-4f52-9c6f-91b4035f93cc None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:48.961386 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 769/1532] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 23:59:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:59:48.966734 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7f604-2bae-490d-afe4-debd4ba747a6 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:48.967202 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7f604-2bae-490d-afe4-debd4ba747a6 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:48.967313 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac7f604-2bae-490d-afe4-debd4ba747a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:48.985661 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-2ac7f604-2bae-490d-afe4-debd4ba747a6 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:59:48.986862 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-2ac7f604-2bae-490d-afe4-debd4ba747a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:59:48.994704 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 764/1533] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 23:59:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:59:49.029680 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca45ad1-5559-4f52-9c6f-91b4035f93cc None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:59:49.040696 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca45ad1-5559-4f52-9c6f-91b4035f93cc None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:59:49.044336 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea2430a-a7f4-4dd1-99b8-f777cde8ede4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:59:49.044964 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2430a-a7f4-4dd1-99b8-f777cde8ede4 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:49.045239 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2430a-a7f4-4dd1-99b8-f777cde8ede4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:49.045508 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea2430a-a7f4-4dd1-99b8-f777cde8ede4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:49.054489 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2430a-a7f4-4dd1-99b8-f777cde8ede4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:59:49.055918 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea2430a-a7f4-4dd1-99b8-f777cde8ede4 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:59:49.064946 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 770/1534] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:59:52.742787 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f545a-a28b-48f0-a47b-5e842814e0fe None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:52.743378 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f545a-a28b-48f0-a47b-5e842814e0fe None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:52.743378 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f545a-a28b-48f0-a47b-5e842814e0fe None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:52.745143 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 765/1535] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 23:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:59:52.750191 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7bf62-d934-4374-b91d-b3a6d76a454b None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:52.750593 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7bf62-d934-4374-b91d-b3a6d76a454b None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:52.750742 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7bf62-d934-4374-b91d-b3a6d76a454b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:52.768402 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-c7d7bf62-d934-4374-b91d-b3a6d76a454b None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:59:52.769585 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-c7d7bf62-d934-4374-b91d-b3a6d76a454b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:59:52.778080 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 771/1536] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 23:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:59:53.028662 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f545a-a28b-48f0-a47b-5e842814e0fe None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:59:53.030316 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-311f545a-a28b-48f0-a47b-5e842814e0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:59:53.087206 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f545a-a28b-48f0-a47b-5e842814e0fe None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:59:53.090668 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dfa411-4d4a-46c3-961d-3b41cdbfd0f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:59:53.091349 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfa411-4d4a-46c3-961d-3b41cdbfd0f2 service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:53.091628 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfa411-4d4a-46c3-961d-3b41cdbfd0f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:53.091903 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dfa411-4d4a-46c3-961d-3b41cdbfd0f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:53.100961 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfa411-4d4a-46c3-961d-3b41cdbfd0f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:59:53.102396 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dfa411-4d4a-46c3-961d-3b41cdbfd0f2 service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:59:53.111977 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 766/1537] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:59:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 11 23:59:55.426509 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f05db8-fe8f-4120-9fe0-8a1365cc6957 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:55.427099 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f05db8-fe8f-4120-9fe0-8a1365cc6957 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:55.427099 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f05db8-fe8f-4120-9fe0-8a1365cc6957 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:55.429469 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 772/1538] 127.0.0.1 () {54 vars in 916 bytes} [Mon Apr 11 23:59:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:59:55.434511 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4901aed-f037-4870-8a4a-5e554beabe4b None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:55.434952 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4901aed-f037-4870-8a4a-5e554beabe4b None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:55.435107 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4901aed-f037-4870-8a4a-5e554beabe4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:55.452601 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-c4901aed-f037-4870-8a4a-5e554beabe4b None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:59:55.453831 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-c4901aed-f037-4870-8a4a-5e554beabe4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:59:55.461501 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 767/1539] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Apr 11 23:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:59:55.712755 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e611232-33e2-4736-9299-ba4047370bb3 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:55.713043 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e611232-33e2-4736-9299-ba4047370bb3 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:55.713319 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e611232-33e2-4736-9299-ba4047370bb3 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:55.715173 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 773/1540] 10.222.0.24 () {54 vars in 961 bytes} [Mon Apr 11 23:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 11 23:59:55.719875 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d76f5e-770c-4f88-9a38-103fe175781c None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:55.720163 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d76f5e-770c-4f88-9a38-103fe175781c None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:55.720438 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d76f5e-770c-4f88-9a38-103fe175781c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:55.739185 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-f5d76f5e-770c-4f88-9a38-103fe175781c None None] MFA Rules not processed for user `3a09a31262e54eec84580c7259902df1`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 11 23:59:55.740350 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-f5d76f5e-770c-4f88-9a38-103fe175781c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 11 23:59:55.746627 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 768/1541] 10.222.0.24 () {58 vars in 1058 bytes} [Mon Apr 11 23:59:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 11 23:59:55.755902 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e611232-33e2-4736-9299-ba4047370bb3 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 11 23:59:55.766320 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e611232-33e2-4736-9299-ba4047370bb3 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 11 23:59:55.769815 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef417be-a5e8-4940-bb6f-75d48ea22105 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 11 23:59:55.770672 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef417be-a5e8-4940-bb6f-75d48ea22105 service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 11 23:59:55.770783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef417be-a5e8-4940-bb6f-75d48ea22105 service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 11 23:59:55.771004 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef417be-a5e8-4940-bb6f-75d48ea22105 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 11 23:59:55.780467 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef417be-a5e8-4940-bb6f-75d48ea22105 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 11 23:59:55.781945 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef417be-a5e8-4940-bb6f-75d48ea22105 service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 11 23:59:55.791844 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 774/1542] 10.222.0.24 () {60 vars in 1365 bytes} [Mon Apr 11 23:59:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:01:29.735368 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866faeb-11bc-4993-97be-ca88edd856aa None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:29.736521 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866faeb-11bc-4993-97be-ca88edd856aa None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:29.737007 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0866faeb-11bc-4993-97be-ca88edd856aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:29.776569 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-0866faeb-11bc-4993-97be-ca88edd856aa None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:29.778052 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-0866faeb-11bc-4993-97be-ca88edd856aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:29.795704 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 769/1543] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:29.806338 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f909fa-cb2f-4967-ba52-ed2ebadda2a1 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:29.806970 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f909fa-cb2f-4967-ba52-ed2ebadda2a1 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:29.806970 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f909fa-cb2f-4967-ba52-ed2ebadda2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:29.837599 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-15f909fa-cb2f-4967-ba52-ed2ebadda2a1 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:29.838798 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-15f909fa-cb2f-4967-ba52-ed2ebadda2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:29.860538 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 775/1544] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:29.868125 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866faeb-11bc-4993-97be-ca88edd856aa None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:29.881499 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0866faeb-11bc-4993-97be-ca88edd856aa None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:29.892977 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df7d9e4-840e-4116-8607-0dd16f1499bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:29.894106 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7d9e4-840e-4116-8607-0dd16f1499bd admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:29.894615 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7d9e4-840e-4116-8607-0dd16f1499bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:29.895296 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df7d9e4-840e-4116-8607-0dd16f1499bd admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:29.896284 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7d9e4-840e-4116-8607-0dd16f1499bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:01:29.896823 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7d9e4-840e-4116-8607-0dd16f1499bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:29.903732 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df7d9e4-840e-4116-8607-0dd16f1499bd admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:29.923103 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 770/1545] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:01:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:01:29.934880 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f909fa-cb2f-4967-ba52-ed2ebadda2a1 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:29.956681 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f909fa-cb2f-4967-ba52-ed2ebadda2a1 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:29.965929 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a87a76-fdd9-4cab-8657-93844dfa3fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:29.966610 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a87a76-fdd9-4cab-8657-93844dfa3fbd admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:29.966914 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a87a76-fdd9-4cab-8657-93844dfa3fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:29.967189 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a87a76-fdd9-4cab-8657-93844dfa3fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:29.967901 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a87a76-fdd9-4cab-8657-93844dfa3fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:29.969879 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a87a76-fdd9-4cab-8657-93844dfa3fbd admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:30.016959 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65970ae-9166-4fb5-ad56-ca5007ffd332 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.017439 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65970ae-9166-4fb5-ad56-ca5007ffd332 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.017817 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65970ae-9166-4fb5-ad56-ca5007ffd332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.044533 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-f65970ae-9166-4fb5-ad56-ca5007ffd332 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:30.045764 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-f65970ae-9166-4fb5-ad56-ca5007ffd332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:30.057933 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 771/1546] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:30.059368 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbcaa0-032a-43af-95f4-87eb808621f2 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.059656 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbcaa0-032a-43af-95f4-87eb808621f2 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.059933 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cbcaa0-032a-43af-95f4-87eb808621f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.086119 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 776/1547] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:01:29 2022] POST /identity/v3/projects => generated 375 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:30.086119 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5605f7-c476-4c12-9fa1-22a603096d47 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.086119 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5605f7-c476-4c12-9fa1-22a603096d47 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.086119 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5605f7-c476-4c12-9fa1-22a603096d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.088523 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-e4cbcaa0-032a-43af-95f4-87eb808621f2 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:30.089969 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-e4cbcaa0-032a-43af-95f4-87eb808621f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:30.127075 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-2a5605f7-c476-4c12-9fa1-22a603096d47 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:30.127075 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-2a5605f7-c476-4c12-9fa1-22a603096d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:30.189405 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 772/1548] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:30.190187 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbcaa0-032a-43af-95f4-87eb808621f2 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:30.205116 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cbcaa0-032a-43af-95f4-87eb808621f2 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:30.210193 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0970c-6773-4e70-ba23-4daa641eee2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:30.211119 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0970c-6773-4e70-ba23-4daa641eee2c admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.211405 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0970c-6773-4e70-ba23-4daa641eee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.211682 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0970c-6773-4e70-ba23-4daa641eee2c admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.212386 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0970c-6773-4e70-ba23-4daa641eee2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:30.212965 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 777/1549] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:30.214316 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0970c-6773-4e70-ba23-4daa641eee2c admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:30.214442 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0858d43-616c-4d01-a459-60e58b5cd580 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.214714 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0858d43-616c-4d01-a459-60e58b5cd580 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.215090 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0858d43-616c-4d01-a459-60e58b5cd580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.244310 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-d0858d43-616c-4d01-a459-60e58b5cd580 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:30.245492 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d0858d43-616c-4d01-a459-60e58b5cd580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:30.253462 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 778/1550] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:30.254729 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff04dd5-e191-4cd4-9a24-4e565fab393f None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.255046 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff04dd5-e191-4cd4-9a24-4e565fab393f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.255317 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff04dd5-e191-4cd4-9a24-4e565fab393f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.276010 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-eff04dd5-e191-4cd4-9a24-4e565fab393f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:30.277360 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-eff04dd5-e191-4cd4-9a24-4e565fab393f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:30.285287 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 779/1551] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:30.286546 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7328d-3fc7-4f0c-9cd5-f155409ebb53 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.286851 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7328d-3fc7-4f0c-9cd5-f155409ebb53 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.287141 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7328d-3fc7-4f0c-9cd5-f155409ebb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.306527 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-4ef7328d-3fc7-4f0c-9cd5-f155409ebb53 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:30.307794 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-4ef7328d-3fc7-4f0c-9cd5-f155409ebb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:30.315820 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 780/1552] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:30.317117 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc70ff-c890-4beb-b6a4-b3fdf66a1ab7 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.317402 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc70ff-c890-4beb-b6a4-b3fdf66a1ab7 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.317676 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc70ff-c890-4beb-b6a4-b3fdf66a1ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.330368 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 773/1553] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:01:30 2022] POST /identity/v3/users => generated 288 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:30.332043 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b056051-e707-47b2-8175-089f503b6e7f None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.335143 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b056051-e707-47b2-8175-089f503b6e7f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.335143 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b056051-e707-47b2-8175-089f503b6e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.336558 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-70fc70ff-c890-4beb-b6a4-b3fdf66a1ab7 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:30.337880 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-70fc70ff-c890-4beb-b6a4-b3fdf66a1ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:30.346015 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 781/1554] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:30.347031 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc70ff-c890-4beb-b6a4-b3fdf66a1ab7 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:30.352874 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-1b056051-e707-47b2-8175-089f503b6e7f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:30.354105 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-1b056051-e707-47b2-8175-089f503b6e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:30.358061 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc70ff-c890-4beb-b6a4-b3fdf66a1ab7 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:30.363392 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 774/1555] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:30.363611 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c25a93c-5c28-4c46-aaaa-324a3e355826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:30.364285 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25a93c-5c28-4c46-aaaa-324a3e355826 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.364559 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25a93c-5c28-4c46-aaaa-324a3e355826 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.364831 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c25a93c-5c28-4c46-aaaa-324a3e355826 admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.364954 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b50c0d-7d59-47bf-a57c-e22e23107a93 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.365287 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b50c0d-7d59-47bf-a57c-e22e23107a93 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.365556 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25a93c-5c28-4c46-aaaa-324a3e355826 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:01:30.365660 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b50c0d-7d59-47bf-a57c-e22e23107a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.365868 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25a93c-5c28-4c46-aaaa-324a3e355826 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:30.367772 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING py.warnings [None req-0c25a93c-5c28-4c46-aaaa-324a3e355826 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:01:30.367772 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: warnings.warn(msg) Apr 12 00:01:30.367772 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: Apr 12 00:01:30.368488 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c25a93c-5c28-4c46-aaaa-324a3e355826 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:30.385948 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 782/1556] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:01:30.385948 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f5e04-0607-49ce-9e8b-d1b5ec201a01 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.385948 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f5e04-0607-49ce-9e8b-d1b5ec201a01 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.385948 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f5e04-0607-49ce-9e8b-d1b5ec201a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.386468 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-b7b50c0d-7d59-47bf-a57c-e22e23107a93 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:30.386468 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-b7b50c0d-7d59-47bf-a57c-e22e23107a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:30.393469 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 775/1557] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:30.394708 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fce7b-a57c-4049-bb8b-c886cdf4c995 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.395146 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fce7b-a57c-4049-bb8b-c886cdf4c995 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.395414 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9fce7b-a57c-4049-bb8b-c886cdf4c995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.405442 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-ff6f5e04-0607-49ce-9e8b-d1b5ec201a01 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:30.406621 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-ff6f5e04-0607-49ce-9e8b-d1b5ec201a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:30.412814 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-4b9fce7b-a57c-4049-bb8b-c886cdf4c995 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:30.414538 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-4b9fce7b-a57c-4049-bb8b-c886cdf4c995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:30.414994 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 783/1558] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:30.416300 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be474cff-3734-49ee-a9a9-3d0a5e1bd649 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.416535 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be474cff-3734-49ee-a9a9-3d0a5e1bd649 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.416811 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be474cff-3734-49ee-a9a9-3d0a5e1bd649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.422650 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 776/1559] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:30.423456 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fce7b-a57c-4049-bb8b-c886cdf4c995 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:30.433110 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9fce7b-a57c-4049-bb8b-c886cdf4c995 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:30.435036 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-be474cff-3734-49ee-a9a9-3d0a5e1bd649 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:30.436190 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-be474cff-3734-49ee-a9a9-3d0a5e1bd649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:30.437686 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f274c62-9f34-4028-bc61-4102b8f0b6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:30.438327 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f274c62-9f34-4028-bc61-4102b8f0b6cf admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.438610 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f274c62-9f34-4028-bc61-4102b8f0b6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.438912 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f274c62-9f34-4028-bc61-4102b8f0b6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.439804 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f274c62-9f34-4028-bc61-4102b8f0b6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:30.441348 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f274c62-9f34-4028-bc61-4102b8f0b6cf admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:30.443996 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 784/1560] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:30.445284 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0330ef-6ac3-44a4-8d46-15e0e8b0ef2f None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.445565 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0330ef-6ac3-44a4-8d46-15e0e8b0ef2f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.445834 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0330ef-6ac3-44a4-8d46-15e0e8b0ef2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.452479 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 777/1561] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:30.452479 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f274c62-9f34-4028-bc61-4102b8f0b6cf admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:30.463220 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f274c62-9f34-4028-bc61-4102b8f0b6cf admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:30.464794 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-cd0330ef-6ac3-44a4-8d46-15e0e8b0ef2f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:30.465952 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-cd0330ef-6ac3-44a4-8d46-15e0e8b0ef2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:30.467811 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0354380-4338-415a-ad50-72b8177f34ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:30.468442 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0354380-4338-415a-ad50-72b8177f34ba admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.468725 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0354380-4338-415a-ad50-72b8177f34ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.469010 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0354380-4338-415a-ad50-72b8177f34ba admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.469725 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0354380-4338-415a-ad50-72b8177f34ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:01:30.470032 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0354380-4338-415a-ad50-72b8177f34ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:30.471648 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0354380-4338-415a-ad50-72b8177f34ba admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:30.474135 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 785/1562] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:30.474958 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0330ef-6ac3-44a4-8d46-15e0e8b0ef2f None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:30.484094 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 778/1563] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:01:30.485330 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373788db-835d-4554-97b9-653069fd910e None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.485617 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373788db-835d-4554-97b9-653069fd910e None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.485892 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373788db-835d-4554-97b9-653069fd910e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.489329 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0330ef-6ac3-44a4-8d46-15e0e8b0ef2f None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:30.495081 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323e954-e2c7-4e80-89e1-50b4a98969da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:30.495723 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323e954-e2c7-4e80-89e1-50b4a98969da admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.495999 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323e954-e2c7-4e80-89e1-50b4a98969da admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.496757 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d323e954-e2c7-4e80-89e1-50b4a98969da admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.497449 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323e954-e2c7-4e80-89e1-50b4a98969da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:30.499358 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d323e954-e2c7-4e80-89e1-50b4a98969da admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:30.504482 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-373788db-835d-4554-97b9-653069fd910e None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:30.505668 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-373788db-835d-4554-97b9-653069fd910e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:30.513866 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 779/1564] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:30.514654 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373788db-835d-4554-97b9-653069fd910e None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:30.523831 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373788db-835d-4554-97b9-653069fd910e None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:30.528368 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dee646-bd0a-4c1f-8584-f6a80611fc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:30.528987 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dee646-bd0a-4c1f-8584-f6a80611fc9f admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.529269 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dee646-bd0a-4c1f-8584-f6a80611fc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.529541 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dee646-bd0a-4c1f-8584-f6a80611fc9f admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.530248 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dee646-bd0a-4c1f-8584-f6a80611fc9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:01:30.530550 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dee646-bd0a-4c1f-8584-f6a80611fc9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:30.532223 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dee646-bd0a-4c1f-8584-f6a80611fc9f admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:30.544208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 780/1565] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:01:30.545119 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dee646-bd0a-4c1f-8584-f6a80611fc9f admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:30.554498 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dee646-bd0a-4c1f-8584-f6a80611fc9f admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:30.559612 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f1618-44af-4fd7-a8b3-34243e898e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:30.560226 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f1618-44af-4fd7-a8b3-34243e898e2c admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.560501 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f1618-44af-4fd7-a8b3-34243e898e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.560769 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f1618-44af-4fd7-a8b3-34243e898e2c admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.561505 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f1618-44af-4fd7-a8b3-34243e898e2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:01:30.561801 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f1618-44af-4fd7-a8b3-34243e898e2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:30.563378 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f1618-44af-4fd7-a8b3-34243e898e2c admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:30.574800 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 781/1566] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:01:30.575590 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f1618-44af-4fd7-a8b3-34243e898e2c admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:30.584556 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f1618-44af-4fd7-a8b3-34243e898e2c admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:30.588971 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b85a5-3c9f-4920-9bc1-cdc40eb18222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:30.589573 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b85a5-3c9f-4920-9bc1-cdc40eb18222 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.589846 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b85a5-3c9f-4920-9bc1-cdc40eb18222 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.590113 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b85a5-3c9f-4920-9bc1-cdc40eb18222 admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.590798 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b85a5-3c9f-4920-9bc1-cdc40eb18222 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:01:30.591124 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b85a5-3c9f-4920-9bc1-cdc40eb18222 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:30.592696 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b85a5-3c9f-4920-9bc1-cdc40eb18222 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:30.604099 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 782/1567] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:01:30.605318 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b85a5-3c9f-4920-9bc1-cdc40eb18222 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:30.617642 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 786/1568] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:01:30 2022] POST /identity/v3/projects => generated 377 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:30.618764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323e954-e2c7-4e80-89e1-50b4a98969da admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:30.623535 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b85a5-3c9f-4920-9bc1-cdc40eb18222 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:30.680689 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258d2b6-284c-4411-8cd6-3a7f786f5072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:30.681353 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258d2b6-284c-4411-8cd6-3a7f786f5072 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.681635 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258d2b6-284c-4411-8cd6-3a7f786f5072 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.681937 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6258d2b6-284c-4411-8cd6-3a7f786f5072 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.682663 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258d2b6-284c-4411-8cd6-3a7f786f5072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:30.683633 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d323e954-e2c7-4e80-89e1-50b4a98969da admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:30.684464 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6258d2b6-284c-4411-8cd6-3a7f786f5072 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:30.688213 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf612bb-bce3-4ad5-a3d8-689f552a1a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:30.688863 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf612bb-bce3-4ad5-a3d8-689f552a1a87 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.689145 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf612bb-bce3-4ad5-a3d8-689f552a1a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.689418 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf612bb-bce3-4ad5-a3d8-689f552a1a87 admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.690196 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf612bb-bce3-4ad5-a3d8-689f552a1a87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:01:30.690445 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf612bb-bce3-4ad5-a3d8-689f552a1a87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:30.692054 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf612bb-bce3-4ad5-a3d8-689f552a1a87 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:30.697548 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 783/1569] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:30.697548 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258d2b6-284c-4411-8cd6-3a7f786f5072 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:30.703494 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 787/1570] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:01:30.703494 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf612bb-bce3-4ad5-a3d8-689f552a1a87 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:30.710613 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6258d2b6-284c-4411-8cd6-3a7f786f5072 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:30.710613 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282de2c4-ebbd-48bc-a3e4-436a6071927a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:30.710613 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282de2c4-ebbd-48bc-a3e4-436a6071927a admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.710613 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282de2c4-ebbd-48bc-a3e4-436a6071927a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.711523 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282de2c4-ebbd-48bc-a3e4-436a6071927a admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.711619 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282de2c4-ebbd-48bc-a3e4-436a6071927a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:30.712544 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING py.warnings [None req-282de2c4-ebbd-48bc-a3e4-436a6071927a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:01:30.712544 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: warnings.warn(msg) Apr 12 00:01:30.712544 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: Apr 12 00:01:30.713711 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282de2c4-ebbd-48bc-a3e4-436a6071927a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:30.714064 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf612bb-bce3-4ad5-a3d8-689f552a1a87 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:30.718531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9abe1-2974-454c-b765-41626f633dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:30.719195 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9abe1-2974-454c-b765-41626f633dfa admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.719474 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9abe1-2974-454c-b765-41626f633dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.719742 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f9abe1-2974-454c-b765-41626f633dfa admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.720447 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9abe1-2974-454c-b765-41626f633dfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:01:30.720748 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9abe1-2974-454c-b765-41626f633dfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:30.722290 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f9abe1-2974-454c-b765-41626f633dfa admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:30.734880 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 788/1571] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:01:30.735650 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9abe1-2974-454c-b765-41626f633dfa admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:30.747097 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f9abe1-2974-454c-b765-41626f633dfa admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:30.751536 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a477c-c2aa-45e0-a6ec-c80c0e648190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:30.752153 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a477c-c2aa-45e0-a6ec-c80c0e648190 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.752482 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a477c-c2aa-45e0-a6ec-c80c0e648190 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.752704 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973a477c-c2aa-45e0-a6ec-c80c0e648190 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.753430 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a477c-c2aa-45e0-a6ec-c80c0e648190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:30.755326 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973a477c-c2aa-45e0-a6ec-c80c0e648190 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:30.813865 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 784/1572] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:01:30 2022] POST /identity/v3/projects => generated 389 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:30.815056 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282de2c4-ebbd-48bc-a3e4-436a6071927a admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:30.843326 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 789/1573] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:01:30 2022] POST /identity/v3/projects => generated 391 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:30.844727 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a477c-c2aa-45e0-a6ec-c80c0e648190 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:30.877257 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282de2c4-ebbd-48bc-a3e4-436a6071927a admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:30.903842 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973a477c-c2aa-45e0-a6ec-c80c0e648190 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:30.909252 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f3520-94a6-4e9d-9bbe-1b01522cd8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:30.909896 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f3520-94a6-4e9d-9bbe-1b01522cd8af admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.910171 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f3520-94a6-4e9d-9bbe-1b01522cd8af admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.910440 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f3520-94a6-4e9d-9bbe-1b01522cd8af admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.911150 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f3520-94a6-4e9d-9bbe-1b01522cd8af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:30.913044 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f3520-94a6-4e9d-9bbe-1b01522cd8af admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:30.930468 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5a5bb-819d-4bd6-a231-8024ef5e010b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:30.931153 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5a5bb-819d-4bd6-a231-8024ef5e010b admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:30.931433 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5a5bb-819d-4bd6-a231-8024ef5e010b admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:30.931708 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5a5bb-819d-4bd6-a231-8024ef5e010b admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:30.932395 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5a5bb-819d-4bd6-a231-8024ef5e010b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:30.934288 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5a5bb-819d-4bd6-a231-8024ef5e010b admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:30.991028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 790/1574] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:01:30 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:30.991028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f3520-94a6-4e9d-9bbe-1b01522cd8af admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:31.024041 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 785/1575] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:01:30 2022] POST /identity/v3/projects => generated 363 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:31.024922 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5a5bb-819d-4bd6-a231-8024ef5e010b admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:31.055382 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f3520-94a6-4e9d-9bbe-1b01522cd8af admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:31.094744 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5a5bb-819d-4bd6-a231-8024ef5e010b admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:31.099340 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0d5dd-e1d1-45b5-932e-c76f3f529416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:31.100220 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0d5dd-e1d1-45b5-932e-c76f3f529416 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:31.100503 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0d5dd-e1d1-45b5-932e-c76f3f529416 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:31.100777 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0d5dd-e1d1-45b5-932e-c76f3f529416 admin admin] PATH_INFO: `/v3/projects/8e10126821844f4cb497402dbb6c86c3/users/f03a84381dae444a907bf9624d2fefaa/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:31.115233 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0d5dd-e1d1-45b5-932e-c76f3f529416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e10126821844f4cb497402dbb6c86c3, user_id=f03a84381dae444a907bf9624d2fefaa, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:31.116656 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING py.warnings [None req-36e0d5dd-e1d1-45b5-932e-c76f3f529416 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:01:31.116656 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: warnings.warn(msg) Apr 12 00:01:31.116656 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: Apr 12 00:01:31.118228 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e0d5dd-e1d1-45b5-932e-c76f3f529416 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:31.119181 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a938db-a03b-482f-9c03-eca33e103473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:31.119850 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a938db-a03b-482f-9c03-eca33e103473 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:31.120124 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a938db-a03b-482f-9c03-eca33e103473 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:31.120394 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a938db-a03b-482f-9c03-eca33e103473 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:31.121075 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a938db-a03b-482f-9c03-eca33e103473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:31.122063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING py.warnings [None req-f4a938db-a03b-482f-9c03-eca33e103473 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:01:31.122063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: warnings.warn(msg) Apr 12 00:01:31.122063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: Apr 12 00:01:31.123277 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a938db-a03b-482f-9c03-eca33e103473 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:31.223626 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 786/1576] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:01:31 2022] PUT /identity/v3/projects/8e10126821844f4cb497402dbb6c86c3/users/f03a84381dae444a907bf9624d2fefaa/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:31.224641 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0d5dd-e1d1-45b5-932e-c76f3f529416 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:31.252060 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 791/1577] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:01:30 2022] POST /identity/v3/users => generated 289 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:31.252737 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a938db-a03b-482f-9c03-eca33e103473 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:31.262670 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a938db-a03b-482f-9c03-eca33e103473 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:31.286854 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0d5dd-e1d1-45b5-932e-c76f3f529416 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:31.291635 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b02a97-af81-4fad-850b-912d8a6c4644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:31.292293 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b02a97-af81-4fad-850b-912d8a6c4644 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:31.292576 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b02a97-af81-4fad-850b-912d8a6c4644 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:31.292849 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b02a97-af81-4fad-850b-912d8a6c4644 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:31.293540 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b02a97-af81-4fad-850b-912d8a6c4644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:31.295474 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b02a97-af81-4fad-850b-912d8a6c4644 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:31.325794 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe2647-b952-47b2-a28f-f614d26089bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:31.326490 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe2647-b952-47b2-a28f-f614d26089bd admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:31.326773 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe2647-b952-47b2-a28f-f614d26089bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:31.327084 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe2647-b952-47b2-a28f-f614d26089bd admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:31.327785 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe2647-b952-47b2-a28f-f614d26089bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:31.329780 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe2647-b952-47b2-a28f-f614d26089bd admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:31.379842 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 787/1578] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:01:31 2022] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:31.380898 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b02a97-af81-4fad-850b-912d8a6c4644 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:31.403585 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 792/1579] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:01:31 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:31.403585 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe2647-b952-47b2-a28f-f614d26089bd admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:31.441048 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b02a97-af81-4fad-850b-912d8a6c4644 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:31.461313 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe2647-b952-47b2-a28f-f614d26089bd admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:31.465849 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7bf91-c19d-4923-aa0f-8e5646031f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:31.466566 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7bf91-c19d-4923-aa0f-8e5646031f70 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:31.466853 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7bf91-c19d-4923-aa0f-8e5646031f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:31.467145 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b7bf91-c19d-4923-aa0f-8e5646031f70 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:31.467827 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7bf91-c19d-4923-aa0f-8e5646031f70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:31.469758 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b7bf91-c19d-4923-aa0f-8e5646031f70 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:31.495685 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be7103-93bd-431d-b66f-44eb3aeccab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:31.496378 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be7103-93bd-431d-b66f-44eb3aeccab5 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:31.496668 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be7103-93bd-431d-b66f-44eb3aeccab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:31.496941 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be7103-93bd-431d-b66f-44eb3aeccab5 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:31.498104 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be7103-93bd-431d-b66f-44eb3aeccab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:31.500029 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96be7103-93bd-431d-b66f-44eb3aeccab5 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:31.564986 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 793/1580] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:01:31 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:31.565725 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7bf91-c19d-4923-aa0f-8e5646031f70 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:31.575527 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b7bf91-c19d-4923-aa0f-8e5646031f70 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:31.579982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8f664-2f18-4280-b515-45def44c84c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:31.580794 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8f664-2f18-4280-b515-45def44c84c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:31.581002 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8f664-2f18-4280-b515-45def44c84c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:31.581275 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8f664-2f18-4280-b515-45def44c84c4 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:31.581951 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8f664-2f18-4280-b515-45def44c84c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:31.583880 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8f664-2f18-4280-b515-45def44c84c4 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:31.589373 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 788/1581] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:01:31 2022] POST /identity/v3/users => generated 295 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:31.589373 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be7103-93bd-431d-b66f-44eb3aeccab5 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:31.598697 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be7103-93bd-431d-b66f-44eb3aeccab5 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:31.603273 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ea3ff-2f29-426b-8e35-82ceb2405bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:31.603909 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ea3ff-2f29-426b-8e35-82ceb2405bfc admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:31.604191 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ea3ff-2f29-426b-8e35-82ceb2405bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:31.604465 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241ea3ff-2f29-426b-8e35-82ceb2405bfc admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:31.605488 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ea3ff-2f29-426b-8e35-82ceb2405bfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:31.607420 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241ea3ff-2f29-426b-8e35-82ceb2405bfc admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:31.683378 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 794/1582] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:01:31 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:31.684677 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d63346-d89c-494e-841b-66201f1e92d7 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:31.684961 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d63346-d89c-494e-841b-66201f1e92d7 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:31.685234 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d63346-d89c-494e-841b-66201f1e92d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:31.702612 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-62d63346-d89c-494e-841b-66201f1e92d7 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:31.703837 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-62d63346-d89c-494e-841b-66201f1e92d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:31.711550 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 795/1583] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:31.713939 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d63346-d89c-494e-841b-66201f1e92d7 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:31.715621 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 789/1584] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:01:31 2022] POST /identity/v3/users => generated 282 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:31.716592 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ea3ff-2f29-426b-8e35-82ceb2405bfc admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:31.723879 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d63346-d89c-494e-841b-66201f1e92d7 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:31.726508 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241ea3ff-2f29-426b-8e35-82ceb2405bfc admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:31.728711 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d097ea-f076-4f70-a3d4-8e092dac9a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:31.729366 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d097ea-f076-4f70-a3d4-8e092dac9a4d admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:31.729643 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d097ea-f076-4f70-a3d4-8e092dac9a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:31.730235 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d097ea-f076-4f70-a3d4-8e092dac9a4d admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:31.730963 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d097ea-f076-4f70-a3d4-8e092dac9a4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:31.731726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576eb91a-e377-4483-9c90-77d552309e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:31.732383 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576eb91a-e377-4483-9c90-77d552309e27 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:31.732534 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d097ea-f076-4f70-a3d4-8e092dac9a4d admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:31.732662 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576eb91a-e377-4483-9c90-77d552309e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:31.732937 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576eb91a-e377-4483-9c90-77d552309e27 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:31.733625 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576eb91a-e377-4483-9c90-77d552309e27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:31.735572 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576eb91a-e377-4483-9c90-77d552309e27 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:31.743064 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 796/1585] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:31.743897 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d097ea-f076-4f70-a3d4-8e092dac9a4d admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:31.753247 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d097ea-f076-4f70-a3d4-8e092dac9a4d admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:31.758736 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de2dae-52d2-499b-8914-1218c1e96cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:31.759411 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de2dae-52d2-499b-8914-1218c1e96cef admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:31.759689 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de2dae-52d2-499b-8914-1218c1e96cef admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:31.759960 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65de2dae-52d2-499b-8914-1218c1e96cef admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:31.760646 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de2dae-52d2-499b-8914-1218c1e96cef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:31.762603 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65de2dae-52d2-499b-8914-1218c1e96cef admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:31.823927 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 790/1586] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:01:31 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:31.824693 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576eb91a-e377-4483-9c90-77d552309e27 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:31.833928 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576eb91a-e377-4483-9c90-77d552309e27 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:31.838429 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd037e43-6ae9-433e-8504-bdd3ae3511cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:31.839089 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd037e43-6ae9-433e-8504-bdd3ae3511cd admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:31.839372 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd037e43-6ae9-433e-8504-bdd3ae3511cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:31.839652 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd037e43-6ae9-433e-8504-bdd3ae3511cd admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:31.840369 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd037e43-6ae9-433e-8504-bdd3ae3511cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:31.841955 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd037e43-6ae9-433e-8504-bdd3ae3511cd admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:31.846684 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 797/1587] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:01:31 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:31.847746 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de2dae-52d2-499b-8914-1218c1e96cef admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:31.853429 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 791/1588] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:31.854495 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd037e43-6ae9-433e-8504-bdd3ae3511cd admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:31.858722 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65de2dae-52d2-499b-8914-1218c1e96cef admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:31.863601 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae84300-c2f0-4c9d-a16f-1c93fd3c378b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:31.864108 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd037e43-6ae9-433e-8504-bdd3ae3511cd admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:31.864233 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae84300-c2f0-4c9d-a16f-1c93fd3c378b admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:31.864572 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae84300-c2f0-4c9d-a16f-1c93fd3c378b admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:31.864848 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae84300-c2f0-4c9d-a16f-1c93fd3c378b admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:31.865570 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae84300-c2f0-4c9d-a16f-1c93fd3c378b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:31.867910 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae84300-c2f0-4c9d-a16f-1c93fd3c378b admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:31.869272 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c8137-3ce4-4629-9294-51df1d1ed276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:31.869904 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c8137-3ce4-4629-9294-51df1d1ed276 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:31.870185 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c8137-3ce4-4629-9294-51df1d1ed276 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:31.870456 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c8137-3ce4-4629-9294-51df1d1ed276 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:31.871209 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c8137-3ce4-4629-9294-51df1d1ed276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:31.872759 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c8137-3ce4-4629-9294-51df1d1ed276 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:31.878348 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 798/1589] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:31.879167 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae84300-c2f0-4c9d-a16f-1c93fd3c378b admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:31.886279 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 792/1590] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:31.886279 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c8137-3ce4-4629-9294-51df1d1ed276 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:31.889729 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae84300-c2f0-4c9d-a16f-1c93fd3c378b admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:31.894244 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4031d-91a9-421e-b051-1a8aab971689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:31.894963 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4031d-91a9-421e-b051-1a8aab971689 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:31.895232 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4031d-91a9-421e-b051-1a8aab971689 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:31.895503 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4031d-91a9-421e-b051-1a8aab971689 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:31.896252 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4031d-91a9-421e-b051-1a8aab971689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:31.897831 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de4031d-91a9-421e-b051-1a8aab971689 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:31.907712 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 799/1591] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:31.908543 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4031d-91a9-421e-b051-1a8aab971689 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:31.918444 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4031d-91a9-421e-b051-1a8aab971689 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:31.923198 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35798bd5-2113-4d46-b40b-017dc5f48530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:31.923818 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35798bd5-2113-4d46-b40b-017dc5f48530 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:31.924094 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35798bd5-2113-4d46-b40b-017dc5f48530 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:31.924365 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35798bd5-2113-4d46-b40b-017dc5f48530 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:31.925092 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35798bd5-2113-4d46-b40b-017dc5f48530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:31.926625 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35798bd5-2113-4d46-b40b-017dc5f48530 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:31.936729 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 800/1592] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:31.937505 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35798bd5-2113-4d46-b40b-017dc5f48530 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:31.939478 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c8137-3ce4-4629-9294-51df1d1ed276 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:31.943464 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dfcd3-84b3-4350-8acc-f444fceb9634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:31.943777 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dfcd3-84b3-4350-8acc-f444fceb9634 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:31.944056 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dfcd3-84b3-4350-8acc-f444fceb9634 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:31.944329 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6dfcd3-84b3-4350-8acc-f444fceb9634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:31.947153 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35798bd5-2113-4d46-b40b-017dc5f48530 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:31.951615 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f9a48-e60a-4980-9629-4f760d5f522d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:31.952245 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f9a48-e60a-4980-9629-4f760d5f522d admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:31.952520 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f9a48-e60a-4980-9629-4f760d5f522d admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:31.952788 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6f9a48-e60a-4980-9629-4f760d5f522d admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:31.953495 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f9a48-e60a-4980-9629-4f760d5f522d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:31.955060 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6f9a48-e60a-4980-9629-4f760d5f522d admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:31.957177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6dfcd3-84b3-4350-8acc-f444fceb9634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:31.958667 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6dfcd3-84b3-4350-8acc-f444fceb9634 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:31.965596 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 801/1593] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:31.966207 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f9a48-e60a-4980-9629-4f760d5f522d admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:31.969553 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 793/1594] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:01:31.970331 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dfcd3-84b3-4350-8acc-f444fceb9634 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:31.976758 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6f9a48-e60a-4980-9629-4f760d5f522d admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:31.980755 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6dfcd3-84b3-4350-8acc-f444fceb9634 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:31.981760 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ec313-a3e3-43c1-8ba4-2d8698c7e716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:31.982386 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ec313-a3e3-43c1-8ba4-2d8698c7e716 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:31.982666 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ec313-a3e3-43c1-8ba4-2d8698c7e716 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:31.982972 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ec313-a3e3-43c1-8ba4-2d8698c7e716 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:31.983700 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ec313-a3e3-43c1-8ba4-2d8698c7e716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:31.985321 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ec313-a3e3-43c1-8ba4-2d8698c7e716 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:31.985793 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40037b0e-47b8-48d5-92c2-c7c76fb1aa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:31.986882 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40037b0e-47b8-48d5-92c2-c7c76fb1aa0e admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:31.986882 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40037b0e-47b8-48d5-92c2-c7c76fb1aa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:31.987081 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40037b0e-47b8-48d5-92c2-c7c76fb1aa0e admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:31.987693 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40037b0e-47b8-48d5-92c2-c7c76fb1aa0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:31.989406 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40037b0e-47b8-48d5-92c2-c7c76fb1aa0e admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:31.996681 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 802/1595] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:31.997503 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ec313-a3e3-43c1-8ba4-2d8698c7e716 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:32.000361 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 794/1596] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:32.001169 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40037b0e-47b8-48d5-92c2-c7c76fb1aa0e admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:32.008780 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ec313-a3e3-43c1-8ba4-2d8698c7e716 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:32.012489 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40037b0e-47b8-48d5-92c2-c7c76fb1aa0e admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:32.013487 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea21f9f-f580-496b-9dca-21bc30908da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:32.014198 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea21f9f-f580-496b-9dca-21bc30908da3 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:32.014407 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea21f9f-f580-496b-9dca-21bc30908da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:32.014699 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea21f9f-f580-496b-9dca-21bc30908da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:32.015445 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea21f9f-f580-496b-9dca-21bc30908da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:32.017010 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea21f9f-f580-496b-9dca-21bc30908da3 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:32.017242 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132a993-047b-4893-82b3-9799172b0de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:32.017883 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132a993-047b-4893-82b3-9799172b0de6 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:32.018162 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132a993-047b-4893-82b3-9799172b0de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:32.018436 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132a993-047b-4893-82b3-9799172b0de6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:32.019251 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132a993-047b-4893-82b3-9799172b0de6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:32.020838 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9132a993-047b-4893-82b3-9799172b0de6 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:32.026732 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 803/1597] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:32.027665 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea21f9f-f580-496b-9dca-21bc30908da3 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:32.033807 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 795/1598] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:32.033807 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132a993-047b-4893-82b3-9799172b0de6 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:32.039566 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea21f9f-f580-496b-9dca-21bc30908da3 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:32.041512 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132a993-047b-4893-82b3-9799172b0de6 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:32.044157 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815fb7a-e239-43bb-8739-2b39f24f33f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:32.044797 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815fb7a-e239-43bb-8739-2b39f24f33f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:32.045076 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815fb7a-e239-43bb-8739-2b39f24f33f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:32.045344 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6815fb7a-e239-43bb-8739-2b39f24f33f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:32.045996 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ec324-a271-404e-8e6b-65f9a0227fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:32.046130 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815fb7a-e239-43bb-8739-2b39f24f33f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:32.046863 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ec324-a271-404e-8e6b-65f9a0227fd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:32.047165 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ec324-a271-404e-8e6b-65f9a0227fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:32.047560 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0ec324-a271-404e-8e6b-65f9a0227fd4 admin admin] PATH_INFO: `/v3/projects/d37d376de665470ab663729e12178191/users/cc2c179ab0e24fb09d97385cf0894428/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:32.047684 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6815fb7a-e239-43bb-8739-2b39f24f33f0 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:32.058369 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 804/1599] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:32.059262 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815fb7a-e239-43bb-8739-2b39f24f33f0 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:32.063056 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ec324-a271-404e-8e6b-65f9a0227fd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d37d376de665470ab663729e12178191, user_id=cc2c179ab0e24fb09d97385cf0894428, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:32.065864 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0ec324-a271-404e-8e6b-65f9a0227fd4 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:32.068766 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6815fb7a-e239-43bb-8739-2b39f24f33f0 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:32.073774 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e2f12-75a4-4de5-8d8a-e0b18a711289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:32.074481 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e2f12-75a4-4de5-8d8a-e0b18a711289 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:32.074703 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e2f12-75a4-4de5-8d8a-e0b18a711289 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:32.075043 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e2f12-75a4-4de5-8d8a-e0b18a711289 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:32.075764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e2f12-75a4-4de5-8d8a-e0b18a711289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:32.077329 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e2f12-75a4-4de5-8d8a-e0b18a711289 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:32.087660 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 805/1600] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:32.088537 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e2f12-75a4-4de5-8d8a-e0b18a711289 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:32.098179 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e2f12-75a4-4de5-8d8a-e0b18a711289 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:32.103505 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f918b-891b-4003-b2f2-7d7e31de6107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:32.104166 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f918b-891b-4003-b2f2-7d7e31de6107 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:32.104550 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f918b-891b-4003-b2f2-7d7e31de6107 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:32.105080 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996f918b-891b-4003-b2f2-7d7e31de6107 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:32.105821 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f918b-891b-4003-b2f2-7d7e31de6107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:32.107552 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996f918b-891b-4003-b2f2-7d7e31de6107 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:32.118239 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 806/1601] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:32.119654 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f918b-891b-4003-b2f2-7d7e31de6107 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:32.127647 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 796/1602] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:01:32 2022] PUT /identity/v3/projects/d37d376de665470ab663729e12178191/users/cc2c179ab0e24fb09d97385cf0894428/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:32.128526 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ec324-a271-404e-8e6b-65f9a0227fd4 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:32.130232 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996f918b-891b-4003-b2f2-7d7e31de6107 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:32.193169 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044da1b-1ac4-45e0-af75-678fed6379df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:32.194176 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044da1b-1ac4-45e0-af75-678fed6379df admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:32.194470 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0ec324-a271-404e-8e6b-65f9a0227fd4 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:32.194632 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044da1b-1ac4-45e0-af75-678fed6379df admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:32.194934 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f044da1b-1ac4-45e0-af75-678fed6379df admin admin] PATH_INFO: `/v3/projects/a6462994c4f146a2a17f698efbaeb2dc/users/7b5417dc6db1461e94de39f4d2ca8f2c/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:32.199276 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753a214-2162-45a8-ab88-8caaad8f04e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:32.200227 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753a214-2162-45a8-ab88-8caaad8f04e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:32.200502 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753a214-2162-45a8-ab88-8caaad8f04e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:32.200768 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753a214-2162-45a8-ab88-8caaad8f04e2 admin admin] PATH_INFO: `/v3/projects/f86f93d46d394081b4da1693c28e9c7e/users/1da750621eb94e5db8e50dddb008602c/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:32.209300 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044da1b-1ac4-45e0-af75-678fed6379df admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6462994c4f146a2a17f698efbaeb2dc, user_id=7b5417dc6db1461e94de39f4d2ca8f2c, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:32.212508 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f044da1b-1ac4-45e0-af75-678fed6379df admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:32.216830 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753a214-2162-45a8-ab88-8caaad8f04e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f86f93d46d394081b4da1693c28e9c7e, user_id=1da750621eb94e5db8e50dddb008602c, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:32.217883 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7753a214-2162-45a8-ab88-8caaad8f04e2 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:32.321646 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 807/1603] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:01:32 2022] PUT /identity/v3/projects/a6462994c4f146a2a17f698efbaeb2dc/users/7b5417dc6db1461e94de39f4d2ca8f2c/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:32.326042 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044da1b-1ac4-45e0-af75-678fed6379df admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:32.326299 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 797/1604] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:01:32 2022] PUT /identity/v3/projects/f86f93d46d394081b4da1693c28e9c7e/users/1da750621eb94e5db8e50dddb008602c/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:32.327814 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753a214-2162-45a8-ab88-8caaad8f04e2 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:32.393889 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7753a214-2162-45a8-ab88-8caaad8f04e2 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:32.394756 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f044da1b-1ac4-45e0-af75-678fed6379df admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:32.400068 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de5748-fe23-4fc4-9e2d-543293de39ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:32.400241 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66616ec9-4d63-4130-995c-1676cffff385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:32.401007 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de5748-fe23-4fc4-9e2d-543293de39ae admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:32.401137 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66616ec9-4d63-4130-995c-1676cffff385 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:32.401349 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de5748-fe23-4fc4-9e2d-543293de39ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:32.401463 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66616ec9-4d63-4130-995c-1676cffff385 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:32.401561 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de5748-fe23-4fc4-9e2d-543293de39ae admin admin] PATH_INFO: `/v3/projects/502a61fa984340a1b0d452d8eb70236a/users/4a999b1c1098441fb478ecda69a350a1/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:32.401643 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66616ec9-4d63-4130-995c-1676cffff385 admin admin] PATH_INFO: `/v3/projects/05a65e651e1f43289e5a6f40a8cc2ab8/users/8757ffd8c9ed4e5aa0eeb5f8d0a25666/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:32.417303 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66616ec9-4d63-4130-995c-1676cffff385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a65e651e1f43289e5a6f40a8cc2ab8, user_id=8757ffd8c9ed4e5aa0eeb5f8d0a25666, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:32.417516 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de5748-fe23-4fc4-9e2d-543293de39ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=502a61fa984340a1b0d452d8eb70236a, user_id=4a999b1c1098441fb478ecda69a350a1, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:32.420062 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de5748-fe23-4fc4-9e2d-543293de39ae admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:32.420243 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66616ec9-4d63-4130-995c-1676cffff385 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:32.510257 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 808/1605] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:01:32 2022] PUT /identity/v3/projects/502a61fa984340a1b0d452d8eb70236a/users/4a999b1c1098441fb478ecda69a350a1/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:32.511408 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de5748-fe23-4fc4-9e2d-543293de39ae admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:32.519345 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 798/1606] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:01:32 2022] PUT /identity/v3/projects/05a65e651e1f43289e5a6f40a8cc2ab8/users/8757ffd8c9ed4e5aa0eeb5f8d0a25666/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:32.520839 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66616ec9-4d63-4130-995c-1676cffff385 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:32.589960 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de5748-fe23-4fc4-9e2d-543293de39ae admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:32.590169 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66616ec9-4d63-4130-995c-1676cffff385 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:32.602480 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc616b6d-e446-44aa-945d-1a6dba1329c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:32.603784 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc616b6d-e446-44aa-945d-1a6dba1329c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:32.604064 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc616b6d-e446-44aa-945d-1a6dba1329c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:32.604331 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc616b6d-e446-44aa-945d-1a6dba1329c6 admin admin] PATH_INFO: `/v3/projects/1f6b404679504360b53cc5f6dd9fe18b/users/759502bd797647459ba0f1b6860acc64/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:32.605683 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b51bb-7f94-40a0-a415-89a3f7a6ab73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:32.606730 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b51bb-7f94-40a0-a415-89a3f7a6ab73 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:32.607034 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b51bb-7f94-40a0-a415-89a3f7a6ab73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:32.607300 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b51bb-7f94-40a0-a415-89a3f7a6ab73 admin admin] PATH_INFO: `/v3/projects/d0ec6f41f918426096d78a95fa0ad353/users/c2cb6daf2a694c64a0d2a39324d8672e/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:32.624837 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc616b6d-e446-44aa-945d-1a6dba1329c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f6b404679504360b53cc5f6dd9fe18b, user_id=759502bd797647459ba0f1b6860acc64, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:32.629730 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b51bb-7f94-40a0-a415-89a3f7a6ab73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ec6f41f918426096d78a95fa0ad353, user_id=c2cb6daf2a694c64a0d2a39324d8672e, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:32.629853 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc616b6d-e446-44aa-945d-1a6dba1329c6 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:32.629934 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b51bb-7f94-40a0-a415-89a3f7a6ab73 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:32.715630 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 799/1608] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:01:32 2022] PUT /identity/v3/projects/d0ec6f41f918426096d78a95fa0ad353/users/c2cb6daf2a694c64a0d2a39324d8672e/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:32.717007 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dede193-a10e-4cf4-952a-beef954b12f0 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:32.717296 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dede193-a10e-4cf4-952a-beef954b12f0 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:32.717582 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dede193-a10e-4cf4-952a-beef954b12f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:32.735643 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 809/1608] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:01:32 2022] PUT /identity/v3/projects/1f6b404679504360b53cc5f6dd9fe18b/users/759502bd797647459ba0f1b6860acc64/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:32.735643 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5d0b7-6fd3-4f68-89fd-716b750501bf None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:32.735643 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5d0b7-6fd3-4f68-89fd-716b750501bf None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:32.735643 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5d0b7-6fd3-4f68-89fd-716b750501bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:32.736380 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-9dede193-a10e-4cf4-952a-beef954b12f0 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:32.738120 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-9dede193-a10e-4cf4-952a-beef954b12f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:32.754146 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-6ee5d0b7-6fd3-4f68-89fd-716b750501bf None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:32.757499 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-6ee5d0b7-6fd3-4f68-89fd-716b750501bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:32.800382 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 800/1609] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:32.802120 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777434a-9364-4e23-9c1a-5e480d744603 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:32.802482 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777434a-9364-4e23-9c1a-5e480d744603 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:32.802879 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8777434a-9364-4e23-9c1a-5e480d744603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:32.822456 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-8777434a-9364-4e23-9c1a-5e480d744603 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:32.823732 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-8777434a-9364-4e23-9c1a-5e480d744603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:32.834987 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 810/1611] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:32.835165 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 801/1611] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:32.835165 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824910e7-0fa9-44d6-8df2-f0f869fb454b None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:32.835165 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824910e7-0fa9-44d6-8df2-f0f869fb454b None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:32.835165 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824910e7-0fa9-44d6-8df2-f0f869fb454b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:32.836644 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece9a80-e882-4011-91e5-4288eec159ee None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:32.836960 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece9a80-e882-4011-91e5-4288eec159ee None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:32.837236 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece9a80-e882-4011-91e5-4288eec159ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:32.864500 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-824910e7-0fa9-44d6-8df2-f0f869fb454b None None] MFA Rules not processed for user `8757ffd8c9ed4e5aa0eeb5f8d0a25666`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:32.865722 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-824910e7-0fa9-44d6-8df2-f0f869fb454b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:32.865866 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-7ece9a80-e882-4011-91e5-4288eec159ee None None] MFA Rules not processed for user `4a999b1c1098441fb478ecda69a350a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:32.867583 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-7ece9a80-e882-4011-91e5-4288eec159ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:32.928525 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 802/1612] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:32 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:32.929611 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 811/1613] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:32.933419 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae6a14-00fc-4ae3-8fb4-75c6f36e2f6f None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:32.933419 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae6a14-00fc-4ae3-8fb4-75c6f36e2f6f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:32.933419 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae6a14-00fc-4ae3-8fb4-75c6f36e2f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:32.933740 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed802f8e-c7dd-47a9-81e2-31b674d3cb3f None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:32.933740 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed802f8e-c7dd-47a9-81e2-31b674d3cb3f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:32.933740 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed802f8e-c7dd-47a9-81e2-31b674d3cb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:32.957437 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-ed802f8e-c7dd-47a9-81e2-31b674d3cb3f None None] MFA Rules not processed for user `c2cb6daf2a694c64a0d2a39324d8672e`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:32.957682 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-94ae6a14-00fc-4ae3-8fb4-75c6f36e2f6f None None] MFA Rules not processed for user `759502bd797647459ba0f1b6860acc64`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:32.958629 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-ed802f8e-c7dd-47a9-81e2-31b674d3cb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:32.959200 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-94ae6a14-00fc-4ae3-8fb4-75c6f36e2f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:33.032854 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 803/1614] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:33.034091 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae6a14-00fc-4ae3-8fb4-75c6f36e2f6f None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:33.035398 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-94ae6a14-00fc-4ae3-8fb4-75c6f36e2f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:33.038434 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 812/1615] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:33.040239 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed802f8e-c7dd-47a9-81e2-31b674d3cb3f None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:33.041790 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-ed802f8e-c7dd-47a9-81e2-31b674d3cb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:33.093687 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae6a14-00fc-4ae3-8fb4-75c6f36e2f6f None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:33.097600 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db85bc9-4cb7-448f-8f96-76d2750de2b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:33.098391 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db85bc9-4cb7-448f-8f96-76d2750de2b7 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:33.098664 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db85bc9-4cb7-448f-8f96-76d2750de2b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:33.099514 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db85bc9-4cb7-448f-8f96-76d2750de2b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:33.100117 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed802f8e-c7dd-47a9-81e2-31b674d3cb3f None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:33.103748 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2b246-9a40-4d37-a041-4bab50394c45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:33.104395 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2b246-9a40-4d37-a041-4bab50394c45 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:33.105091 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2b246-9a40-4d37-a041-4bab50394c45 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:33.105366 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2b246-9a40-4d37-a041-4bab50394c45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:33.109170 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db85bc9-4cb7-448f-8f96-76d2750de2b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:33.110594 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db85bc9-4cb7-448f-8f96-76d2750de2b7 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:33.114879 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2b246-9a40-4d37-a041-4bab50394c45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:33.116241 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b2b246-9a40-4d37-a041-4bab50394c45 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:33.120665 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 804/1616] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:01:33.123777 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db85bc9-4cb7-448f-8f96-76d2750de2b7 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:33.126765 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 813/1617] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:01:33.127585 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2b246-9a40-4d37-a041-4bab50394c45 service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:33.131975 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db85bc9-4cb7-448f-8f96-76d2750de2b7 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:33.136826 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e90f67-c444-4f33-8f28-64bfdb77eab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:33.137220 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2b246-9a40-4d37-a041-4bab50394c45 service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:33.137462 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e90f67-c444-4f33-8f28-64bfdb77eab6 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:33.137741 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e90f67-c444-4f33-8f28-64bfdb77eab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:33.138018 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e90f67-c444-4f33-8f28-64bfdb77eab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:33.142175 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cf406-7054-48c0-937a-0519249f63cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:33.142945 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cf406-7054-48c0-937a-0519249f63cb admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:33.143129 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cf406-7054-48c0-937a-0519249f63cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:33.143666 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cf406-7054-48c0-937a-0519249f63cb admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:33.144080 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cf406-7054-48c0-937a-0519249f63cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:33.145998 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cf406-7054-48c0-937a-0519249f63cb admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:33.147659 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e90f67-c444-4f33-8f28-64bfdb77eab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:33.149109 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e90f67-c444-4f33-8f28-64bfdb77eab6 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:33.159501 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 805/1618] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:01:33.160301 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e90f67-c444-4f33-8f28-64bfdb77eab6 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:33.169450 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e90f67-c444-4f33-8f28-64bfdb77eab6 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:33.185846 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fda8c-f0a0-48f8-aa60-08e75699f434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:33.186549 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fda8c-f0a0-48f8-aa60-08e75699f434 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:33.186914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fda8c-f0a0-48f8-aa60-08e75699f434 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:33.187196 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fda8c-f0a0-48f8-aa60-08e75699f434 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:33.187927 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69fda8c-f0a0-48f8-aa60-08e75699f434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:33.190360 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69fda8c-f0a0-48f8-aa60-08e75699f434 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:33.264879 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 814/1619] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:01:33 2022] POST /identity/v3/projects => generated 363 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:33.265935 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cf406-7054-48c0-937a-0519249f63cb admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:33.312695 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 806/1620] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:01:33 2022] POST /identity/v3/projects => generated 371 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:33.314271 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a01304-da40-46ee-be59-38fdbe3d587e None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:33.315123 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a01304-da40-46ee-be59-38fdbe3d587e None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:33.315509 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a01304-da40-46ee-be59-38fdbe3d587e None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:33.327973 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 807/1621] 10.222.0.24 () {54 vars in 959 bytes} [Tue Apr 12 00:01:33 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:01:33.329084 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a01304-da40-46ee-be59-38fdbe3d587e None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:33.339865 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cf406-7054-48c0-937a-0519249f63cb admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:33.409933 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d0891-ab61-4389-a1ae-d8dbe5c4754e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:33.410623 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d0891-ab61-4389-a1ae-d8dbe5c4754e admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:33.410954 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d0891-ab61-4389-a1ae-d8dbe5c4754e admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:33.411236 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24d0891-ab61-4389-a1ae-d8dbe5c4754e admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:33.412439 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d0891-ab61-4389-a1ae-d8dbe5c4754e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:33.415069 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24d0891-ab61-4389-a1ae-d8dbe5c4754e admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:33.458524 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a01304-da40-46ee-be59-38fdbe3d587e None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:33.465867 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a3ca56-a51e-41eb-83d5-16fbbda382df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:33.466612 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3ca56-a51e-41eb-83d5-16fbbda382df admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:33.467092 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3ca56-a51e-41eb-83d5-16fbbda382df admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:33.467470 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a3ca56-a51e-41eb-83d5-16fbbda382df admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:33.468272 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3ca56-a51e-41eb-83d5-16fbbda382df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:33.470298 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a3ca56-a51e-41eb-83d5-16fbbda382df admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:33.529512 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 815/1622] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:01:33 2022] POST /identity/v3/projects => generated 381 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:33.530659 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d0891-ab61-4389-a1ae-d8dbe5c4754e admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:33.609479 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24d0891-ab61-4389-a1ae-d8dbe5c4754e admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:33.614365 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54836f5-8c7f-4a81-ae9c-7dd1194ec832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:33.615111 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54836f5-8c7f-4a81-ae9c-7dd1194ec832 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:33.615340 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54836f5-8c7f-4a81-ae9c-7dd1194ec832 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:33.615672 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54836f5-8c7f-4a81-ae9c-7dd1194ec832 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:33.617562 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54836f5-8c7f-4a81-ae9c-7dd1194ec832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:33.618297 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 808/1623] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:01:33 2022] POST /identity/v3/users => generated 288 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:33.620054 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54836f5-8c7f-4a81-ae9c-7dd1194ec832 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:33.620897 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173944d-9711-4d6e-8d31-d8711c95c568 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:33.621833 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173944d-9711-4d6e-8d31-d8711c95c568 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:33.622220 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173944d-9711-4d6e-8d31-d8711c95c568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:33.650664 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-c173944d-9711-4d6e-8d31-d8711c95c568 None None] MFA Rules not processed for user `a9519f49f897415a894c1121278dda9c`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:33.653170 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-c173944d-9711-4d6e-8d31-d8711c95c568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:33.738252 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 809/1624] 10.222.0.24 () {58 vars in 1056 bytes} [Tue Apr 12 00:01:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:33.739268 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173944d-9711-4d6e-8d31-d8711c95c568 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:33.749514 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 816/1625] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:01:33 2022] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:33.749967 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173944d-9711-4d6e-8d31-d8711c95c568 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:33.750860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54836f5-8c7f-4a81-ae9c-7dd1194ec832 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:33.757248 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d3c90-6a92-4b0c-9820-76b1683da4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:33.758111 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d3c90-6a92-4b0c-9820-76b1683da4ae admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:33.758465 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d3c90-6a92-4b0c-9820-76b1683da4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:33.758818 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d3c90-6a92-4b0c-9820-76b1683da4ae admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:33.759616 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d3c90-6a92-4b0c-9820-76b1683da4ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:33.761616 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d3c90-6a92-4b0c-9820-76b1683da4ae admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:33.762034 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54836f5-8c7f-4a81-ae9c-7dd1194ec832 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:33.781894 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980e455-1a4d-4d07-8173-94b12974392e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:33.782601 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980e455-1a4d-4d07-8173-94b12974392e admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:33.785240 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980e455-1a4d-4d07-8173-94b12974392e admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:33.785240 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980e455-1a4d-4d07-8173-94b12974392e admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:33.785240 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980e455-1a4d-4d07-8173-94b12974392e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:33.786273 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980e455-1a4d-4d07-8173-94b12974392e admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:33.801959 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 817/1626] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:33.801959 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980e455-1a4d-4d07-8173-94b12974392e admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:33.814581 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980e455-1a4d-4d07-8173-94b12974392e admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:33.831180 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46760c8-8b83-4055-9df1-5643d15b463d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:33.832864 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46760c8-8b83-4055-9df1-5643d15b463d service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:33.834120 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46760c8-8b83-4055-9df1-5643d15b463d service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:33.834677 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46760c8-8b83-4055-9df1-5643d15b463d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:33.916462 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46760c8-8b83-4055-9df1-5643d15b463d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:33.917020 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 810/1627] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:01:33 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:33.917375 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46760c8-8b83-4055-9df1-5643d15b463d service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:33.917476 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d3c90-6a92-4b0c-9820-76b1683da4ae admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:33.932232 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d3c90-6a92-4b0c-9820-76b1683da4ae admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:33.938711 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13630381-8e9c-410f-bdfd-57cd450ec94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:33.950953 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13630381-8e9c-410f-bdfd-57cd450ec94b admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:33.950953 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13630381-8e9c-410f-bdfd-57cd450ec94b admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:33.950953 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13630381-8e9c-410f-bdfd-57cd450ec94b admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:33.950953 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13630381-8e9c-410f-bdfd-57cd450ec94b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:33.950953 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13630381-8e9c-410f-bdfd-57cd450ec94b admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:33.958712 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 811/1628] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:33.958712 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13630381-8e9c-410f-bdfd-57cd450ec94b admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:33.959025 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 818/1629] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:01:33.959733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46760c8-8b83-4055-9df1-5643d15b463d service nova] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:33.968414 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13630381-8e9c-410f-bdfd-57cd450ec94b admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:33.973985 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5e364-f43d-413f-8f6b-95e5c047e6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:33.975077 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5e364-f43d-413f-8f6b-95e5c047e6c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:33.975340 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5e364-f43d-413f-8f6b-95e5c047e6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:33.975753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5e364-f43d-413f-8f6b-95e5c047e6c5 admin admin] PATH_INFO: `/v3/projects/f188611031d5470c85cdb5476ecc1bfd/users/1f4af17f2abd499997b201d2f30bad48/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:33.998021 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5e364-f43d-413f-8f6b-95e5c047e6c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f188611031d5470c85cdb5476ecc1bfd, user_id=1f4af17f2abd499997b201d2f30bad48, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:34.002088 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5e364-f43d-413f-8f6b-95e5c047e6c5 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:34.002249 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46760c8-8b83-4055-9df1-5643d15b463d service nova] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:34.018012 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c0dac-165c-403a-a9f8-a6c16d77bff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:34.018715 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c0dac-165c-403a-a9f8-a6c16d77bff4 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:34.019026 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c0dac-165c-403a-a9f8-a6c16d77bff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:34.019301 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c0dac-165c-403a-a9f8-a6c16d77bff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:34.020059 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c0dac-165c-403a-a9f8-a6c16d77bff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:34.024158 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c0dac-165c-403a-a9f8-a6c16d77bff4 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:34.045270 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 819/1630] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:34.045270 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c0dac-165c-403a-a9f8-a6c16d77bff4 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:34.068364 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c0dac-165c-403a-a9f8-a6c16d77bff4 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:34.075170 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d156e-60f2-454a-b76b-f09d44c9499c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:34.076269 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d156e-60f2-454a-b76b-f09d44c9499c admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:34.076698 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d156e-60f2-454a-b76b-f09d44c9499c admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:34.077118 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d156e-60f2-454a-b76b-f09d44c9499c admin admin] PATH_INFO: `/v3/projects/88337c7021784b10b3a511128271ae7a/users/36badcddd9ce4fba9ca3a1ac237b572c/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:34.095755 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d156e-60f2-454a-b76b-f09d44c9499c admin admin] RBAC: Authorizing `identity:create_grant(project_id=88337c7021784b10b3a511128271ae7a, user_id=36badcddd9ce4fba9ca3a1ac237b572c, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:34.098586 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d156e-60f2-454a-b76b-f09d44c9499c admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:34.161020 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 812/1631] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:01:33 2022] PUT /identity/v3/projects/f188611031d5470c85cdb5476ecc1bfd/users/1f4af17f2abd499997b201d2f30bad48/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:34.162650 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5e364-f43d-413f-8f6b-95e5c047e6c5 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:34.192471 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 820/1632] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:01:34 2022] PUT /identity/v3/projects/88337c7021784b10b3a511128271ae7a/users/36badcddd9ce4fba9ca3a1ac237b572c/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:34.194704 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d156e-60f2-454a-b76b-f09d44c9499c admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:34.259541 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5e364-f43d-413f-8f6b-95e5c047e6c5 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:34.282065 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d156e-60f2-454a-b76b-f09d44c9499c admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:34.289094 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23882d06-b4b5-4bba-8a8d-fabc21f7493b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:34.293030 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23882d06-b4b5-4bba-8a8d-fabc21f7493b admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:34.293030 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23882d06-b4b5-4bba-8a8d-fabc21f7493b admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:34.293030 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23882d06-b4b5-4bba-8a8d-fabc21f7493b admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:34.293371 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23882d06-b4b5-4bba-8a8d-fabc21f7493b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:34.295144 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23882d06-b4b5-4bba-8a8d-fabc21f7493b admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:34.310605 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 821/1633] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:34.312387 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23882d06-b4b5-4bba-8a8d-fabc21f7493b admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:34.326079 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23882d06-b4b5-4bba-8a8d-fabc21f7493b admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:34.331649 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35695255-ad54-4fce-9dd5-dc366c0c29d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:34.332424 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35695255-ad54-4fce-9dd5-dc366c0c29d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:34.332908 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35695255-ad54-4fce-9dd5-dc366c0c29d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:34.333257 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35695255-ad54-4fce-9dd5-dc366c0c29d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:34.334270 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35695255-ad54-4fce-9dd5-dc366c0c29d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:34.336754 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35695255-ad54-4fce-9dd5-dc366c0c29d7 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:34.370500 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 822/1634] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:34.373278 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904f602-a463-4863-bf20-be9d5d059139 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:34.374296 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904f602-a463-4863-bf20-be9d5d059139 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:34.374580 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904f602-a463-4863-bf20-be9d5d059139 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:34.381039 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 823/1635] 10.222.0.24 () {54 vars in 912 bytes} [Tue Apr 12 00:01:34 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:01:34.382416 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904f602-a463-4863-bf20-be9d5d059139 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:34.412075 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904f602-a463-4863-bf20-be9d5d059139 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:34.417730 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bd7cd6-75f8-4284-81c3-f79d6e6fa3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:34.418756 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd7cd6-75f8-4284-81c3-f79d6e6fa3d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:34.419132 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd7cd6-75f8-4284-81c3-f79d6e6fa3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:34.419409 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bd7cd6-75f8-4284-81c3-f79d6e6fa3d8 admin admin] PATH_INFO: `/v3/projects/06eb286af028433da5c1a1a7f810c506/users/86971e10f5da4e9b8f6bfb91779a0ced/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:34.439040 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1ac2e-654c-4086-9ec3-92fc100faf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:34.440354 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1ac2e-654c-4086-9ec3-92fc100faf40 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:34.441458 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1ac2e-654c-4086-9ec3-92fc100faf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:34.441908 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f1ac2e-654c-4086-9ec3-92fc100faf40 admin admin] PATH_INFO: `/v3/projects/f188611031d5470c85cdb5476ecc1bfd/users/1f4af17f2abd499997b201d2f30bad48/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:34.447783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1ac2e-654c-4086-9ec3-92fc100faf40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f188611031d5470c85cdb5476ecc1bfd, user_id=1f4af17f2abd499997b201d2f30bad48, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:34.450760 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f1ac2e-654c-4086-9ec3-92fc100faf40 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:34.451789 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd7cd6-75f8-4284-81c3-f79d6e6fa3d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06eb286af028433da5c1a1a7f810c506, user_id=86971e10f5da4e9b8f6bfb91779a0ced, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:34.458076 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bd7cd6-75f8-4284-81c3-f79d6e6fa3d8 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:34.467136 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 824/1636] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:01:34 2022] PUT /identity/v3/projects/f188611031d5470c85cdb5476ecc1bfd/users/1f4af17f2abd499997b201d2f30bad48/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:34.468406 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1ac2e-654c-4086-9ec3-92fc100faf40 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:34.558143 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f1ac2e-654c-4086-9ec3-92fc100faf40 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:34.563667 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c291047-39a1-49b4-a6e6-f2215e2fc520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:34.564764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c291047-39a1-49b4-a6e6-f2215e2fc520 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:34.564962 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c291047-39a1-49b4-a6e6-f2215e2fc520 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:34.565129 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c291047-39a1-49b4-a6e6-f2215e2fc520 admin admin] PATH_INFO: `/v3/projects/88337c7021784b10b3a511128271ae7a/users/36badcddd9ce4fba9ca3a1ac237b572c/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:34.567887 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c291047-39a1-49b4-a6e6-f2215e2fc520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88337c7021784b10b3a511128271ae7a, user_id=36badcddd9ce4fba9ca3a1ac237b572c, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:34.571789 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c291047-39a1-49b4-a6e6-f2215e2fc520 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:34.582195 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 813/1637] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:01:34 2022] PUT /identity/v3/projects/06eb286af028433da5c1a1a7f810c506/users/86971e10f5da4e9b8f6bfb91779a0ced/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:34.582195 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4cbf8-4b1e-484e-a68b-6831009657ff None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:34.582195 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4cbf8-4b1e-484e-a68b-6831009657ff None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:34.582195 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d4cbf8-4b1e-484e-a68b-6831009657ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:34.599000 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 825/1638] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:01:34 2022] PUT /identity/v3/projects/88337c7021784b10b3a511128271ae7a/users/36badcddd9ce4fba9ca3a1ac237b572c/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:34.599000 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9802ca4-4796-4226-84f4-82616f5be2fd None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:34.599000 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9802ca4-4796-4226-84f4-82616f5be2fd None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:34.599000 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9802ca4-4796-4226-84f4-82616f5be2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:34.626618 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-b9802ca4-4796-4226-84f4-82616f5be2fd None None] MFA Rules not processed for user `1f4af17f2abd499997b201d2f30bad48`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:34.628058 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-64d4cbf8-4b1e-484e-a68b-6831009657ff None None] MFA Rules not processed for user `a9519f49f897415a894c1121278dda9c`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:34.628349 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-b9802ca4-4796-4226-84f4-82616f5be2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:34.629397 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-64d4cbf8-4b1e-484e-a68b-6831009657ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:34.761814 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 826/1639] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:34 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:34.765259 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9802ca4-4796-4226-84f4-82616f5be2fd None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:34.789572 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 814/1640] 10.222.0.24 () {58 vars in 1009 bytes} [Tue Apr 12 00:01:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:34.792013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eff90-239f-41ef-97d3-1b66c8f6cc30 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:34.792530 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eff90-239f-41ef-97d3-1b66c8f6cc30 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:34.793452 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170eff90-239f-41ef-97d3-1b66c8f6cc30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:34.849692 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-170eff90-239f-41ef-97d3-1b66c8f6cc30 None None] MFA Rules not processed for user `36badcddd9ce4fba9ca3a1ac237b572c`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:34.851946 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-170eff90-239f-41ef-97d3-1b66c8f6cc30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:34.882666 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9802ca4-4796-4226-84f4-82616f5be2fd None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:34.891308 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b10ef-9fd3-49e4-8c1b-91859f81e402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:34.892446 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b10ef-9fd3-49e4-8c1b-91859f81e402 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:34.896011 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b10ef-9fd3-49e4-8c1b-91859f81e402 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:34.896644 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96b10ef-9fd3-49e4-8c1b-91859f81e402 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:34.897828 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b10ef-9fd3-49e4-8c1b-91859f81e402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:34.901011 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96b10ef-9fd3-49e4-8c1b-91859f81e402 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:34.920221 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 827/1641] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:34.924648 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b10ef-9fd3-49e4-8c1b-91859f81e402 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:34.980955 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 815/1642] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:34 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:34.986669 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170eff90-239f-41ef-97d3-1b66c8f6cc30 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:35.000211 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96b10ef-9fd3-49e4-8c1b-91859f81e402 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:35.005321 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e266cba-67dd-44d3-b3de-351ccc094158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:35.006216 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e266cba-67dd-44d3-b3de-351ccc094158 service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:35.006646 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e266cba-67dd-44d3-b3de-351ccc094158 service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:35.007114 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e266cba-67dd-44d3-b3de-351ccc094158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:35.021555 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e266cba-67dd-44d3-b3de-351ccc094158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:35.024458 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e266cba-67dd-44d3-b3de-351ccc094158 service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:35.055853 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 828/1643] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:34 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:01:35.056841 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e266cba-67dd-44d3-b3de-351ccc094158 service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:35.060941 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170eff90-239f-41ef-97d3-1b66c8f6cc30 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:35.065598 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db727b-ab0b-41fe-8457-3e2ad53900e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:35.066510 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db727b-ab0b-41fe-8457-3e2ad53900e5 service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:35.066923 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db727b-ab0b-41fe-8457-3e2ad53900e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:35.067433 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db727b-ab0b-41fe-8457-3e2ad53900e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:35.081923 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db727b-ab0b-41fe-8457-3e2ad53900e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:35.083546 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db727b-ab0b-41fe-8457-3e2ad53900e5 service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:35.085002 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e266cba-67dd-44d3-b3de-351ccc094158 service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:35.097727 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 816/1644] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:01:35.099482 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2c684-4b50-4ac5-9765-908942d9d7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:35.101043 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2c684-4b50-4ac5-9765-908942d9d7a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:35.105208 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2c684-4b50-4ac5-9765-908942d9d7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:35.105208 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be2c684-4b50-4ac5-9765-908942d9d7a6 admin admin] PATH_INFO: `/v3/projects/06eb286af028433da5c1a1a7f810c506/users/86971e10f5da4e9b8f6bfb91779a0ced/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:35.110436 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2c684-4b50-4ac5-9765-908942d9d7a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06eb286af028433da5c1a1a7f810c506, user_id=86971e10f5da4e9b8f6bfb91779a0ced, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:35.115054 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be2c684-4b50-4ac5-9765-908942d9d7a6 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:35.141173 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 829/1645] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:01:35 2022] PUT /identity/v3/projects/06eb286af028433da5c1a1a7f810c506/users/86971e10f5da4e9b8f6bfb91779a0ced/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:35.154245 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8a083-9fde-4ce6-93a3-71492663feff None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:35.154522 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8a083-9fde-4ce6-93a3-71492663feff None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:35.154788 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc8a083-9fde-4ce6-93a3-71492663feff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:35.183873 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-0dc8a083-9fde-4ce6-93a3-71492663feff None None] MFA Rules not processed for user `86971e10f5da4e9b8f6bfb91779a0ced`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:35.185460 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-0dc8a083-9fde-4ce6-93a3-71492663feff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:35.267819 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2c684-4b50-4ac5-9765-908942d9d7a6 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:35.289484 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 817/1646] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:35.379182 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be2c684-4b50-4ac5-9765-908942d9d7a6 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:35.379182 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a2112-3e98-4751-8933-1ea674884e47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:35.379182 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a2112-3e98-4751-8933-1ea674884e47 service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:35.379182 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a2112-3e98-4751-8933-1ea674884e47 service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:35.380249 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39a2112-3e98-4751-8933-1ea674884e47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:35.462183 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a2112-3e98-4751-8933-1ea674884e47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:35.463608 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39a2112-3e98-4751-8933-1ea674884e47 service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:35.474278 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 830/1647] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:35 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:01:35.532824 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35ebd9-ece6-49e2-870f-19137cf9323d None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:35.533751 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35ebd9-ece6-49e2-870f-19137cf9323d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:35.534266 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35ebd9-ece6-49e2-870f-19137cf9323d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:35.575273 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-ba35ebd9-ece6-49e2-870f-19137cf9323d None None] MFA Rules not processed for user `cc2c179ab0e24fb09d97385cf0894428`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:35.576718 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ba35ebd9-ece6-49e2-870f-19137cf9323d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:35.668234 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a2112-3e98-4751-8933-1ea674884e47 service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:35.682198 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39a2112-3e98-4751-8933-1ea674884e47 service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:35.696719 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb52ec5-a2e7-4ce1-9b90-47fc846a6927 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:35.697454 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb52ec5-a2e7-4ce1-9b90-47fc846a6927 service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:35.697779 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb52ec5-a2e7-4ce1-9b90-47fc846a6927 service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:35.700183 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb52ec5-a2e7-4ce1-9b90-47fc846a6927 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:35.708090 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 818/1648] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:35.720348 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb52ec5-a2e7-4ce1-9b90-47fc846a6927 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:35.720587 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af17d51-9f02-4009-b1f5-84fa81797e5d None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:35.720948 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af17d51-9f02-4009-b1f5-84fa81797e5d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:35.721328 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af17d51-9f02-4009-b1f5-84fa81797e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:35.722583 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb52ec5-a2e7-4ce1-9b90-47fc846a6927 service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:35.749732 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-1af17d51-9f02-4009-b1f5-84fa81797e5d None None] MFA Rules not processed for user `cc2c179ab0e24fb09d97385cf0894428`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:35.751058 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 831/1649] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:01:35.752011 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-1af17d51-9f02-4009-b1f5-84fa81797e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:35.766177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 819/1650] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:01:35.785294 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce97579-2650-46d9-bef7-66235df129bd None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:35.785582 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce97579-2650-46d9-bef7-66235df129bd None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:35.785852 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce97579-2650-46d9-bef7-66235df129bd None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:35.787941 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 832/1651] 10.222.0.24 () {54 vars in 959 bytes} [Tue Apr 12 00:01:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:01:35.794041 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a3faf-e263-4d4e-ab2e-6303be3ee079 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:35.796346 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a3faf-e263-4d4e-ab2e-6303be3ee079 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:35.796346 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a3faf-e263-4d4e-ab2e-6303be3ee079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:35.825870 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-072a3faf-e263-4d4e-ab2e-6303be3ee079 None None] MFA Rules not processed for user `a9519f49f897415a894c1121278dda9c`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:35.827979 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-072a3faf-e263-4d4e-ab2e-6303be3ee079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:35.951214 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 820/1652] 10.222.0.24 () {58 vars in 1056 bytes} [Tue Apr 12 00:01:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:01:35.959981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce97579-2650-46d9-bef7-66235df129bd None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:35.980336 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce97579-2650-46d9-bef7-66235df129bd None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:35.986514 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957108c9-e160-48c5-af3d-eef4b0ab5975 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:35.987161 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957108c9-e160-48c5-af3d-eef4b0ab5975 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:35.987516 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957108c9-e160-48c5-af3d-eef4b0ab5975 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:35.987791 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957108c9-e160-48c5-af3d-eef4b0ab5975 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:35.996993 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957108c9-e160-48c5-af3d-eef4b0ab5975 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:35.998764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957108c9-e160-48c5-af3d-eef4b0ab5975 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:36.026869 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 833/1653] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:01:36.186297 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a3faf-e263-4d4e-ab2e-6303be3ee079 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:36.200957 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a3faf-e263-4d4e-ab2e-6303be3ee079 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:36.209728 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f91da-ffe0-431f-ace6-254ff80ba4d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:36.216608 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f91da-ffe0-431f-ace6-254ff80ba4d2 service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:36.219253 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f91da-ffe0-431f-ace6-254ff80ba4d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:36.219788 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f91da-ffe0-431f-ace6-254ff80ba4d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:36.370723 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f91da-ffe0-431f-ace6-254ff80ba4d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:36.375368 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f91da-ffe0-431f-ace6-254ff80ba4d2 service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:36.388325 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 821/1654] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:01:36.460303 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957108c9-e160-48c5-af3d-eef4b0ab5975 service nova] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:36.470939 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957108c9-e160-48c5-af3d-eef4b0ab5975 service nova] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:36.490311 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac8db9-e857-40b0-bef2-ec174d159a5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:36.494510 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac8db9-e857-40b0-bef2-ec174d159a5e service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:36.495859 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac8db9-e857-40b0-bef2-ec174d159a5e service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:36.496142 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac8db9-e857-40b0-bef2-ec174d159a5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:36.643747 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac8db9-e857-40b0-bef2-ec174d159a5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:36.646311 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac8db9-e857-40b0-bef2-ec174d159a5e service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:36.647571 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16e43b-bd54-42a6-b2f8-ace209bf6e24 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:36.651106 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16e43b-bd54-42a6-b2f8-ace209bf6e24 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:36.651106 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d16e43b-bd54-42a6-b2f8-ace209bf6e24 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:36.651106 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 822/1655] 10.222.0.24 () {54 vars in 912 bytes} [Tue Apr 12 00:01:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:01:36.658586 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbb5e4-36c2-448f-a322-00cf63c1e78f None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:36.658913 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbb5e4-36c2-448f-a322-00cf63c1e78f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:36.659176 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdbb5e4-36c2-448f-a322-00cf63c1e78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:36.661455 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 834/1656] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:01:36.694392 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-1bdbb5e4-36c2-448f-a322-00cf63c1e78f None None] MFA Rules not processed for user `a9519f49f897415a894c1121278dda9c`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:36.695691 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-1bdbb5e4-36c2-448f-a322-00cf63c1e78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:36.722073 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 823/1657] 10.222.0.24 () {58 vars in 1009 bytes} [Tue Apr 12 00:01:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:01:36.742814 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac8db9-e857-40b0-bef2-ec174d159a5e service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:36.742814 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-c1ac8db9-e857-40b0-bef2-ec174d159a5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:36.833594 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac8db9-e857-40b0-bef2-ec174d159a5e service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:36.841097 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6896b0-fcdc-4a56-bafe-3aa7bd5c9099 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2ad9c7f930e426bb908237f72c04a2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:36.842130 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6896b0-fcdc-4a56-bafe-3aa7bd5c9099 service glance] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:36.842572 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6896b0-fcdc-4a56-bafe-3aa7bd5c9099 service glance] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:36.843240 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6896b0-fcdc-4a56-bafe-3aa7bd5c9099 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:36.859969 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6896b0-fcdc-4a56-bafe-3aa7bd5c9099 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:36.863129 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6896b0-fcdc-4a56-bafe-3aa7bd5c9099 service glance] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:36.896887 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 835/1658] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:01:37.497286 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e6c85-1371-4875-9c37-9318e05f35ea None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:37.497826 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e6c85-1371-4875-9c37-9318e05f35ea None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:37.497826 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e6c85-1371-4875-9c37-9318e05f35ea None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:37.499997 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 824/1659] 10.222.0.24 () {54 vars in 912 bytes} [Tue Apr 12 00:01:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:01:37.512965 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3909cb-8749-4e7a-b8f3-ef41488b84e1 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:37.514037 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3909cb-8749-4e7a-b8f3-ef41488b84e1 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:37.514488 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3909cb-8749-4e7a-b8f3-ef41488b84e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:37.611986 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-4c3909cb-8749-4e7a-b8f3-ef41488b84e1 None None] MFA Rules not processed for user `c6936272118b49a9baa19f3bd5066f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:37.613246 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-4c3909cb-8749-4e7a-b8f3-ef41488b84e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:37.729268 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 836/1660] 10.222.0.24 () {58 vars in 1009 bytes} [Tue Apr 12 00:01:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:37.747821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e6c85-1371-4875-9c37-9318e05f35ea None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:37.772058 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e6c85-1371-4875-9c37-9318e05f35ea None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:37.776858 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3922f-38a3-45df-9765-264c589f07d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:37.777513 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3922f-38a3-45df-9765-264c589f07d6 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:37.777793 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3922f-38a3-45df-9765-264c589f07d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:37.778064 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3922f-38a3-45df-9765-264c589f07d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:37.789649 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3922f-38a3-45df-9765-264c589f07d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:37.791025 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3922f-38a3-45df-9765-264c589f07d6 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:37.800017 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 825/1661] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:01:38.527327 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3909cb-8749-4e7a-b8f3-ef41488b84e1 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:38.682587 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3909cb-8749-4e7a-b8f3-ef41488b84e1 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:38.699475 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd0cb3-0227-4c30-9fe3-1d66cc7f98b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:38.701813 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd0cb3-0227-4c30-9fe3-1d66cc7f98b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:38.702294 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd0cb3-0227-4c30-9fe3-1d66cc7f98b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:38.702785 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd0cb3-0227-4c30-9fe3-1d66cc7f98b0 admin admin] PATH_INFO: `/v3/users/8757ffd8c9ed4e5aa0eeb5f8d0a25666` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:38.705908 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd0cb3-0227-4c30-9fe3-1d66cc7f98b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8757ffd8c9ed4e5aa0eeb5f8d0a25666)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:38.716304 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd0cb3-0227-4c30-9fe3-1d66cc7f98b0 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:39.067448 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c2bd0cb3-0227-4c30-9fe3-1d66cc7f98b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8757ffd8c9ed4e5aa0eeb5f8d0a25666'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:39.132605 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b2773-f8d2-434c-8b9b-e77277b59e64 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:39.132605 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b2773-f8d2-434c-8b9b-e77277b59e64 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:39.132605 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b2773-f8d2-434c-8b9b-e77277b59e64 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:39.132605 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 826/1662] 10.222.0.24 () {54 vars in 960 bytes} [Tue Apr 12 00:01:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:01:39.132605 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c46e77-c41c-41db-b2a4-44acb6872bc1 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:39.132605 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c46e77-c41c-41db-b2a4-44acb6872bc1 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:39.134690 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c46e77-c41c-41db-b2a4-44acb6872bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:39.134785 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c2bd0cb3-0227-4c30-9fe3-1d66cc7f98b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8757ffd8c9ed4e5aa0eeb5f8d0a25666'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:39.193771 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-d4c46e77-c41c-41db-b2a4-44acb6872bc1 None None] MFA Rules not processed for user `47515442e0e84441bed4bfbb7a3b4ff9`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:39.201870 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d4c46e77-c41c-41db-b2a4-44acb6872bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:39.288012 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c2bd0cb3-0227-4c30-9fe3-1d66cc7f98b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8757ffd8c9ed4e5aa0eeb5f8d0a25666'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:39.289706 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c2bd0cb3-0227-4c30-9fe3-1d66cc7f98b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8757ffd8c9ed4e5aa0eeb5f8d0a25666'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:39.318634 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c2bd0cb3-0227-4c30-9fe3-1d66cc7f98b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8757ffd8c9ed4e5aa0eeb5f8d0a25666'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:39.341790 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 837/1663] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:01:38 2022] DELETE /identity/v3/users/8757ffd8c9ed4e5aa0eeb5f8d0a25666 => generated 0 bytes in 815 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:39.345185 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4ff02-560a-438e-b67a-9529f05c42fa None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:39.345484 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4ff02-560a-438e-b67a-9529f05c42fa None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:39.345745 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c4ff02-560a-438e-b67a-9529f05c42fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:39.386601 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-76c4ff02-560a-438e-b67a-9529f05c42fa None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:39.387879 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-76c4ff02-560a-438e-b67a-9529f05c42fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:39.406329 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 827/1664] 10.222.0.24 () {58 vars in 1057 bytes} [Tue Apr 12 00:01:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:39.426445 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c46e77-c41c-41db-b2a4-44acb6872bc1 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:39.455327 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c46e77-c41c-41db-b2a4-44acb6872bc1 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:39.506885 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 838/1665] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:39.517745 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4ff02-560a-438e-b67a-9529f05c42fa None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:39.521476 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-76c4ff02-560a-438e-b67a-9529f05c42fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:39.567546 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0cb7e-cc90-4009-8c77-f8f51404d6bd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47515442e0e84441bed4bfbb7a3b4ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:39.568703 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0cb7e-cc90-4009-8c77-f8f51404d6bd service placement] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:39.569152 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0cb7e-cc90-4009-8c77-f8f51404d6bd service placement] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:39.569589 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0cb7e-cc90-4009-8c77-f8f51404d6bd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:39.577377 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ead0cb7e-cc90-4009-8c77-f8f51404d6bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:39.597045 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0cb7e-cc90-4009-8c77-f8f51404d6bd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:39.600877 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0cb7e-cc90-4009-8c77-f8f51404d6bd service placement] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:39.626021 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 828/1666] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:01:39.660502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c4ff02-560a-438e-b67a-9529f05c42fa None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:39.669955 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8f328c-8739-4fc2-b6a8-eab3f1005a4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:39.670618 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f328c-8739-4fc2-b6a8-eab3f1005a4a service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:39.671134 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f328c-8739-4fc2-b6a8-eab3f1005a4a service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:39.671570 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8f328c-8739-4fc2-b6a8-eab3f1005a4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:39.689071 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f328c-8739-4fc2-b6a8-eab3f1005a4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:39.693279 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8f328c-8739-4fc2-b6a8-eab3f1005a4a service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:39.722701 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 839/1667] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:01:41.923821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0cb7e-cc90-4009-8c77-f8f51404d6bd service placement] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:41.925316 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ead0cb7e-cc90-4009-8c77-f8f51404d6bd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:41.954999 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0cb7e-cc90-4009-8c77-f8f51404d6bd service placement] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:41.977319 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270403d6-c852-448e-bc6a-d0168ec4471a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:41.981301 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270403d6-c852-448e-bc6a-d0168ec4471a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:41.981726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270403d6-c852-448e-bc6a-d0168ec4471a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:41.982026 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270403d6-c852-448e-bc6a-d0168ec4471a admin admin] PATH_INFO: `/v3/projects/05a65e651e1f43289e5a6f40a8cc2ab8` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:41.987744 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270403d6-c852-448e-bc6a-d0168ec4471a admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a65e651e1f43289e5a6f40a8cc2ab8)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:41.996489 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270403d6-c852-448e-bc6a-d0168ec4471a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:42.167215 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-270403d6-c852-448e-bc6a-d0168ec4471a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a65e651e1f43289e5a6f40a8cc2ab8', 'request_id': 'req-270403d6-c852-448e-bc6a-d0168ec4471a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:42.175173 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d2ba8-7cb0-4f8d-94c7-72396a43f919 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:42.176173 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d2ba8-7cb0-4f8d-94c7-72396a43f919 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:42.176741 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d2ba8-7cb0-4f8d-94c7-72396a43f919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:42.220291 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-359d2ba8-7cb0-4f8d-94c7-72396a43f919 None None] MFA Rules not processed for user `f03a84381dae444a907bf9624d2fefaa`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:42.221762 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-359d2ba8-7cb0-4f8d-94c7-72396a43f919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:42.314919 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 840/1668] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:42.326252 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d2ba8-7cb0-4f8d-94c7-72396a43f919 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:42.326374 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-270403d6-c852-448e-bc6a-d0168ec4471a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a65e651e1f43289e5a6f40a8cc2ab8', 'request_id': 'req-270403d6-c852-448e-bc6a-d0168ec4471a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:42.331971 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-359d2ba8-7cb0-4f8d-94c7-72396a43f919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:42.333432 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-270403d6-c852-448e-bc6a-d0168ec4471a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a65e651e1f43289e5a6f40a8cc2ab8', 'request_id': 'req-270403d6-c852-448e-bc6a-d0168ec4471a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:42.356073 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-270403d6-c852-448e-bc6a-d0168ec4471a admin admin] The token cache is being invalidate because project 05a65e651e1f43289e5a6f40a8cc2ab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:01:42.356441 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-270403d6-c852-448e-bc6a-d0168ec4471a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:42.358814 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-270403d6-c852-448e-bc6a-d0168ec4471a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:42.364863 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 829/1669] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:01:41 2022] DELETE /identity/v3/projects/05a65e651e1f43289e5a6f40a8cc2ab8 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:42.367238 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270403d6-c852-448e-bc6a-d0168ec4471a admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:42.371229 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-270403d6-c852-448e-bc6a-d0168ec4471a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:42.510435 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270403d6-c852-448e-bc6a-d0168ec4471a admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:42.517008 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496156df-0974-4915-a527-87443f3b0f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:42.518202 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496156df-0974-4915-a527-87443f3b0f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:42.518686 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496156df-0974-4915-a527-87443f3b0f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:42.519173 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496156df-0974-4915-a527-87443f3b0f3d admin admin] PATH_INFO: `/v3/users/759502bd797647459ba0f1b6860acc64` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:42.524780 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496156df-0974-4915-a527-87443f3b0f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=759502bd797647459ba0f1b6860acc64)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:42.526377 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: WARNING py.warnings [None req-496156df-0974-4915-a527-87443f3b0f3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:01:42.526377 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: warnings.warn(msg) Apr 12 00:01:42.526377 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: Apr 12 00:01:42.528026 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496156df-0974-4915-a527-87443f3b0f3d admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:42.591071 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d2ba8-7cb0-4f8d-94c7-72396a43f919 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:42.599447 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ad729-e10f-4cd6-a784-31f9e6d37f22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:42.600493 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ad729-e10f-4cd6-a784-31f9e6d37f22 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:42.600777 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ad729-e10f-4cd6-a784-31f9e6d37f22 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:42.601261 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ad729-e10f-4cd6-a784-31f9e6d37f22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:42.603349 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-307ad729-e10f-4cd6-a784-31f9e6d37f22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:42.633173 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ad729-e10f-4cd6-a784-31f9e6d37f22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:42.640575 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ad729-e10f-4cd6-a784-31f9e6d37f22 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:42.661554 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 841/1670] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:01:42.662499 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ad729-e10f-4cd6-a784-31f9e6d37f22 service nova] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:42.683655 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-307ad729-e10f-4cd6-a784-31f9e6d37f22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:42.717599 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ad729-e10f-4cd6-a784-31f9e6d37f22 service nova] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:42.729779 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717ab9f-c169-4a43-a731-c0b47bd45e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:42.735408 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717ab9f-c169-4a43-a731-c0b47bd45e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:42.737767 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717ab9f-c169-4a43-a731-c0b47bd45e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:42.737767 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717ab9f-c169-4a43-a731-c0b47bd45e94 admin admin] PATH_INFO: `/v3/users/1f4af17f2abd499997b201d2f30bad48` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:42.756814 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717ab9f-c169-4a43-a731-c0b47bd45e94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f4af17f2abd499997b201d2f30bad48)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:42.760376 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717ab9f-c169-4a43-a731-c0b47bd45e94 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:42.856010 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-496156df-0974-4915-a527-87443f3b0f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '759502bd797647459ba0f1b6860acc64'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:42.937939 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-496156df-0974-4915-a527-87443f3b0f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '759502bd797647459ba0f1b6860acc64'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:42.939359 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-496156df-0974-4915-a527-87443f3b0f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '759502bd797647459ba0f1b6860acc64'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:42.957517 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-496156df-0974-4915-a527-87443f3b0f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '759502bd797647459ba0f1b6860acc64'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:43.000122 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-496156df-0974-4915-a527-87443f3b0f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '759502bd797647459ba0f1b6860acc64'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:43.006142 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c717ab9f-c169-4a43-a731-c0b47bd45e94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f4af17f2abd499997b201d2f30bad48'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:43.020685 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 830/1671] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:01:42 2022] DELETE /identity/v3/users/759502bd797647459ba0f1b6860acc64 => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:43.022583 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac85a91-b1af-4725-b9df-1b484376064f None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:43.023154 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac85a91-b1af-4725-b9df-1b484376064f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:43.023606 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac85a91-b1af-4725-b9df-1b484376064f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:43.028857 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c717ab9f-c169-4a43-a731-c0b47bd45e94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f4af17f2abd499997b201d2f30bad48'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:43.065060 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-1ac85a91-b1af-4725-b9df-1b484376064f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:43.066535 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-1ac85a91-b1af-4725-b9df-1b484376064f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:43.114957 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c717ab9f-c169-4a43-a731-c0b47bd45e94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f4af17f2abd499997b201d2f30bad48'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:43.115661 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c717ab9f-c169-4a43-a731-c0b47bd45e94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f4af17f2abd499997b201d2f30bad48'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:43.156142 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c717ab9f-c169-4a43-a731-c0b47bd45e94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f4af17f2abd499997b201d2f30bad48'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:43.174781 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 842/1672] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:01:42 2022] DELETE /identity/v3/users/1f4af17f2abd499997b201d2f30bad48 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:43.192404 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 831/1673] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:43.310121 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717ab9f-c169-4a43-a731-c0b47bd45e94 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:43.312400 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-c717ab9f-c169-4a43-a731-c0b47bd45e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:43.430212 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717ab9f-c169-4a43-a731-c0b47bd45e94 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:43.436077 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3049010-f483-48d6-8cae-90483ea518e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:43.437383 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3049010-f483-48d6-8cae-90483ea518e9 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:43.437836 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3049010-f483-48d6-8cae-90483ea518e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:43.438295 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3049010-f483-48d6-8cae-90483ea518e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:43.519299 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3049010-f483-48d6-8cae-90483ea518e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:43.522789 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3049010-f483-48d6-8cae-90483ea518e9 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:43.535806 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 843/1674] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:01:44.453236 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac85a91-b1af-4725-b9df-1b484376064f None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:44.454721 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-1ac85a91-b1af-4725-b9df-1b484376064f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:44.470216 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac85a91-b1af-4725-b9df-1b484376064f None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:44.474910 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f327e-173c-435d-bc55-7b162c0b1d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:44.475949 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f327e-173c-435d-bc55-7b162c0b1d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:44.476394 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f327e-173c-435d-bc55-7b162c0b1d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:44.484352 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f327e-173c-435d-bc55-7b162c0b1d40 admin admin] PATH_INFO: `/v3/projects/1f6b404679504360b53cc5f6dd9fe18b` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:44.484352 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f327e-173c-435d-bc55-7b162c0b1d40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f6b404679504360b53cc5f6dd9fe18b)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:44.484352 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6f327e-173c-435d-bc55-7b162c0b1d40 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:44.660549 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ab6f327e-173c-435d-bc55-7b162c0b1d40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f6b404679504360b53cc5f6dd9fe18b', 'request_id': 'req-ab6f327e-173c-435d-bc55-7b162c0b1d40'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:44.720131 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3049010-f483-48d6-8cae-90483ea518e9 service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:44.721587 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-e3049010-f483-48d6-8cae-90483ea518e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:44.748353 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3049010-f483-48d6-8cae-90483ea518e9 service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:44.814395 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ab6f327e-173c-435d-bc55-7b162c0b1d40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f6b404679504360b53cc5f6dd9fe18b', 'request_id': 'req-ab6f327e-173c-435d-bc55-7b162c0b1d40'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:44.821855 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ab6f327e-173c-435d-bc55-7b162c0b1d40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f6b404679504360b53cc5f6dd9fe18b', 'request_id': 'req-ab6f327e-173c-435d-bc55-7b162c0b1d40'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:44.849783 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ab6f327e-173c-435d-bc55-7b162c0b1d40 admin admin] The token cache is being invalidate because project 1f6b404679504360b53cc5f6dd9fe18b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:01:44.850217 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ab6f327e-173c-435d-bc55-7b162c0b1d40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:44.859681 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ab6f327e-173c-435d-bc55-7b162c0b1d40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:44.865465 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 832/1675] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:01:44 2022] DELETE /identity/v3/projects/1f6b404679504360b53cc5f6dd9fe18b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:44.875111 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2807497-7030-48d0-9c73-17b16acc6c4e None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:44.875399 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2807497-7030-48d0-9c73-17b16acc6c4e None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:44.875678 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2807497-7030-48d0-9c73-17b16acc6c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:44.895621 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783f4b9-8687-4f8d-a189-d25ffdb20f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:44.896524 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783f4b9-8687-4f8d-a189-d25ffdb20f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:44.896808 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783f4b9-8687-4f8d-a189-d25ffdb20f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:44.897084 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783f4b9-8687-4f8d-a189-d25ffdb20f87 admin admin] PATH_INFO: `/v3/projects/f188611031d5470c85cdb5476ecc1bfd` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:44.899062 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783f4b9-8687-4f8d-a189-d25ffdb20f87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f188611031d5470c85cdb5476ecc1bfd)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:44.900088 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: WARNING py.warnings [None req-a783f4b9-8687-4f8d-a189-d25ffdb20f87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Apr 12 00:01:44.900088 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: warnings.warn(msg) Apr 12 00:01:44.900088 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: Apr 12 00:01:44.901569 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a783f4b9-8687-4f8d-a189-d25ffdb20f87 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:44.919360 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-b2807497-7030-48d0-9c73-17b16acc6c4e None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:44.933860 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-b2807497-7030-48d0-9c73-17b16acc6c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:44.964565 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 833/1676] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:01:44.973471 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d56df6-b735-40a8-9c6d-b1adf4fad7fd None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:44.973471 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d56df6-b735-40a8-9c6d-b1adf4fad7fd None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:44.973471 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d56df6-b735-40a8-9c6d-b1adf4fad7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:45.015228 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-a4d56df6-b735-40a8-9c6d-b1adf4fad7fd None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:45.016486 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-a4d56df6-b735-40a8-9c6d-b1adf4fad7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:45.038271 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 834/1677] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:45.042599 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d56df6-b735-40a8-9c6d-b1adf4fad7fd None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:45.061141 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d56df6-b735-40a8-9c6d-b1adf4fad7fd None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:45.078517 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a783f4b9-8687-4f8d-a189-d25ffdb20f87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f188611031d5470c85cdb5476ecc1bfd', 'request_id': 'req-a783f4b9-8687-4f8d-a189-d25ffdb20f87'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:45.095797 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a783f4b9-8687-4f8d-a189-d25ffdb20f87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f188611031d5470c85cdb5476ecc1bfd', 'request_id': 'req-a783f4b9-8687-4f8d-a189-d25ffdb20f87'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:45.167634 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de931cc9-8490-4634-86fb-47bdd8f3e9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:45.168422 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de931cc9-8490-4634-86fb-47bdd8f3e9fe admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:45.168842 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de931cc9-8490-4634-86fb-47bdd8f3e9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:45.169127 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de931cc9-8490-4634-86fb-47bdd8f3e9fe admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:45.170978 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de931cc9-8490-4634-86fb-47bdd8f3e9fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:01:45.173507 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de931cc9-8490-4634-86fb-47bdd8f3e9fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:45.175420 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de931cc9-8490-4634-86fb-47bdd8f3e9fe admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:45.183299 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a783f4b9-8687-4f8d-a189-d25ffdb20f87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f188611031d5470c85cdb5476ecc1bfd', 'request_id': 'req-a783f4b9-8687-4f8d-a189-d25ffdb20f87'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:45.213480 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 835/1678] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:01:45.214369 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a783f4b9-8687-4f8d-a189-d25ffdb20f87 admin admin] The token cache is being invalidate because project f188611031d5470c85cdb5476ecc1bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:01:45.214669 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a783f4b9-8687-4f8d-a189-d25ffdb20f87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:45.215395 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a783f4b9-8687-4f8d-a189-d25ffdb20f87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:45.221194 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 844/1679] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:01:44 2022] DELETE /identity/v3/projects/f188611031d5470c85cdb5476ecc1bfd => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:01:45.221194 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783f4b9-8687-4f8d-a189-d25ffdb20f87 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:45.221194 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a783f4b9-8687-4f8d-a189-d25ffdb20f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:45.222687 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43fe38-0f25-4a3a-b4d8-eeda1d8051c1 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:45.223583 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43fe38-0f25-4a3a-b4d8-eeda1d8051c1 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:45.224045 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43fe38-0f25-4a3a-b4d8-eeda1d8051c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:45.235906 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a783f4b9-8687-4f8d-a189-d25ffdb20f87 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:45.254692 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17624e20-e5ee-484d-ab69-9ad928a81dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:45.255898 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17624e20-e5ee-484d-ab69-9ad928a81dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:45.256481 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17624e20-e5ee-484d-ab69-9ad928a81dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:45.256898 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17624e20-e5ee-484d-ab69-9ad928a81dc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:45.258764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17624e20-e5ee-484d-ab69-9ad928a81dc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:45.263839 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17624e20-e5ee-484d-ab69-9ad928a81dc3 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:45.274189 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-de43fe38-0f25-4a3a-b4d8-eeda1d8051c1 None None] MFA Rules not processed for user `7b5417dc6db1461e94de39f4d2ca8f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:45.275442 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-de43fe38-0f25-4a3a-b4d8-eeda1d8051c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:45.402562 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 836/1680] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:45.403940 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dece85e-a034-4a37-8856-93fbd5b30176 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:45.404228 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dece85e-a034-4a37-8856-93fbd5b30176 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:45.404711 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dece85e-a034-4a37-8856-93fbd5b30176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:45.434640 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-8dece85e-a034-4a37-8856-93fbd5b30176 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:45.436041 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-8dece85e-a034-4a37-8856-93fbd5b30176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:45.448868 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 837/1681] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:45.450861 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003a004-cdda-4712-bf70-e386178bbfa9 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:45.451361 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003a004-cdda-4712-bf70-e386178bbfa9 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:45.451990 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003a004-cdda-4712-bf70-e386178bbfa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:45.465580 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 845/1682] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:01:45 2022] POST /identity/v3/projects => generated 365 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:45.467937 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45ead6-792d-4c62-91ed-f3f46f776a3a None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:45.467937 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45ead6-792d-4c62-91ed-f3f46f776a3a None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:45.467937 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45ead6-792d-4c62-91ed-f3f46f776a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:45.476270 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-a003a004-cdda-4712-bf70-e386178bbfa9 None None] MFA Rules not processed for user `7b5417dc6db1461e94de39f4d2ca8f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:45.477713 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-a003a004-cdda-4712-bf70-e386178bbfa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:45.496851 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-0b45ead6-792d-4c62-91ed-f3f46f776a3a None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:45.498142 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-0b45ead6-792d-4c62-91ed-f3f46f776a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:45.583367 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 838/1683] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:45.583367 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003a004-cdda-4712-bf70-e386178bbfa9 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:45.624650 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 846/1684] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:45.626022 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45ead6-792d-4c62-91ed-f3f46f776a3a None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:45.635769 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-0b45ead6-792d-4c62-91ed-f3f46f776a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:45.759837 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003a004-cdda-4712-bf70-e386178bbfa9 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:45.765792 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45ead6-792d-4c62-91ed-f3f46f776a3a None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:45.771236 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c63cfb-af34-4c34-a198-fb85ee751203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:45.777322 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c63cfb-af34-4c34-a198-fb85ee751203 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:45.777690 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c63cfb-af34-4c34-a198-fb85ee751203 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:45.777970 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c63cfb-af34-4c34-a198-fb85ee751203 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:45.778735 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c63cfb-af34-4c34-a198-fb85ee751203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:45.781291 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c63cfb-af34-4c34-a198-fb85ee751203 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:45.782050 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb5975-b5c9-497a-8427-a6a46108a713 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:45.782937 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb5975-b5c9-497a-8427-a6a46108a713 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:45.783962 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb5975-b5c9-497a-8427-a6a46108a713 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:45.784444 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb5975-b5c9-497a-8427-a6a46108a713 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:45.816992 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb5975-b5c9-497a-8427-a6a46108a713 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:45.818735 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb5975-b5c9-497a-8427-a6a46108a713 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:45.867554 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 847/1685] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:01:45.868733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb5975-b5c9-497a-8427-a6a46108a713 service nova] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:45.914384 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 839/1686] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:01:45 2022] POST /identity/v3/users => generated 283 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:45.914486 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb5975-b5c9-497a-8427-a6a46108a713 service nova] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:45.915508 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c63cfb-af34-4c34-a198-fb85ee751203 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:45.936062 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c19ab-fbd3-42fb-81f6-b1b9bda954c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:45.936945 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c19ab-fbd3-42fb-81f6-b1b9bda954c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:45.941118 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c19ab-fbd3-42fb-81f6-b1b9bda954c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:45.941574 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c19ab-fbd3-42fb-81f6-b1b9bda954c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:45.942517 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c19ab-fbd3-42fb-81f6-b1b9bda954c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:01:45.943028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c19ab-fbd3-42fb-81f6-b1b9bda954c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:45.944866 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c19ab-fbd3-42fb-81f6-b1b9bda954c8 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:45.956710 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c63cfb-af34-4c34-a198-fb85ee751203 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:45.995242 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 848/1687] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:01:45.996096 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb20ca-ec90-4336-90d2-ba85e04826e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:45.996252 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c19ab-fbd3-42fb-81f6-b1b9bda954c8 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:45.997067 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb20ca-ec90-4336-90d2-ba85e04826e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:45.997350 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb20ca-ec90-4336-90d2-ba85e04826e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:45.997619 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb20ca-ec90-4336-90d2-ba85e04826e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:45.998382 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb20ca-ec90-4336-90d2-ba85e04826e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:46.011708 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb20ca-ec90-4336-90d2-ba85e04826e5 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:46.034766 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c19ab-fbd3-42fb-81f6-b1b9bda954c8 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:46.041736 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 840/1688] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:46.043231 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb20ca-ec90-4336-90d2-ba85e04826e5 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:46.055322 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424d05f-e263-40ac-965e-43b0649c90e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:46.070287 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424d05f-e263-40ac-965e-43b0649c90e3 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:46.070287 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424d05f-e263-40ac-965e-43b0649c90e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:46.070287 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424d05f-e263-40ac-965e-43b0649c90e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:46.070287 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424d05f-e263-40ac-965e-43b0649c90e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:46.070287 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424d05f-e263-40ac-965e-43b0649c90e3 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:46.070676 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb20ca-ec90-4336-90d2-ba85e04826e5 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:46.071518 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205ac84-2a18-46fa-aaa0-684931d5ea47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:46.072464 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205ac84-2a18-46fa-aaa0-684931d5ea47 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:46.073376 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205ac84-2a18-46fa-aaa0-684931d5ea47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:46.073873 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205ac84-2a18-46fa-aaa0-684931d5ea47 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:46.075082 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205ac84-2a18-46fa-aaa0-684931d5ea47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:46.077487 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205ac84-2a18-46fa-aaa0-684931d5ea47 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:46.091042 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 841/1689] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:46.096682 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205ac84-2a18-46fa-aaa0-684931d5ea47 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:46.113465 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205ac84-2a18-46fa-aaa0-684931d5ea47 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:46.121892 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a64503-4c30-401f-8efb-307b48bd8250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:46.123475 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a64503-4c30-401f-8efb-307b48bd8250 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:46.124001 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a64503-4c30-401f-8efb-307b48bd8250 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:46.124365 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a64503-4c30-401f-8efb-307b48bd8250 admin admin] PATH_INFO: `/v3/projects/9e1b43d05d334b7d945e7e3f0e3f9336/users/1a707f6dd1aa4b0f9173bc4d673bbfb4/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:46.163205 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a64503-4c30-401f-8efb-307b48bd8250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e1b43d05d334b7d945e7e3f0e3f9336, user_id=1a707f6dd1aa4b0f9173bc4d673bbfb4, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:46.171543 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a64503-4c30-401f-8efb-307b48bd8250 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:46.284508 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 849/1690] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:01:45 2022] POST /identity/v3/projects => generated 355 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:46.290573 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424d05f-e263-40ac-965e-43b0649c90e3 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:46.315007 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 842/1691] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:01:46 2022] PUT /identity/v3/projects/9e1b43d05d334b7d945e7e3f0e3f9336/users/1a707f6dd1aa4b0f9173bc4d673bbfb4/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:46.326861 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2eef34-d2ff-40b8-9ce9-90b0fadd447f None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:46.327367 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2eef34-d2ff-40b8-9ce9-90b0fadd447f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:46.327796 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2eef34-d2ff-40b8-9ce9-90b0fadd447f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:46.386997 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-ff2eef34-d2ff-40b8-9ce9-90b0fadd447f None None] MFA Rules not processed for user `1a707f6dd1aa4b0f9173bc4d673bbfb4`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:46.388249 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ff2eef34-d2ff-40b8-9ce9-90b0fadd447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:46.426768 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424d05f-e263-40ac-965e-43b0649c90e3 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:46.527733 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 843/1692] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:01:46.539147 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2eef34-d2ff-40b8-9ce9-90b0fadd447f None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:46.540713 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ff2eef34-d2ff-40b8-9ce9-90b0fadd447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:46.561087 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887c4c6-f61c-4e9c-b7f4-b9ee19be7aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:46.563278 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887c4c6-f61c-4e9c-b7f4-b9ee19be7aeb admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:46.563749 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887c4c6-f61c-4e9c-b7f4-b9ee19be7aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:46.565082 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887c4c6-f61c-4e9c-b7f4-b9ee19be7aeb admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:46.566006 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887c4c6-f61c-4e9c-b7f4-b9ee19be7aeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:46.571576 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887c4c6-f61c-4e9c-b7f4-b9ee19be7aeb admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:46.665955 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2eef34-d2ff-40b8-9ce9-90b0fadd447f None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:46.675984 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a0df3-7557-40e6-9cdf-4680526371cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:46.676653 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a0df3-7557-40e6-9cdf-4680526371cc service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:46.676936 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a0df3-7557-40e6-9cdf-4680526371cc service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:46.677208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a0df3-7557-40e6-9cdf-4680526371cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:46.696313 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a0df3-7557-40e6-9cdf-4680526371cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:46.697841 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a0df3-7557-40e6-9cdf-4680526371cc service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:46.705832 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 850/1693] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:01:46 2022] POST /identity/v3/users => generated 278 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:46.706951 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887c4c6-f61c-4e9c-b7f4-b9ee19be7aeb admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:46.720683 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 844/1694] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:46 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:01:46.740988 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887c4c6-f61c-4e9c-b7f4-b9ee19be7aeb admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:46.771840 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560405cd-3518-4f1a-8aa7-68460d99530b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:46.772546 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560405cd-3518-4f1a-8aa7-68460d99530b admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:46.772830 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560405cd-3518-4f1a-8aa7-68460d99530b admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:46.773662 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560405cd-3518-4f1a-8aa7-68460d99530b admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:46.774415 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560405cd-3518-4f1a-8aa7-68460d99530b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:46.776080 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560405cd-3518-4f1a-8aa7-68460d99530b admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:46.782584 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92faf6-64be-4345-9102-e21d70a710c8 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:46.782903 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92faf6-64be-4345-9102-e21d70a710c8 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:46.783201 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e92faf6-64be-4345-9102-e21d70a710c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:46.816383 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 851/1695] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:46.820961 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560405cd-3518-4f1a-8aa7-68460d99530b admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:46.830817 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-4e92faf6-64be-4345-9102-e21d70a710c8 None None] MFA Rules not processed for user `1da750621eb94e5db8e50dddb008602c`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:46.832108 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-4e92faf6-64be-4345-9102-e21d70a710c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:46.843815 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560405cd-3518-4f1a-8aa7-68460d99530b admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:46.859743 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc0bca-a2a4-41c2-8680-7ba0e8ddc9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:46.860566 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc0bca-a2a4-41c2-8680-7ba0e8ddc9dd admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:46.860976 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc0bca-a2a4-41c2-8680-7ba0e8ddc9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:46.861372 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc0bca-a2a4-41c2-8680-7ba0e8ddc9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:46.864007 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc0bca-a2a4-41c2-8680-7ba0e8ddc9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:46.865766 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc0bca-a2a4-41c2-8680-7ba0e8ddc9dd admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:46.902738 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 852/1696] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:46.903769 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc0bca-a2a4-41c2-8680-7ba0e8ddc9dd admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:46.927710 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc0bca-a2a4-41c2-8680-7ba0e8ddc9dd admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:46.941249 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3957f6-b4c5-47eb-a65d-771a2683fe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:46.942276 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3957f6-b4c5-47eb-a65d-771a2683fe63 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:46.944482 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3957f6-b4c5-47eb-a65d-771a2683fe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:46.946222 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3957f6-b4c5-47eb-a65d-771a2683fe63 admin admin] PATH_INFO: `/v3/projects/0900961e14a34e289ccb17b6d11da861/users/b1afef762d434728ba6879fc6d49fe2c/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:47.000298 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3957f6-b4c5-47eb-a65d-771a2683fe63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0900961e14a34e289ccb17b6d11da861, user_id=b1afef762d434728ba6879fc6d49fe2c, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:47.010814 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3957f6-b4c5-47eb-a65d-771a2683fe63 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:47.106042 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 853/1697] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:01:46 2022] PUT /identity/v3/projects/0900961e14a34e289ccb17b6d11da861/users/b1afef762d434728ba6879fc6d49fe2c/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:47.116586 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44438508-37be-4968-b801-dcb949a77cbe None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:47.116827 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44438508-37be-4968-b801-dcb949a77cbe None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:47.117196 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44438508-37be-4968-b801-dcb949a77cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:47.158654 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 845/1698] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:47.173036 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92faf6-64be-4345-9102-e21d70a710c8 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:47.174672 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-4e92faf6-64be-4345-9102-e21d70a710c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:47.193299 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-44438508-37be-4968-b801-dcb949a77cbe None None] MFA Rules not processed for user `b1afef762d434728ba6879fc6d49fe2c`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:47.197962 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-44438508-37be-4968-b801-dcb949a77cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:47.401438 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 854/1699] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:47 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:47.402361 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44438508-37be-4968-b801-dcb949a77cbe None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:47.445899 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e92faf6-64be-4345-9102-e21d70a710c8 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:47.564253 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44438508-37be-4968-b801-dcb949a77cbe None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:47.583433 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74d927-ed6d-4ab3-a6ba-0f215caad9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:47.584113 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74d927-ed6d-4ab3-a6ba-0f215caad9f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:47.584388 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74d927-ed6d-4ab3-a6ba-0f215caad9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:47.584977 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74d927-ed6d-4ab3-a6ba-0f215caad9f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:47.585389 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74d927-ed6d-4ab3-a6ba-0f215caad9f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:47.587351 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74d927-ed6d-4ab3-a6ba-0f215caad9f0 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:47.637237 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c42f9-8d17-487d-b40a-b415a8cf3aea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:47.637915 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c42f9-8d17-487d-b40a-b415a8cf3aea service nova] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:47.638360 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c42f9-8d17-487d-b40a-b415a8cf3aea service nova] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:47.638774 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c42f9-8d17-487d-b40a-b415a8cf3aea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:47.699705 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 855/1700] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:01:47 2022] POST /identity/v3/projects => generated 353 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:47.703660 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74d927-ed6d-4ab3-a6ba-0f215caad9f0 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:47.889535 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c42f9-8d17-487d-b40a-b415a8cf3aea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:47.891201 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c42f9-8d17-487d-b40a-b415a8cf3aea service nova] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:47.908112 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74d927-ed6d-4ab3-a6ba-0f215caad9f0 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:47.931739 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858223a3-183c-4a09-aaf7-a2727ad9f532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:47.931739 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858223a3-183c-4a09-aaf7-a2727ad9f532 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:47.931739 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858223a3-183c-4a09-aaf7-a2727ad9f532 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:47.932122 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 846/1701] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 758 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:01:47.932286 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858223a3-183c-4a09-aaf7-a2727ad9f532 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:47.932414 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858223a3-183c-4a09-aaf7-a2727ad9f532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:47.945955 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858223a3-183c-4a09-aaf7-a2727ad9f532 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:48.064285 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c42f9-8d17-487d-b40a-b415a8cf3aea service nova] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:48.077583 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 856/1702] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:01:47 2022] POST /identity/v3/users => generated 283 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:01:48.100200 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c42f9-8d17-487d-b40a-b415a8cf3aea service nova] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:48.119416 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e03db0-67f7-49fc-8285-7f4941c36d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:48.121821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e03db0-67f7-49fc-8285-7f4941c36d22 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:48.121821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e03db0-67f7-49fc-8285-7f4941c36d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:48.121821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e03db0-67f7-49fc-8285-7f4941c36d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:48.121821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e03db0-67f7-49fc-8285-7f4941c36d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:48.122992 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e03db0-67f7-49fc-8285-7f4941c36d22 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:48.163094 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 847/1703] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:48.176155 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858223a3-183c-4a09-aaf7-a2727ad9f532 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:48.177020 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6786e72-fe5e-422f-a41a-191688c88a68 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:48.177582 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6786e72-fe5e-422f-a41a-191688c88a68 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:48.178060 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6786e72-fe5e-422f-a41a-191688c88a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:48.186638 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858223a3-183c-4a09-aaf7-a2727ad9f532 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:48.201088 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07982894-313f-4f06-a62e-1f6b795c48d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:48.201986 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07982894-313f-4f06-a62e-1f6b795c48d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:48.202372 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07982894-313f-4f06-a62e-1f6b795c48d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:48.202531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07982894-313f-4f06-a62e-1f6b795c48d2 admin admin] PATH_INFO: `/v3/projects/15addcbecb294bc2b841fc31881f0047/users/51b159b9615c4145a9d052ca03141abb/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:48.204251 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-a6786e72-fe5e-422f-a41a-191688c88a68 None None] MFA Rules not processed for user `7b5417dc6db1461e94de39f4d2ca8f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:48.205948 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-a6786e72-fe5e-422f-a41a-191688c88a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:48.232989 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07982894-313f-4f06-a62e-1f6b795c48d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15addcbecb294bc2b841fc31881f0047, user_id=51b159b9615c4145a9d052ca03141abb, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:48.239200 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07982894-313f-4f06-a62e-1f6b795c48d2 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:48.343425 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 848/1704] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:01:48.426321 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 857/1705] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:01:48 2022] PUT /identity/v3/projects/15addcbecb294bc2b841fc31881f0047/users/51b159b9615c4145a9d052ca03141abb/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:48.431301 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6786e72-fe5e-422f-a41a-191688c88a68 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:48.457099 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6786e72-fe5e-422f-a41a-191688c88a68 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:48.532990 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6a990-f50a-4bd3-a481-33eae3229682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:48.533957 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6a990-f50a-4bd3-a481-33eae3229682 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:48.534437 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6a990-f50a-4bd3-a481-33eae3229682 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:48.534947 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6a990-f50a-4bd3-a481-33eae3229682 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:48.536078 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6a990-f50a-4bd3-a481-33eae3229682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:48.537946 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6a990-f50a-4bd3-a481-33eae3229682 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:48.554745 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 849/1706] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:01:48 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:01:48.555475 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07982894-313f-4f06-a62e-1f6b795c48d2 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:48.570670 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07982894-313f-4f06-a62e-1f6b795c48d2 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:48.614963 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75072f0-f160-4b05-ab33-837139d69bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:48.616852 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75072f0-f160-4b05-ab33-837139d69bf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:48.617141 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75072f0-f160-4b05-ab33-837139d69bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:48.618940 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75072f0-f160-4b05-ab33-837139d69bf6 admin admin] PATH_INFO: `/v3/projects/15addcbecb294bc2b841fc31881f0047/users/51b159b9615c4145a9d052ca03141abb/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:48.622366 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75072f0-f160-4b05-ab33-837139d69bf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15addcbecb294bc2b841fc31881f0047, user_id=51b159b9615c4145a9d052ca03141abb, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:48.626449 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75072f0-f160-4b05-ab33-837139d69bf6 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:48.660098 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5ae68-670c-4b5a-81c2-a93949318129 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:48.660647 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5ae68-670c-4b5a-81c2-a93949318129 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:48.660823 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5ae68-670c-4b5a-81c2-a93949318129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:48.687189 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 858/1707] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:01:48 2022] PUT /identity/v3/projects/15addcbecb294bc2b841fc31881f0047/users/51b159b9615c4145a9d052ca03141abb/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:01:48.693093 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205988f6-8315-474b-9479-8762febe6123 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:48.693374 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205988f6-8315-474b-9479-8762febe6123 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:48.693654 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205988f6-8315-474b-9479-8762febe6123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:48.727892 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-2ef5ae68-670c-4b5a-81c2-a93949318129 None None] MFA Rules not processed for user `51b159b9615c4145a9d052ca03141abb`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:48.729592 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-2ef5ae68-670c-4b5a-81c2-a93949318129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:48.740261 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-205988f6-8315-474b-9479-8762febe6123 None None] MFA Rules not processed for user `f03a84381dae444a907bf9624d2fefaa`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:48.747837 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-205988f6-8315-474b-9479-8762febe6123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:48.851154 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 850/1708] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:48 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:48.861586 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5ae68-670c-4b5a-81c2-a93949318129 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:48.863433 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-2ef5ae68-670c-4b5a-81c2-a93949318129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:48.978822 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 859/1709] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:49.067840 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5ae68-670c-4b5a-81c2-a93949318129 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:49.075632 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc329e47-d47b-4ffc-b248-70823138b2ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:49.076297 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc329e47-d47b-4ffc-b248-70823138b2ad service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:49.076593 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc329e47-d47b-4ffc-b248-70823138b2ad service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:49.076858 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc329e47-d47b-4ffc-b248-70823138b2ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:49.103799 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc329e47-d47b-4ffc-b248-70823138b2ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:49.105558 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc329e47-d47b-4ffc-b248-70823138b2ad service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:49.125536 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 851/1710] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:48 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:01:49.480258 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205988f6-8315-474b-9479-8762febe6123 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:49.495538 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205988f6-8315-474b-9479-8762febe6123 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:49.509816 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7b7215-538a-417b-841f-66712329d7a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:49.510881 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b7215-538a-417b-841f-66712329d7a3 service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:49.512656 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b7215-538a-417b-841f-66712329d7a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:49.513163 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7b7215-538a-417b-841f-66712329d7a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:49.728156 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b7215-538a-417b-841f-66712329d7a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:49.730630 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7b7215-538a-417b-841f-66712329d7a3 service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:49.780262 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 860/1711] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:49 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:01:50.009620 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f8f9e-b418-4b24-8155-777f399538e6 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:50.010488 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f8f9e-b418-4b24-8155-777f399538e6 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:50.011085 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f8f9e-b418-4b24-8155-777f399538e6 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:50.013745 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 852/1712] 10.222.0.24 () {54 vars in 912 bytes} [Tue Apr 12 00:01:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:01:50.019652 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605b828-7b23-4568-aad8-1be73000e4f5 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:50.020575 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605b828-7b23-4568-aad8-1be73000e4f5 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:50.021025 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605b828-7b23-4568-aad8-1be73000e4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:50.078752 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-4605b828-7b23-4568-aad8-1be73000e4f5 None None] MFA Rules not processed for user `c6936272118b49a9baa19f3bd5066f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:50.084178 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-4605b828-7b23-4568-aad8-1be73000e4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:50.265153 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f8f9e-b418-4b24-8155-777f399538e6 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:50.267569 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-dd2f8f9e-b418-4b24-8155-777f399538e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:50.275007 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 861/1713] 10.222.0.24 () {58 vars in 1009 bytes} [Tue Apr 12 00:01:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:50.279820 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3209b9-1e34-4de8-b281-edf02833ff19 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:50.282110 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3209b9-1e34-4de8-b281-edf02833ff19 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:50.282558 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3209b9-1e34-4de8-b281-edf02833ff19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:50.320293 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f8f9e-b418-4b24-8155-777f399538e6 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:50.330400 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844adf62-267e-4576-91e4-7d4a8641c9d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:50.331229 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844adf62-267e-4576-91e4-7d4a8641c9d0 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:50.332110 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844adf62-267e-4576-91e4-7d4a8641c9d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:50.340618 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844adf62-267e-4576-91e4-7d4a8641c9d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:50.365105 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844adf62-267e-4576-91e4-7d4a8641c9d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:50.367211 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844adf62-267e-4576-91e4-7d4a8641c9d0 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:50.404700 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 853/1714] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:01:50.424913 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-cb3209b9-1e34-4de8-b281-edf02833ff19 None None] MFA Rules not processed for user `5c7b25e0e29143d783553859a0583d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:50.432691 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-cb3209b9-1e34-4de8-b281-edf02833ff19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:50.621776 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 862/1715] 10.222.0.24 () {58 vars in 1009 bytes} [Tue Apr 12 00:01:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:51.228627 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844adf62-267e-4576-91e4-7d4a8641c9d0 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:51.230560 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-844adf62-267e-4576-91e4-7d4a8641c9d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:51.452183 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844adf62-267e-4576-91e4-7d4a8641c9d0 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:51.477912 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee6aae-28ea-4b12-9bd9-0ef478dbad63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d616b38304d91bf1c7aded81205e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:51.478604 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee6aae-28ea-4b12-9bd9-0ef478dbad63 service swift] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:51.478923 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee6aae-28ea-4b12-9bd9-0ef478dbad63 service swift] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:51.484780 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee6aae-28ea-4b12-9bd9-0ef478dbad63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:51.509423 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee6aae-28ea-4b12-9bd9-0ef478dbad63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:51.511286 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee6aae-28ea-4b12-9bd9-0ef478dbad63 service swift] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:51.547314 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 854/1716] 10.222.0.24 () {60 vars in 1384 bytes} [Tue Apr 12 00:01:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:01:54.194119 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06bb2c-981e-467d-a711-af00221f98b5 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:54.195644 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06bb2c-981e-467d-a711-af00221f98b5 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:54.199948 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06bb2c-981e-467d-a711-af00221f98b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:54.260954 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-aa06bb2c-981e-467d-a711-af00221f98b5 None None] MFA Rules not processed for user `c6936272118b49a9baa19f3bd5066f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:54.260954 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-aa06bb2c-981e-467d-a711-af00221f98b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:54.279938 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 863/1717] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Apr 12 00:01:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:54.328039 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee6aae-28ea-4b12-9bd9-0ef478dbad63 service swift] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:54.330961 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-43ee6aae-28ea-4b12-9bd9-0ef478dbad63 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:54.354672 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee6aae-28ea-4b12-9bd9-0ef478dbad63 service swift] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:54.363705 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73eec1-fbcb-4d0e-84e5-5d8bb37a8904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:54.366880 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73eec1-fbcb-4d0e-84e5-5d8bb37a8904 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:54.367427 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73eec1-fbcb-4d0e-84e5-5d8bb37a8904 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:54.368764 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73eec1-fbcb-4d0e-84e5-5d8bb37a8904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:54.389187 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73eec1-fbcb-4d0e-84e5-5d8bb37a8904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:54.399514 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73eec1-fbcb-4d0e-84e5-5d8bb37a8904 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:54.430080 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 855/1718] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:01:57.270544 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a766e9-739d-494c-9c1a-465c7b3dbe88 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:57.274500 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a766e9-739d-494c-9c1a-465c7b3dbe88 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:57.274500 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a766e9-739d-494c-9c1a-465c7b3dbe88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:57.368663 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-25a766e9-739d-494c-9c1a-465c7b3dbe88 None None] MFA Rules not processed for user `1da750621eb94e5db8e50dddb008602c`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:57.376598 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-25a766e9-739d-494c-9c1a-465c7b3dbe88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:57.550958 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 864/1719] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:58.115519 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73eec1-fbcb-4d0e-84e5-5d8bb37a8904 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:58.123878 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-bd73eec1-fbcb-4d0e-84e5-5d8bb37a8904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:58.381794 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73eec1-fbcb-4d0e-84e5-5d8bb37a8904 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:58.388777 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e44a1a-fddc-4c4f-87c8-4d6b61e3a0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:58.390145 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e44a1a-fddc-4c4f-87c8-4d6b61e3a0b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:58.390715 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e44a1a-fddc-4c4f-87c8-4d6b61e3a0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:58.391237 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e44a1a-fddc-4c4f-87c8-4d6b61e3a0b5 admin admin] PATH_INFO: `/v3/users/c2cb6daf2a694c64a0d2a39324d8672e` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:58.393675 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e44a1a-fddc-4c4f-87c8-4d6b61e3a0b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2cb6daf2a694c64a0d2a39324d8672e)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:58.427447 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e44a1a-fddc-4c4f-87c8-4d6b61e3a0b5 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:58.654810 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1f7c-17f7-45a2-aca5-7af9a3d23c44 None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:58.655775 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1f7c-17f7-45a2-aca5-7af9a3d23c44 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:58.656255 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad1f7c-17f7-45a2-aca5-7af9a3d23c44 None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:58.658241 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 865/1720] 10.222.0.24 () {54 vars in 921 bytes} [Tue Apr 12 00:01:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:01:58.718202 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-18e44a1a-fddc-4c4f-87c8-4d6b61e3a0b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2cb6daf2a694c64a0d2a39324d8672e'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:58.830196 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2807fb4-9970-4812-8bfc-ee252e41096b None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:58.830196 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2807fb4-9970-4812-8bfc-ee252e41096b None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:58.830196 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2807fb4-9970-4812-8bfc-ee252e41096b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:58.832895 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-c2807fb4-9970-4812-8bfc-ee252e41096b None None] MFA Rules not processed for user `a9519f49f897415a894c1121278dda9c`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:58.834275 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-c2807fb4-9970-4812-8bfc-ee252e41096b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:59.024769 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-18e44a1a-fddc-4c4f-87c8-4d6b61e3a0b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2cb6daf2a694c64a0d2a39324d8672e'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:59.026119 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-18e44a1a-fddc-4c4f-87c8-4d6b61e3a0b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2cb6daf2a694c64a0d2a39324d8672e'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:59.064493 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 866/1721] 10.222.0.24 () {58 vars in 1018 bytes} [Tue Apr 12 00:01:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:01:59.068461 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-18e44a1a-fddc-4c4f-87c8-4d6b61e3a0b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2cb6daf2a694c64a0d2a39324d8672e'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:59.134288 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-18e44a1a-fddc-4c4f-87c8-4d6b61e3a0b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2cb6daf2a694c64a0d2a39324d8672e'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:01:59.164825 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 856/1722] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:01:58 2022] DELETE /identity/v3/users/c2cb6daf2a694c64a0d2a39324d8672e => generated 0 bytes in 1050 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:01:59.170441 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b1c7b-662f-4aaf-98d0-3e37dd733a4d None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:59.171286 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b1c7b-662f-4aaf-98d0-3e37dd733a4d None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:59.171711 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b1c7b-662f-4aaf-98d0-3e37dd733a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:59.202285 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-564b1c7b-662f-4aaf-98d0-3e37dd733a4d None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:01:59.211403 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-564b1c7b-662f-4aaf-98d0-3e37dd733a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:59.404362 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 867/1723] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:01:59.504312 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e44a1a-fddc-4c4f-87c8-4d6b61e3a0b5 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:01:59.508438 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-18e44a1a-fddc-4c4f-87c8-4d6b61e3a0b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:01:59.678293 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e44a1a-fddc-4c4f-87c8-4d6b61e3a0b5 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:01:59.707657 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880625b-adad-419a-8af5-63e2c23e301f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:01:59.711309 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880625b-adad-419a-8af5-63e2c23e301f service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:01:59.711309 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880625b-adad-419a-8af5-63e2c23e301f service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:01:59.711309 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7880625b-adad-419a-8af5-63e2c23e301f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:01:59.719750 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880625b-adad-419a-8af5-63e2c23e301f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:01:59.721266 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7880625b-adad-419a-8af5-63e2c23e301f service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:01:59.741819 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 857/1724] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:01:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:02:00.573971 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b1c7b-662f-4aaf-98d0-3e37dd733a4d None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:00.576427 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-564b1c7b-662f-4aaf-98d0-3e37dd733a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:00.746678 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b1c7b-662f-4aaf-98d0-3e37dd733a4d None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:00.777615 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c09f0-a3bc-4613-9df1-8c70fb5bbb26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:00.781175 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c09f0-a3bc-4613-9df1-8c70fb5bbb26 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:00.781474 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c09f0-a3bc-4613-9df1-8c70fb5bbb26 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:00.781753 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c09f0-a3bc-4613-9df1-8c70fb5bbb26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:00.821857 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c09f0-a3bc-4613-9df1-8c70fb5bbb26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:00.824036 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c09f0-a3bc-4613-9df1-8c70fb5bbb26 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:00.838786 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 868/1725] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:02:02.022391 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880625b-adad-419a-8af5-63e2c23e301f service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:02.025205 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-7880625b-adad-419a-8af5-63e2c23e301f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:02.085158 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7880625b-adad-419a-8af5-63e2c23e301f service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:02.133138 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074e2818-f5dc-4009-9e24-3e56b34c4d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:02.139119 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e2818-f5dc-4009-9e24-3e56b34c4d9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:02.140034 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e2818-f5dc-4009-9e24-3e56b34c4d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:02.140614 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074e2818-f5dc-4009-9e24-3e56b34c4d9e admin admin] PATH_INFO: `/v3/projects/d0ec6f41f918426096d78a95fa0ad353` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:02.149703 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e2818-f5dc-4009-9e24-3e56b34c4d9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0ec6f41f918426096d78a95fa0ad353)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:02.152979 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074e2818-f5dc-4009-9e24-3e56b34c4d9e admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:02.667641 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-074e2818-f5dc-4009-9e24-3e56b34c4d9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0ec6f41f918426096d78a95fa0ad353', 'request_id': 'req-074e2818-f5dc-4009-9e24-3e56b34c4d9e'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:02.943720 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-074e2818-f5dc-4009-9e24-3e56b34c4d9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0ec6f41f918426096d78a95fa0ad353', 'request_id': 'req-074e2818-f5dc-4009-9e24-3e56b34c4d9e'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:02.962187 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-074e2818-f5dc-4009-9e24-3e56b34c4d9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0ec6f41f918426096d78a95fa0ad353', 'request_id': 'req-074e2818-f5dc-4009-9e24-3e56b34c4d9e'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:02.999659 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-074e2818-f5dc-4009-9e24-3e56b34c4d9e admin admin] The token cache is being invalidate because project d0ec6f41f918426096d78a95fa0ad353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:03.000742 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-074e2818-f5dc-4009-9e24-3e56b34c4d9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:03.002138 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-074e2818-f5dc-4009-9e24-3e56b34c4d9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:03.004726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 858/1726] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:02 2022] DELETE /identity/v3/projects/d0ec6f41f918426096d78a95fa0ad353 => generated 0 bytes in 984 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:03.009247 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c09f0-a3bc-4613-9df1-8c70fb5bbb26 service nova] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:03.039867 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c09f0-a3bc-4613-9df1-8c70fb5bbb26 service nova] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:03.188255 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe723a-2943-4923-b8d0-df70b63397e0 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:03.189256 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe723a-2943-4923-b8d0-df70b63397e0 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:03.189770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe723a-2943-4923-b8d0-df70b63397e0 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:03.192307 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 859/1727] 10.222.0.24 () {54 vars in 921 bytes} [Tue Apr 12 00:02:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:02:03.224179 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294d509-2c8b-4636-8781-af799cb97aa2 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:03.224352 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294d509-2c8b-4636-8781-af799cb97aa2 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:03.224784 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8294d509-2c8b-4636-8781-af799cb97aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:03.230604 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88170c-f817-4115-97cd-869ff9c7e229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:03.232382 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88170c-f817-4115-97cd-869ff9c7e229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:03.233110 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88170c-f817-4115-97cd-869ff9c7e229 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:03.233679 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da88170c-f817-4115-97cd-869ff9c7e229 admin admin] PATH_INFO: `/v3/users/86971e10f5da4e9b8f6bfb91779a0ced` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:03.247933 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88170c-f817-4115-97cd-869ff9c7e229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86971e10f5da4e9b8f6bfb91779a0ced)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:03.250505 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da88170c-f817-4115-97cd-869ff9c7e229 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:03.273495 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-8294d509-2c8b-4636-8781-af799cb97aa2 None None] MFA Rules not processed for user `a9519f49f897415a894c1121278dda9c`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:03.274247 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-8294d509-2c8b-4636-8781-af799cb97aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:03.536350 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-da88170c-f817-4115-97cd-869ff9c7e229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86971e10f5da4e9b8f6bfb91779a0ced'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:03.552942 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 860/1728] 10.222.0.24 () {58 vars in 1018 bytes} [Tue Apr 12 00:02:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:03.556763 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-da88170c-f817-4115-97cd-869ff9c7e229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86971e10f5da4e9b8f6bfb91779a0ced'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:03.628801 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-da88170c-f817-4115-97cd-869ff9c7e229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86971e10f5da4e9b8f6bfb91779a0ced'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:03.631164 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-da88170c-f817-4115-97cd-869ff9c7e229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86971e10f5da4e9b8f6bfb91779a0ced'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:03.648507 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-da88170c-f817-4115-97cd-869ff9c7e229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86971e10f5da4e9b8f6bfb91779a0ced'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:03.657018 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 869/1729] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:03 2022] DELETE /identity/v3/users/86971e10f5da4e9b8f6bfb91779a0ced => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:03.974707 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294d509-2c8b-4636-8781-af799cb97aa2 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:03.979339 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-8294d509-2c8b-4636-8781-af799cb97aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:04.002884 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8294d509-2c8b-4636-8781-af799cb97aa2 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:04.106577 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0e2f1-71d8-42c4-95a6-fe0cda162400 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:04.107510 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0e2f1-71d8-42c4-95a6-fe0cda162400 service nova] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:04.107889 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0e2f1-71d8-42c4-95a6-fe0cda162400 service nova] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:04.108182 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0e2f1-71d8-42c4-95a6-fe0cda162400 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:04.110812 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-38b0e2f1-71d8-42c4-95a6-fe0cda162400 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:04.127782 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0e2f1-71d8-42c4-95a6-fe0cda162400 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:04.131182 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0e2f1-71d8-42c4-95a6-fe0cda162400 service nova] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:04.151009 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 861/1730] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:02:04.854126 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88170c-f817-4115-97cd-869ff9c7e229 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:04.854126 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-da88170c-f817-4115-97cd-869ff9c7e229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:05.021481 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da88170c-f817-4115-97cd-869ff9c7e229 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:05.021481 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ac6034-cb98-4335-bb4d-8a97e6c101ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:05.021481 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac6034-cb98-4335-bb4d-8a97e6c101ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:05.021481 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac6034-cb98-4335-bb4d-8a97e6c101ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:05.022358 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ac6034-cb98-4335-bb4d-8a97e6c101ce admin admin] PATH_INFO: `/v3/projects/06eb286af028433da5c1a1a7f810c506` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:05.022358 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac6034-cb98-4335-bb4d-8a97e6c101ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=06eb286af028433da5c1a1a7f810c506)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:05.022358 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ac6034-cb98-4335-bb4d-8a97e6c101ce admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:05.207369 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-30ac6034-cb98-4335-bb4d-8a97e6c101ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06eb286af028433da5c1a1a7f810c506', 'request_id': 'req-30ac6034-cb98-4335-bb4d-8a97e6c101ce'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:05.223158 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-30ac6034-cb98-4335-bb4d-8a97e6c101ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06eb286af028433da5c1a1a7f810c506', 'request_id': 'req-30ac6034-cb98-4335-bb4d-8a97e6c101ce'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:05.344212 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-30ac6034-cb98-4335-bb4d-8a97e6c101ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06eb286af028433da5c1a1a7f810c506', 'request_id': 'req-30ac6034-cb98-4335-bb4d-8a97e6c101ce'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:05.361547 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-30ac6034-cb98-4335-bb4d-8a97e6c101ce admin admin] The token cache is being invalidate because project 06eb286af028433da5c1a1a7f810c506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:05.361705 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-30ac6034-cb98-4335-bb4d-8a97e6c101ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:05.362360 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-30ac6034-cb98-4335-bb4d-8a97e6c101ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:05.364589 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 870/1731] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:04 2022] DELETE /identity/v3/projects/06eb286af028433da5c1a1a7f810c506 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:05.369771 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb289bbd-98c5-4470-9359-8359d877d99f None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:05.371099 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb289bbd-98c5-4470-9359-8359d877d99f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:05.371099 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb289bbd-98c5-4470-9359-8359d877d99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:05.401118 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-fb289bbd-98c5-4470-9359-8359d877d99f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:05.403176 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-fb289bbd-98c5-4470-9359-8359d877d99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:05.537263 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 862/1732] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:05.547915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddb8cc-86f7-4be9-b87b-eda5bd323cd2 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:05.547915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddb8cc-86f7-4be9-b87b-eda5bd323cd2 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:05.547915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddb8cc-86f7-4be9-b87b-eda5bd323cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:05.578507 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-56ddb8cc-86f7-4be9-b87b-eda5bd323cd2 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:05.578507 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-56ddb8cc-86f7-4be9-b87b-eda5bd323cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:05.595017 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 871/1733] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:05.600194 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb289bbd-98c5-4470-9359-8359d877d99f None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:05.612138 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb289bbd-98c5-4470-9359-8359d877d99f None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:05.618602 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c848b7-d9ec-4c29-8bc3-67934fe7bc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:05.619637 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c848b7-d9ec-4c29-8bc3-67934fe7bc4b admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:05.620154 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c848b7-d9ec-4c29-8bc3-67934fe7bc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:05.628306 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c848b7-d9ec-4c29-8bc3-67934fe7bc4b admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:05.628306 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c848b7-d9ec-4c29-8bc3-67934fe7bc4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:02:05.628306 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c848b7-d9ec-4c29-8bc3-67934fe7bc4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:05.628591 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c848b7-d9ec-4c29-8bc3-67934fe7bc4b admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:05.654812 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 863/1734] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:02:05.656010 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddb8cc-86f7-4be9-b87b-eda5bd323cd2 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:05.677793 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddb8cc-86f7-4be9-b87b-eda5bd323cd2 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:05.683395 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a0a0a-7e21-4183-b3f1-10891447b2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:05.685099 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a0a0a-7e21-4183-b3f1-10891447b2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:05.685481 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a0a0a-7e21-4183-b3f1-10891447b2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:05.685826 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a0a0a-7e21-4183-b3f1-10891447b2a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:05.686920 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a0a0a-7e21-4183-b3f1-10891447b2a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:05.688936 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a0a0a-7e21-4183-b3f1-10891447b2a2 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:05.784753 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 872/1735] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:05 2022] POST /identity/v3/projects => generated 365 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:05.789013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c848b7-d9ec-4c29-8bc3-67934fe7bc4b admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:05.804296 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c848b7-d9ec-4c29-8bc3-67934fe7bc4b admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:05.917985 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd9100-031d-4429-aacc-dcab9fa94666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:05.918915 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd9100-031d-4429-aacc-dcab9fa94666 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:05.919366 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd9100-031d-4429-aacc-dcab9fa94666 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:05.920051 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd9100-031d-4429-aacc-dcab9fa94666 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:05.920823 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd9100-031d-4429-aacc-dcab9fa94666 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:05.922778 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dd9100-031d-4429-aacc-dcab9fa94666 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:06.029910 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 864/1736] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:05 2022] POST /identity/v3/users => generated 283 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:06.034272 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a0a0a-7e21-4183-b3f1-10891447b2a2 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:06.048057 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a0a0a-7e21-4183-b3f1-10891447b2a2 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:06.054468 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478a493-58e0-4fa1-b7fa-9b89b66d1c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:06.055170 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478a493-58e0-4fa1-b7fa-9b89b66d1c2d admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:06.055486 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478a493-58e0-4fa1-b7fa-9b89b66d1c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:06.055940 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478a493-58e0-4fa1-b7fa-9b89b66d1c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:06.056821 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478a493-58e0-4fa1-b7fa-9b89b66d1c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:06.058569 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478a493-58e0-4fa1-b7fa-9b89b66d1c2d admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:06.072996 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 873/1737] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:06.077471 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd9100-031d-4429-aacc-dcab9fa94666 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:06.087983 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd9100-031d-4429-aacc-dcab9fa94666 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:06.096781 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624852de-1a9d-469d-a8ef-e1d08db9f7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:06.096781 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624852de-1a9d-469d-a8ef-e1d08db9f7cd admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:06.096781 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624852de-1a9d-469d-a8ef-e1d08db9f7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:06.096781 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624852de-1a9d-469d-a8ef-e1d08db9f7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:06.097763 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624852de-1a9d-469d-a8ef-e1d08db9f7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:06.097763 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624852de-1a9d-469d-a8ef-e1d08db9f7cd admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:06.107952 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 865/1738] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:06.112108 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478a493-58e0-4fa1-b7fa-9b89b66d1c2d admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:06.123348 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478a493-58e0-4fa1-b7fa-9b89b66d1c2d admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:06.127993 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42c2f0-5897-4bc8-be70-90ee6e9eb876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:06.128866 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42c2f0-5897-4bc8-be70-90ee6e9eb876 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:06.129138 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42c2f0-5897-4bc8-be70-90ee6e9eb876 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:06.129402 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d42c2f0-5897-4bc8-be70-90ee6e9eb876 admin admin] PATH_INFO: `/v3/projects/bbadf5a274ba46d29602eaf09cfed496/users/5111366c14ef46e681c384c7467784ec/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:06.144248 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42c2f0-5897-4bc8-be70-90ee6e9eb876 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbadf5a274ba46d29602eaf09cfed496, user_id=5111366c14ef46e681c384c7467784ec, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:06.147005 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d42c2f0-5897-4bc8-be70-90ee6e9eb876 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:06.258071 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 874/1739] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:06 2022] PUT /identity/v3/projects/bbadf5a274ba46d29602eaf09cfed496/users/5111366c14ef46e681c384c7467784ec/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:06.269034 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fe73b-bf2c-4b0f-a49b-8641433d81c6 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:06.269325 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fe73b-bf2c-4b0f-a49b-8641433d81c6 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:06.269610 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fe73b-bf2c-4b0f-a49b-8641433d81c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:06.301071 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-c01fe73b-bf2c-4b0f-a49b-8641433d81c6 None None] MFA Rules not processed for user `5111366c14ef46e681c384c7467784ec`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:06.303026 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-c01fe73b-bf2c-4b0f-a49b-8641433d81c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:06.385801 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42c2f0-5897-4bc8-be70-90ee6e9eb876 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:06.389131 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 866/1740] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:06.484350 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d42c2f0-5897-4bc8-be70-90ee6e9eb876 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:06.490066 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b44e3-1ba8-4442-88d0-d5adae0745fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:06.491087 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b44e3-1ba8-4442-88d0-d5adae0745fb admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:06.491942 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b44e3-1ba8-4442-88d0-d5adae0745fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:06.492227 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b44e3-1ba8-4442-88d0-d5adae0745fb admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:06.493248 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b44e3-1ba8-4442-88d0-d5adae0745fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:06.495248 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b44e3-1ba8-4442-88d0-d5adae0745fb admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:06.560498 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fe73b-bf2c-4b0f-a49b-8641433d81c6 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:06.560498 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-c01fe73b-bf2c-4b0f-a49b-8641433d81c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:06.582365 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fe73b-bf2c-4b0f-a49b-8641433d81c6 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:06.595891 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad5fcce-3ea9-4fbf-9d8e-c7f423d04436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:06.597297 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5fcce-3ea9-4fbf-9d8e-c7f423d04436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:06.597749 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5fcce-3ea9-4fbf-9d8e-c7f423d04436 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:06.598250 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad5fcce-3ea9-4fbf-9d8e-c7f423d04436 admin admin] PATH_INFO: `/v3/users/1a707f6dd1aa4b0f9173bc4d673bbfb4` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:06.599930 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5fcce-3ea9-4fbf-9d8e-c7f423d04436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a707f6dd1aa4b0f9173bc4d673bbfb4)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:06.603830 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad5fcce-3ea9-4fbf-9d8e-c7f423d04436 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:06.649061 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 875/1741] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:06 2022] POST /identity/v3/projects => generated 363 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:06.650155 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b44e3-1ba8-4442-88d0-d5adae0745fb admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:06.723911 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b44e3-1ba8-4442-88d0-d5adae0745fb admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:06.729255 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b66190-3c44-4828-a428-5673d5490018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:06.730733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b66190-3c44-4828-a428-5673d5490018 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:06.730733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b66190-3c44-4828-a428-5673d5490018 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:06.735870 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b66190-3c44-4828-a428-5673d5490018 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:06.735870 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b66190-3c44-4828-a428-5673d5490018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:06.735870 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b66190-3c44-4828-a428-5673d5490018 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:06.862939 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 876/1742] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:06 2022] POST /identity/v3/users => generated 288 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:06.863584 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b66190-3c44-4828-a428-5673d5490018 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:06.873929 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b66190-3c44-4828-a428-5673d5490018 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:06.880122 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484c93b-953b-4c44-9e4b-2ba05aca77a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:06.881051 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484c93b-953b-4c44-9e4b-2ba05aca77a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:06.881191 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484c93b-953b-4c44-9e4b-2ba05aca77a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:06.881433 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1484c93b-953b-4c44-9e4b-2ba05aca77a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:06.884171 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484c93b-953b-4c44-9e4b-2ba05aca77a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:06.886532 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1484c93b-953b-4c44-9e4b-2ba05aca77a5 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:06.904568 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 877/1743] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:06.905526 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484c93b-953b-4c44-9e4b-2ba05aca77a5 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:06.906862 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3ad5fcce-3ea9-4fbf-9d8e-c7f423d04436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a707f6dd1aa4b0f9173bc4d673bbfb4'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:06.917010 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1484c93b-953b-4c44-9e4b-2ba05aca77a5 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:06.925770 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e19a7-99be-42ed-8e79-b801ffe08461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:06.926954 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e19a7-99be-42ed-8e79-b801ffe08461 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:06.927315 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e19a7-99be-42ed-8e79-b801ffe08461 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:06.928049 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e19a7-99be-42ed-8e79-b801ffe08461 admin admin] PATH_INFO: `/v3/projects/3151b1506fe242119eb822f9debaa62c/users/a3acab6cd7624070acb9ef7eb5b58ec0/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:06.946342 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e19a7-99be-42ed-8e79-b801ffe08461 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3151b1506fe242119eb822f9debaa62c, user_id=a3acab6cd7624070acb9ef7eb5b58ec0, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:06.949028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e19a7-99be-42ed-8e79-b801ffe08461 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:06.978025 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3ad5fcce-3ea9-4fbf-9d8e-c7f423d04436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a707f6dd1aa4b0f9173bc4d673bbfb4'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:06.978928 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3ad5fcce-3ea9-4fbf-9d8e-c7f423d04436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a707f6dd1aa4b0f9173bc4d673bbfb4'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:06.993153 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3ad5fcce-3ea9-4fbf-9d8e-c7f423d04436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a707f6dd1aa4b0f9173bc4d673bbfb4'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:07.027062 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3ad5fcce-3ea9-4fbf-9d8e-c7f423d04436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a707f6dd1aa4b0f9173bc4d673bbfb4'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:07.041978 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 867/1744] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:06 2022] DELETE /identity/v3/users/1a707f6dd1aa4b0f9173bc4d673bbfb4 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:07.044917 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a69be4-0fd6-4859-8c90-6c80e6f6d433 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:07.045291 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a69be4-0fd6-4859-8c90-6c80e6f6d433 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:07.045477 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a69be4-0fd6-4859-8c90-6c80e6f6d433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:07.070780 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 878/1745] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:06 2022] PUT /identity/v3/projects/3151b1506fe242119eb822f9debaa62c/users/a3acab6cd7624070acb9ef7eb5b58ec0/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:07.079089 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e19a7-99be-42ed-8e79-b801ffe08461 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:07.079089 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-848e19a7-99be-42ed-8e79-b801ffe08461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:07.079861 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-d2a69be4-0fd6-4859-8c90-6c80e6f6d433 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:07.081378 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d2a69be4-0fd6-4859-8c90-6c80e6f6d433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:07.152921 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e19a7-99be-42ed-8e79-b801ffe08461 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:07.164949 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fad856-874d-45b2-9c7c-314c15fde85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:07.168030 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fad856-874d-45b2-9c7c-314c15fde85a admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:07.168030 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fad856-874d-45b2-9c7c-314c15fde85a admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:07.168030 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fad856-874d-45b2-9c7c-314c15fde85a admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:07.168030 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fad856-874d-45b2-9c7c-314c15fde85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:07.176565 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fad856-874d-45b2-9c7c-314c15fde85a admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:07.188265 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 879/1746] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:02:07.195408 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fad856-874d-45b2-9c7c-314c15fde85a admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:07.203655 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 868/1747] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:07.213212 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fad856-874d-45b2-9c7c-314c15fde85a admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:07.214442 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a69be4-0fd6-4859-8c90-6c80e6f6d433 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:07.217761 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d2a69be4-0fd6-4859-8c90-6c80e6f6d433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:07.226313 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8ba28-9d09-4e64-86e4-1cc7dae842d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:07.232518 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8ba28-9d09-4e64-86e4-1cc7dae842d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:07.232518 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8ba28-9d09-4e64-86e4-1cc7dae842d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:07.232518 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8ba28-9d09-4e64-86e4-1cc7dae842d9 admin admin] PATH_INFO: `/v3/projects/3151b1506fe242119eb822f9debaa62c/users/a3acab6cd7624070acb9ef7eb5b58ec0/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:07.232518 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8ba28-9d09-4e64-86e4-1cc7dae842d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3151b1506fe242119eb822f9debaa62c, user_id=a3acab6cd7624070acb9ef7eb5b58ec0, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:07.237549 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8ba28-9d09-4e64-86e4-1cc7dae842d9 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:07.250635 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 880/1748] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:07 2022] PUT /identity/v3/projects/3151b1506fe242119eb822f9debaa62c/users/a3acab6cd7624070acb9ef7eb5b58ec0/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:07.270138 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48a6b3-15d2-495e-979f-e7c96a9f4bd9 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:07.270432 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48a6b3-15d2-495e-979f-e7c96a9f4bd9 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:07.270705 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48a6b3-15d2-495e-979f-e7c96a9f4bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:07.306000 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a69be4-0fd6-4859-8c90-6c80e6f6d433 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:07.309255 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-8f48a6b3-15d2-495e-979f-e7c96a9f4bd9 None None] MFA Rules not processed for user `a3acab6cd7624070acb9ef7eb5b58ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:07.312979 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-8f48a6b3-15d2-495e-979f-e7c96a9f4bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:07.389087 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fbd9d-88e7-41d8-b39d-c733bdbc7e07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:07.389759 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fbd9d-88e7-41d8-b39d-c733bdbc7e07 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:07.390305 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fbd9d-88e7-41d8-b39d-c733bdbc7e07 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:07.390305 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fbd9d-88e7-41d8-b39d-c733bdbc7e07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:07.426785 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 881/1749] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:07 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:07.439677 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48a6b3-15d2-495e-979f-e7c96a9f4bd9 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:07.449710 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-8f48a6b3-15d2-495e-979f-e7c96a9f4bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:07.498158 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fbd9d-88e7-41d8-b39d-c733bdbc7e07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:07.499642 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fbd9d-88e7-41d8-b39d-c733bdbc7e07 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:07.511465 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 869/1750] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:02:07.524660 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48a6b3-15d2-495e-979f-e7c96a9f4bd9 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:07.531397 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bb618-1d23-4b85-8f6e-2415e731bf22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:07.532406 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bb618-1d23-4b85-8f6e-2415e731bf22 service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:07.537005 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bb618-1d23-4b85-8f6e-2415e731bf22 service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:07.537005 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bb618-1d23-4b85-8f6e-2415e731bf22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:07.544060 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7bb618-1d23-4b85-8f6e-2415e731bf22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:07.545522 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7bb618-1d23-4b85-8f6e-2415e731bf22 service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:07.558610 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 882/1751] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:07 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:02:07.891421 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fbd9d-88e7-41d8-b39d-c733bdbc7e07 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:07.900502 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fbd9d-88e7-41d8-b39d-c733bdbc7e07 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:07.904445 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4d9847-dda9-4735-a626-b6eff7eef355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:07.908201 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d9847-dda9-4735-a626-b6eff7eef355 service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:07.908201 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d9847-dda9-4735-a626-b6eff7eef355 service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:07.908201 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d9847-dda9-4735-a626-b6eff7eef355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:07.908201 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-8a4d9847-dda9-4735-a626-b6eff7eef355 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:07.974208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d9847-dda9-4735-a626-b6eff7eef355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:07.976278 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4d9847-dda9-4735-a626-b6eff7eef355 service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:07.985983 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 870/1752] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:07 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:02:08.233870 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bb618-1d23-4b85-8f6e-2415e731bf22 service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:08.235731 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-2a7bb618-1d23-4b85-8f6e-2415e731bf22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:08.260761 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bb618-1d23-4b85-8f6e-2415e731bf22 service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:08.272170 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c384b876-edfc-4f72-9c09-5e682f3685ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:08.273878 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384b876-edfc-4f72-9c09-5e682f3685ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:08.274207 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384b876-edfc-4f72-9c09-5e682f3685ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:08.274484 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c384b876-edfc-4f72-9c09-5e682f3685ec admin admin] PATH_INFO: `/v3/projects/9e1b43d05d334b7d945e7e3f0e3f9336` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:08.287558 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384b876-edfc-4f72-9c09-5e682f3685ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e1b43d05d334b7d945e7e3f0e3f9336)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:08.292196 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c384b876-edfc-4f72-9c09-5e682f3685ec admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:08.419409 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c384b876-edfc-4f72-9c09-5e682f3685ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e1b43d05d334b7d945e7e3f0e3f9336', 'request_id': 'req-c384b876-edfc-4f72-9c09-5e682f3685ec'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:08.438644 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c384b876-edfc-4f72-9c09-5e682f3685ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e1b43d05d334b7d945e7e3f0e3f9336', 'request_id': 'req-c384b876-edfc-4f72-9c09-5e682f3685ec'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:08.514490 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c384b876-edfc-4f72-9c09-5e682f3685ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e1b43d05d334b7d945e7e3f0e3f9336', 'request_id': 'req-c384b876-edfc-4f72-9c09-5e682f3685ec'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:08.530870 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c384b876-edfc-4f72-9c09-5e682f3685ec admin admin] The token cache is being invalidate because project 9e1b43d05d334b7d945e7e3f0e3f9336 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:08.531418 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c384b876-edfc-4f72-9c09-5e682f3685ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:08.532251 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c384b876-edfc-4f72-9c09-5e682f3685ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:08.539356 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 883/1753] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:08 2022] DELETE /identity/v3/projects/9e1b43d05d334b7d945e7e3f0e3f9336 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:08.539867 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46536dc9-e71d-4ea0-85b2-bbe4b035d4ac None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:08.540300 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46536dc9-e71d-4ea0-85b2-bbe4b035d4ac None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:08.540592 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46536dc9-e71d-4ea0-85b2-bbe4b035d4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:08.568183 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-46536dc9-e71d-4ea0-85b2-bbe4b035d4ac None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:08.570236 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-46536dc9-e71d-4ea0-85b2-bbe4b035d4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:08.665203 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 871/1754] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:08.673372 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600b9c9-0aba-43c5-948d-f6a16e25ec1e None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:08.677563 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600b9c9-0aba-43c5-948d-f6a16e25ec1e None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:08.677563 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600b9c9-0aba-43c5-948d-f6a16e25ec1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:08.717452 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-6600b9c9-0aba-43c5-948d-f6a16e25ec1e None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:08.717452 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-6600b9c9-0aba-43c5-948d-f6a16e25ec1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:08.730024 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 884/1755] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:08.736274 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46536dc9-e71d-4ea0-85b2-bbe4b035d4ac None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:08.753176 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46536dc9-e71d-4ea0-85b2-bbe4b035d4ac None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:08.759948 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5801a41-42a8-4551-94f9-03436dfa13fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:08.760616 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5801a41-42a8-4551-94f9-03436dfa13fa admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:08.760896 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5801a41-42a8-4551-94f9-03436dfa13fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:08.761167 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5801a41-42a8-4551-94f9-03436dfa13fa admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:08.761927 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5801a41-42a8-4551-94f9-03436dfa13fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:02:08.762231 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5801a41-42a8-4551-94f9-03436dfa13fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:08.763866 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5801a41-42a8-4551-94f9-03436dfa13fa admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:08.777866 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 872/1756] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:02:08.782211 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600b9c9-0aba-43c5-948d-f6a16e25ec1e None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:08.792088 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600b9c9-0aba-43c5-948d-f6a16e25ec1e None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:08.796722 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d35071-1585-4f93-b13d-eb2c003ef239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:08.800566 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d35071-1585-4f93-b13d-eb2c003ef239 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:08.800566 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d35071-1585-4f93-b13d-eb2c003ef239 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:08.800566 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d35071-1585-4f93-b13d-eb2c003ef239 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:08.800566 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d35071-1585-4f93-b13d-eb2c003ef239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:08.800566 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d35071-1585-4f93-b13d-eb2c003ef239 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:08.878600 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 885/1757] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:08 2022] POST /identity/v3/projects => generated 375 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:08.879691 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5801a41-42a8-4551-94f9-03436dfa13fa admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:08.889703 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5801a41-42a8-4551-94f9-03436dfa13fa admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:08.945771 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60589155-d062-4e9a-a23e-7901940cc397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:08.946562 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60589155-d062-4e9a-a23e-7901940cc397 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:08.946696 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60589155-d062-4e9a-a23e-7901940cc397 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:08.946949 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60589155-d062-4e9a-a23e-7901940cc397 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:08.947713 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60589155-d062-4e9a-a23e-7901940cc397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:08.949695 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60589155-d062-4e9a-a23e-7901940cc397 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:09.041125 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 873/1758] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:08 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:09.045364 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d35071-1585-4f93-b13d-eb2c003ef239 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:09.055749 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d35071-1585-4f93-b13d-eb2c003ef239 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:09.060306 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481ab3f-816a-46c7-a4e9-93844e068c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:09.060952 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481ab3f-816a-46c7-a4e9-93844e068c25 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:09.064548 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481ab3f-816a-46c7-a4e9-93844e068c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:09.064548 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2481ab3f-816a-46c7-a4e9-93844e068c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:09.064548 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481ab3f-816a-46c7-a4e9-93844e068c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:09.064548 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2481ab3f-816a-46c7-a4e9-93844e068c25 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:09.073980 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 886/1759] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:09.077794 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60589155-d062-4e9a-a23e-7901940cc397 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:09.088220 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60589155-d062-4e9a-a23e-7901940cc397 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:09.092847 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb1355-3842-4fa8-a91c-fb8e47e3effa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:09.093504 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb1355-3842-4fa8-a91c-fb8e47e3effa admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:09.093790 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb1355-3842-4fa8-a91c-fb8e47e3effa admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:09.094067 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb1355-3842-4fa8-a91c-fb8e47e3effa admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:09.094802 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb1355-3842-4fa8-a91c-fb8e47e3effa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:09.096422 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb1355-3842-4fa8-a91c-fb8e47e3effa admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:09.107603 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 874/1760] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:09.111809 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481ab3f-816a-46c7-a4e9-93844e068c25 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:09.121579 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2481ab3f-816a-46c7-a4e9-93844e068c25 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:09.126435 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72def58-2b6d-475b-89f9-cf34e2b9f082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:09.127336 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72def58-2b6d-475b-89f9-cf34e2b9f082 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:09.127615 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72def58-2b6d-475b-89f9-cf34e2b9f082 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:09.127885 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72def58-2b6d-475b-89f9-cf34e2b9f082 admin admin] PATH_INFO: `/v3/projects/04771727dcc240e78d0426505fce033f/users/9c1cf55d72a54f8fb5662ae544b603b7/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:09.143859 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72def58-2b6d-475b-89f9-cf34e2b9f082 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04771727dcc240e78d0426505fce033f, user_id=9c1cf55d72a54f8fb5662ae544b603b7, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:09.146482 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72def58-2b6d-475b-89f9-cf34e2b9f082 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:09.205496 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 887/1761] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:09 2022] PUT /identity/v3/projects/04771727dcc240e78d0426505fce033f/users/9c1cf55d72a54f8fb5662ae544b603b7/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:09.222663 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060ac24-1517-44d5-a125-d69af5b3bb76 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:09.223021 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060ac24-1517-44d5-a125-d69af5b3bb76 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:09.223301 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060ac24-1517-44d5-a125-d69af5b3bb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:09.250125 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-3060ac24-1517-44d5-a125-d69af5b3bb76 None None] MFA Rules not processed for user `9c1cf55d72a54f8fb5662ae544b603b7`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:09.251383 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-3060ac24-1517-44d5-a125-d69af5b3bb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:09.317491 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 875/1762] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:09.516136 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72def58-2b6d-475b-89f9-cf34e2b9f082 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:09.516136 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d72def58-2b6d-475b-89f9-cf34e2b9f082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:09.606717 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72def58-2b6d-475b-89f9-cf34e2b9f082 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:09.608006 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bac209-0be3-47bb-84c0-aa1f7d215f50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:09.608823 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bac209-0be3-47bb-84c0-aa1f7d215f50 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:09.609169 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bac209-0be3-47bb-84c0-aa1f7d215f50 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:09.609513 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bac209-0be3-47bb-84c0-aa1f7d215f50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:09.625122 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bac209-0be3-47bb-84c0-aa1f7d215f50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:09.625122 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bac209-0be3-47bb-84c0-aa1f7d215f50 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:09.646010 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 888/1763] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:02:10.006930 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060ac24-1517-44d5-a125-d69af5b3bb76 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:10.069526 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060ac24-1517-44d5-a125-d69af5b3bb76 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:10.074327 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adffda-2816-4c29-8e8f-87763fa58043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:10.075223 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adffda-2816-4c29-8e8f-87763fa58043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:10.075496 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adffda-2816-4c29-8e8f-87763fa58043 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:10.075764 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adffda-2816-4c29-8e8f-87763fa58043 admin admin] PATH_INFO: `/v3/users/9c1cf55d72a54f8fb5662ae544b603b7` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:10.077027 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adffda-2816-4c29-8e8f-87763fa58043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1cf55d72a54f8fb5662ae544b603b7)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:10.078976 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adffda-2816-4c29-8e8f-87763fa58043 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:10.288924 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-76adffda-2816-4c29-8e8f-87763fa58043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1cf55d72a54f8fb5662ae544b603b7'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:10.382701 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-76adffda-2816-4c29-8e8f-87763fa58043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1cf55d72a54f8fb5662ae544b603b7'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:10.383450 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-76adffda-2816-4c29-8e8f-87763fa58043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1cf55d72a54f8fb5662ae544b603b7'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:10.390532 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-76adffda-2816-4c29-8e8f-87763fa58043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1cf55d72a54f8fb5662ae544b603b7'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:10.402338 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-76adffda-2816-4c29-8e8f-87763fa58043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1cf55d72a54f8fb5662ae544b603b7'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:10.408142 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 876/1764] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:10 2022] DELETE /identity/v3/users/9c1cf55d72a54f8fb5662ae544b603b7 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:10.412611 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aef7f7-ccce-4b98-b7d0-b7685f456375 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:10.412991 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aef7f7-ccce-4b98-b7d0-b7685f456375 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:10.413928 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aef7f7-ccce-4b98-b7d0-b7685f456375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:10.432933 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-12aef7f7-ccce-4b98-b7d0-b7685f456375 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:10.434224 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-12aef7f7-ccce-4b98-b7d0-b7685f456375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:10.496990 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 889/1765] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:10.509166 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adffda-2816-4c29-8e8f-87763fa58043 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:10.511176 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-76adffda-2816-4c29-8e8f-87763fa58043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:10.578758 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adffda-2816-4c29-8e8f-87763fa58043 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:10.586029 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4c014c-1de8-46ff-9c10-a79d45b6e236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:10.586957 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c014c-1de8-46ff-9c10-a79d45b6e236 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:10.591735 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c014c-1de8-46ff-9c10-a79d45b6e236 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:10.591735 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4c014c-1de8-46ff-9c10-a79d45b6e236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:10.601849 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c014c-1de8-46ff-9c10-a79d45b6e236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:10.603593 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4c014c-1de8-46ff-9c10-a79d45b6e236 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:10.630985 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 877/1766] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:02:11.249207 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aef7f7-ccce-4b98-b7d0-b7685f456375 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:11.250737 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-12aef7f7-ccce-4b98-b7d0-b7685f456375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:11.263909 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aef7f7-ccce-4b98-b7d0-b7685f456375 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:11.268839 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66f48e-7e4c-4a5b-b9e2-6db3d6dd66f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:11.269716 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66f48e-7e4c-4a5b-b9e2-6db3d6dd66f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:11.269997 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66f48e-7e4c-4a5b-b9e2-6db3d6dd66f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:11.271981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66f48e-7e4c-4a5b-b9e2-6db3d6dd66f2 admin admin] PATH_INFO: `/v3/projects/04771727dcc240e78d0426505fce033f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:11.271981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66f48e-7e4c-4a5b-b9e2-6db3d6dd66f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04771727dcc240e78d0426505fce033f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:11.273635 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66f48e-7e4c-4a5b-b9e2-6db3d6dd66f2 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:11.412402 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ec66f48e-7e4c-4a5b-b9e2-6db3d6dd66f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04771727dcc240e78d0426505fce033f', 'request_id': 'req-ec66f48e-7e4c-4a5b-b9e2-6db3d6dd66f2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:11.417773 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ec66f48e-7e4c-4a5b-b9e2-6db3d6dd66f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04771727dcc240e78d0426505fce033f', 'request_id': 'req-ec66f48e-7e4c-4a5b-b9e2-6db3d6dd66f2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:11.479974 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ec66f48e-7e4c-4a5b-b9e2-6db3d6dd66f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04771727dcc240e78d0426505fce033f', 'request_id': 'req-ec66f48e-7e4c-4a5b-b9e2-6db3d6dd66f2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:11.494296 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ec66f48e-7e4c-4a5b-b9e2-6db3d6dd66f2 admin admin] The token cache is being invalidate because project 04771727dcc240e78d0426505fce033f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:11.494812 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ec66f48e-7e4c-4a5b-b9e2-6db3d6dd66f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:11.495876 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ec66f48e-7e4c-4a5b-b9e2-6db3d6dd66f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:11.499623 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 890/1767] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:11 2022] DELETE /identity/v3/projects/04771727dcc240e78d0426505fce033f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:11.504996 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15fe97-9eea-4426-8247-7ce1716e099b None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:11.505460 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15fe97-9eea-4426-8247-7ce1716e099b None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:11.505585 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de15fe97-9eea-4426-8247-7ce1716e099b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:11.525904 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-de15fe97-9eea-4426-8247-7ce1716e099b None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:11.527159 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-de15fe97-9eea-4426-8247-7ce1716e099b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:11.595931 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 878/1768] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:11.604487 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8230d89-afa2-4329-bb53-a94da4c388fd None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:11.608626 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8230d89-afa2-4329-bb53-a94da4c388fd None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:11.608626 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8230d89-afa2-4329-bb53-a94da4c388fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:11.626729 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-d8230d89-afa2-4329-bb53-a94da4c388fd None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:11.631555 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d8230d89-afa2-4329-bb53-a94da4c388fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:11.637188 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 891/1769] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:11.641884 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15fe97-9eea-4426-8247-7ce1716e099b None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:11.652046 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de15fe97-9eea-4426-8247-7ce1716e099b None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:11.656750 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef3e70-b210-4a33-b2d4-a308bd6d9d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:11.660075 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef3e70-b210-4a33-b2d4-a308bd6d9d7d admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:11.660075 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef3e70-b210-4a33-b2d4-a308bd6d9d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:11.660075 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fef3e70-b210-4a33-b2d4-a308bd6d9d7d admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:11.660075 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef3e70-b210-4a33-b2d4-a308bd6d9d7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:02:11.660075 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef3e70-b210-4a33-b2d4-a308bd6d9d7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:11.660956 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fef3e70-b210-4a33-b2d4-a308bd6d9d7d admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:11.677714 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 879/1770] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:02:11.679578 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8230d89-afa2-4329-bb53-a94da4c388fd None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:11.689865 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8230d89-afa2-4329-bb53-a94da4c388fd None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:11.695017 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb4caf-bb4e-4e45-827c-acff0739b7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:11.696138 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb4caf-bb4e-4e45-827c-acff0739b7cf admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:11.696414 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb4caf-bb4e-4e45-827c-acff0739b7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:11.696691 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb4caf-bb4e-4e45-827c-acff0739b7cf admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:11.697414 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb4caf-bb4e-4e45-827c-acff0739b7cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:11.699340 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb4caf-bb4e-4e45-827c-acff0739b7cf admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:11.730006 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef3e70-b210-4a33-b2d4-a308bd6d9d7d admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:11.732065 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-2fef3e70-b210-4a33-b2d4-a308bd6d9d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:11.745784 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fef3e70-b210-4a33-b2d4-a308bd6d9d7d admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:11.751415 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f81566-b388-48d7-97d3-b16a39fd0e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:11.757583 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f81566-b388-48d7-97d3-b16a39fd0e80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:11.757949 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f81566-b388-48d7-97d3-b16a39fd0e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:11.758420 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f81566-b388-48d7-97d3-b16a39fd0e80 admin admin] PATH_INFO: `/v3/users/5111366c14ef46e681c384c7467784ec` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:11.760670 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f81566-b388-48d7-97d3-b16a39fd0e80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5111366c14ef46e681c384c7467784ec)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:11.763260 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f81566-b388-48d7-97d3-b16a39fd0e80 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:11.809314 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 892/1771] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:11 2022] POST /identity/v3/projects => generated 387 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:11.813227 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb4caf-bb4e-4e45-827c-acff0739b7cf admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:11.886447 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb4caf-bb4e-4e45-827c-acff0739b7cf admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:11.896186 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07888c4-d430-477f-8f73-25bde08aa37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:11.896917 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07888c4-d430-477f-8f73-25bde08aa37e admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:11.897328 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07888c4-d430-477f-8f73-25bde08aa37e admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:11.898241 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07888c4-d430-477f-8f73-25bde08aa37e admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:11.899131 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07888c4-d430-477f-8f73-25bde08aa37e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:11.901477 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07888c4-d430-477f-8f73-25bde08aa37e admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:12.005161 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-a5f81566-b388-48d7-97d3-b16a39fd0e80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5111366c14ef46e681c384c7467784ec'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:12.010202 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 893/1772] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:11 2022] POST /identity/v3/users => generated 294 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:12.014012 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07888c4-d430-477f-8f73-25bde08aa37e admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:12.026222 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07888c4-d430-477f-8f73-25bde08aa37e admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:12.032047 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e34490-2521-41bd-9c19-a7c25eca2ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:12.033255 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e34490-2521-41bd-9c19-a7c25eca2ccf admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:12.033255 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e34490-2521-41bd-9c19-a7c25eca2ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:12.033603 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e34490-2521-41bd-9c19-a7c25eca2ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:12.034446 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e34490-2521-41bd-9c19-a7c25eca2ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:12.036398 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e34490-2521-41bd-9c19-a7c25eca2ccf admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:12.048876 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 894/1773] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:12.052462 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e34490-2521-41bd-9c19-a7c25eca2ccf admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:12.064502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e34490-2521-41bd-9c19-a7c25eca2ccf admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:12.069572 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718b19c-13d4-4b45-8093-9abfd4eefafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:12.070305 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718b19c-13d4-4b45-8093-9abfd4eefafa admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:12.070713 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718b19c-13d4-4b45-8093-9abfd4eefafa admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:12.071066 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718b19c-13d4-4b45-8093-9abfd4eefafa admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:12.071870 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718b19c-13d4-4b45-8093-9abfd4eefafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:12.073524 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718b19c-13d4-4b45-8093-9abfd4eefafa admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:12.079908 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-a5f81566-b388-48d7-97d3-b16a39fd0e80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5111366c14ef46e681c384c7467784ec'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:12.080531 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-a5f81566-b388-48d7-97d3-b16a39fd0e80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5111366c14ef46e681c384c7467784ec'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:12.084581 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 895/1774] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:02:12.089046 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718b19c-13d4-4b45-8093-9abfd4eefafa admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:12.091586 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-0718b19c-13d4-4b45-8093-9abfd4eefafa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:12.092963 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-a5f81566-b388-48d7-97d3-b16a39fd0e80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5111366c14ef46e681c384c7467784ec'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:12.105765 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718b19c-13d4-4b45-8093-9abfd4eefafa admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:12.108416 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-a5f81566-b388-48d7-97d3-b16a39fd0e80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5111366c14ef46e681c384c7467784ec'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:12.110897 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93e9b17-e199-4b71-84e1-0a83c1411e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:12.112104 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e9b17-e199-4b71-84e1-0a83c1411e29 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:12.112264 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e9b17-e199-4b71-84e1-0a83c1411e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:12.112639 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93e9b17-e199-4b71-84e1-0a83c1411e29 admin admin] PATH_INFO: `/v3/projects/d8f5cefa2dee450f8ffbdbede785d1ab/users/a14e130d67bb40ecb0dff2049251d75f/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:12.118478 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 880/1775] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:11 2022] DELETE /identity/v3/users/5111366c14ef46e681c384c7467784ec => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:12.120052 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c6600-f047-4e71-be05-d8553bc2c692 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:12.120337 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c6600-f047-4e71-be05-d8553bc2c692 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:12.120611 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c6600-f047-4e71-be05-d8553bc2c692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:12.128823 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e9b17-e199-4b71-84e1-0a83c1411e29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8f5cefa2dee450f8ffbdbede785d1ab, user_id=a14e130d67bb40ecb0dff2049251d75f, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:12.132400 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93e9b17-e199-4b71-84e1-0a83c1411e29 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:12.141795 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-030c6600-f047-4e71-be05-d8553bc2c692 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:12.142993 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-030c6600-f047-4e71-be05-d8553bc2c692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:12.219622 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 896/1776] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:12 2022] PUT /identity/v3/projects/d8f5cefa2dee450f8ffbdbede785d1ab/users/a14e130d67bb40ecb0dff2049251d75f/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:12.231744 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81181b3-cc86-4a6a-ab0b-ff79d7f25255 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:12.232010 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81181b3-cc86-4a6a-ab0b-ff79d7f25255 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:12.232291 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81181b3-cc86-4a6a-ab0b-ff79d7f25255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:12.257919 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 881/1777] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:12.259788 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c6600-f047-4e71-be05-d8553bc2c692 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:12.261905 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-030c6600-f047-4e71-be05-d8553bc2c692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:12.285115 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-e81181b3-cc86-4a6a-ab0b-ff79d7f25255 None None] MFA Rules not processed for user `a14e130d67bb40ecb0dff2049251d75f`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:12.286364 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-e81181b3-cc86-4a6a-ab0b-ff79d7f25255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:12.368316 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c6600-f047-4e71-be05-d8553bc2c692 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:12.451476 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833db29-20b8-4f09-b94a-e7f1c52049fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:12.454435 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833db29-20b8-4f09-b94a-e7f1c52049fc service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:12.455021 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833db29-20b8-4f09-b94a-e7f1c52049fc service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:12.456051 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833db29-20b8-4f09-b94a-e7f1c52049fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:12.460023 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 897/1778] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:12.460023 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81181b3-cc86-4a6a-ab0b-ff79d7f25255 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:12.560295 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833db29-20b8-4f09-b94a-e7f1c52049fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:12.562293 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833db29-20b8-4f09-b94a-e7f1c52049fc service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:12.589933 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 882/1779] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:02:12.601755 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81181b3-cc86-4a6a-ab0b-ff79d7f25255 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:12.608267 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af24680-ab3f-486c-a484-23eeeda0a609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:12.618986 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af24680-ab3f-486c-a484-23eeeda0a609 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:12.619385 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af24680-ab3f-486c-a484-23eeeda0a609 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:12.619728 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af24680-ab3f-486c-a484-23eeeda0a609 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:12.625054 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af24680-ab3f-486c-a484-23eeeda0a609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:12.625054 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af24680-ab3f-486c-a484-23eeeda0a609 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:12.749604 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 898/1780] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:12 2022] POST /identity/v3/projects => generated 387 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:12.753979 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833db29-20b8-4f09-b94a-e7f1c52049fc service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:12.764383 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833db29-20b8-4f09-b94a-e7f1c52049fc service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:12.826668 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a748e-05da-4707-a2bb-48c9573eace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:12.827534 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a748e-05da-4707-a2bb-48c9573eace8 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:12.828037 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a748e-05da-4707-a2bb-48c9573eace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:12.828317 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03a748e-05da-4707-a2bb-48c9573eace8 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:12.829614 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a748e-05da-4707-a2bb-48c9573eace8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:12.831775 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03a748e-05da-4707-a2bb-48c9573eace8 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:12.924152 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 883/1781] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:12 2022] POST /identity/v3/users => generated 294 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:12.925389 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af24680-ab3f-486c-a484-23eeeda0a609 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:12.936592 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af24680-ab3f-486c-a484-23eeeda0a609 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:12.941401 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f382e7d-e8cf-4831-a785-13684f7304a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:12.942114 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f382e7d-e8cf-4831-a785-13684f7304a0 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:12.942395 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f382e7d-e8cf-4831-a785-13684f7304a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:12.942666 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f382e7d-e8cf-4831-a785-13684f7304a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:12.943452 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f382e7d-e8cf-4831-a785-13684f7304a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:12.945701 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f382e7d-e8cf-4831-a785-13684f7304a0 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:12.956084 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 899/1782] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:12.960119 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a748e-05da-4707-a2bb-48c9573eace8 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:12.971367 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03a748e-05da-4707-a2bb-48c9573eace8 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:12.976818 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbe673-dbf6-42b1-b53d-23b6e6812b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:12.977490 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbe673-dbf6-42b1-b53d-23b6e6812b98 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:12.977769 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbe673-dbf6-42b1-b53d-23b6e6812b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:12.978037 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbe673-dbf6-42b1-b53d-23b6e6812b98 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:12.978771 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbe673-dbf6-42b1-b53d-23b6e6812b98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:12.980661 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbe673-dbf6-42b1-b53d-23b6e6812b98 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:12.990572 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f382e7d-e8cf-4831-a785-13684f7304a0 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:12.993642 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-9f382e7d-e8cf-4831-a785-13684f7304a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:13.002031 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 884/1783] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:13.010407 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbe673-dbf6-42b1-b53d-23b6e6812b98 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:13.014041 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f382e7d-e8cf-4831-a785-13684f7304a0 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:13.020217 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef1b69-2dbb-477f-b015-a0caca53ddb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:13.021225 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef1b69-2dbb-477f-b015-a0caca53ddb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:13.021497 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef1b69-2dbb-477f-b015-a0caca53ddb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:13.021901 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef1b69-2dbb-477f-b015-a0caca53ddb1 admin admin] PATH_INFO: `/v3/projects/bbadf5a274ba46d29602eaf09cfed496` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:13.022063 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbe673-dbf6-42b1-b53d-23b6e6812b98 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:13.023533 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef1b69-2dbb-477f-b015-a0caca53ddb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbadf5a274ba46d29602eaf09cfed496)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:13.025629 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef1b69-2dbb-477f-b015-a0caca53ddb1 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:13.028679 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2822c3-a609-498f-ae1a-14110491a736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:13.029710 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2822c3-a609-498f-ae1a-14110491a736 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:13.030269 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2822c3-a609-498f-ae1a-14110491a736 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:13.030609 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2822c3-a609-498f-ae1a-14110491a736 admin admin] PATH_INFO: `/v3/projects/21fa57c9746144cebd3f68a17e217da6/users/3b61b58a42dc4906a807dea488ed52ad/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:13.048500 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2822c3-a609-498f-ae1a-14110491a736 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21fa57c9746144cebd3f68a17e217da6, user_id=3b61b58a42dc4906a807dea488ed52ad, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:13.051179 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2822c3-a609-498f-ae1a-14110491a736 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:13.164762 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 885/1784] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:13 2022] PUT /identity/v3/projects/21fa57c9746144cebd3f68a17e217da6/users/3b61b58a42dc4906a807dea488ed52ad/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:13.167128 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08c390-8287-4621-8b41-fe40875ac317 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:13.167128 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08c390-8287-4621-8b41-fe40875ac317 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:13.167366 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08c390-8287-4621-8b41-fe40875ac317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:13.178398 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-06ef1b69-2dbb-477f-b015-a0caca53ddb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbadf5a274ba46d29602eaf09cfed496', 'request_id': 'req-06ef1b69-2dbb-477f-b015-a0caca53ddb1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:13.185276 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-06ef1b69-2dbb-477f-b015-a0caca53ddb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbadf5a274ba46d29602eaf09cfed496', 'request_id': 'req-06ef1b69-2dbb-477f-b015-a0caca53ddb1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:13.202737 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-1c08c390-8287-4621-8b41-fe40875ac317 None None] MFA Rules not processed for user `3b61b58a42dc4906a807dea488ed52ad`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:13.204073 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-1c08c390-8287-4621-8b41-fe40875ac317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:13.259443 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-06ef1b69-2dbb-477f-b015-a0caca53ddb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbadf5a274ba46d29602eaf09cfed496', 'request_id': 'req-06ef1b69-2dbb-477f-b015-a0caca53ddb1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:13.276486 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-06ef1b69-2dbb-477f-b015-a0caca53ddb1 admin admin] The token cache is being invalidate because project bbadf5a274ba46d29602eaf09cfed496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:13.276917 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-06ef1b69-2dbb-477f-b015-a0caca53ddb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:13.277818 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-06ef1b69-2dbb-477f-b015-a0caca53ddb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:13.283498 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 900/1785] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:12 2022] DELETE /identity/v3/projects/bbadf5a274ba46d29602eaf09cfed496 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:13.284628 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef1b69-2dbb-477f-b015-a0caca53ddb1 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:13.286088 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-06ef1b69-2dbb-477f-b015-a0caca53ddb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:13.303092 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 886/1786] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:13.307308 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08c390-8287-4621-8b41-fe40875ac317 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:13.314518 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-1c08c390-8287-4621-8b41-fe40875ac317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:13.356210 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef1b69-2dbb-477f-b015-a0caca53ddb1 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:13.361208 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc5f0c-7f05-4b4c-b93b-1c8235ef11c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:13.362150 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc5f0c-7f05-4b4c-b93b-1c8235ef11c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:13.362427 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc5f0c-7f05-4b4c-b93b-1c8235ef11c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:13.362690 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc5f0c-7f05-4b4c-b93b-1c8235ef11c9 admin admin] PATH_INFO: `/v3/users/a3acab6cd7624070acb9ef7eb5b58ec0` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:13.364296 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc5f0c-7f05-4b4c-b93b-1c8235ef11c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3acab6cd7624070acb9ef7eb5b58ec0)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:13.366237 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc5f0c-7f05-4b4c-b93b-1c8235ef11c9 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:13.374727 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08c390-8287-4621-8b41-fe40875ac317 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:13.379308 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd758d-cb51-45b3-9923-8c67943c3f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:13.379962 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd758d-cb51-45b3-9923-8c67943c3f0e admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:13.380238 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd758d-cb51-45b3-9923-8c67943c3f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:13.380513 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd758d-cb51-45b3-9923-8c67943c3f0e admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:13.381273 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd758d-cb51-45b3-9923-8c67943c3f0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:13.383697 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd758d-cb51-45b3-9923-8c67943c3f0e admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:13.526781 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 887/1787] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:13 2022] POST /identity/v3/projects => generated 383 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:13.532345 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd758d-cb51-45b3-9923-8c67943c3f0e admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:13.568357 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-f2cc5f0c-7f05-4b4c-b93b-1c8235ef11c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3acab6cd7624070acb9ef7eb5b58ec0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:13.575971 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-f2cc5f0c-7f05-4b4c-b93b-1c8235ef11c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3acab6cd7624070acb9ef7eb5b58ec0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:13.595354 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd758d-cb51-45b3-9923-8c67943c3f0e admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:13.600161 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7512a-4b8e-4b17-8a5d-5e3b117a1239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:13.600868 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7512a-4b8e-4b17-8a5d-5e3b117a1239 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:13.601148 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7512a-4b8e-4b17-8a5d-5e3b117a1239 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:13.601426 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7512a-4b8e-4b17-8a5d-5e3b117a1239 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:13.602121 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7512a-4b8e-4b17-8a5d-5e3b117a1239 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:13.604541 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7512a-4b8e-4b17-8a5d-5e3b117a1239 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:13.645983 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-f2cc5f0c-7f05-4b4c-b93b-1c8235ef11c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3acab6cd7624070acb9ef7eb5b58ec0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:13.646729 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-f2cc5f0c-7f05-4b4c-b93b-1c8235ef11c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3acab6cd7624070acb9ef7eb5b58ec0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:13.661998 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-f2cc5f0c-7f05-4b4c-b93b-1c8235ef11c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3acab6cd7624070acb9ef7eb5b58ec0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:13.669219 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 901/1788] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:13 2022] DELETE /identity/v3/users/a3acab6cd7624070acb9ef7eb5b58ec0 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:13.721024 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 888/1789] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:13 2022] POST /identity/v3/users => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:13.721685 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc5f0c-7f05-4b4c-b93b-1c8235ef11c9 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:13.723816 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-f2cc5f0c-7f05-4b4c-b93b-1c8235ef11c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:13.815972 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc5f0c-7f05-4b4c-b93b-1c8235ef11c9 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:13.821170 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4ccf7-824d-4d0b-9ef3-685568eccef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:13.821863 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4ccf7-824d-4d0b-9ef3-685568eccef0 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:13.822276 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4ccf7-824d-4d0b-9ef3-685568eccef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:13.822599 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4ccf7-824d-4d0b-9ef3-685568eccef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:13.823681 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4ccf7-824d-4d0b-9ef3-685568eccef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:13.828263 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4ccf7-824d-4d0b-9ef3-685568eccef0 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:13.838911 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 902/1790] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:13.843199 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7512a-4b8e-4b17-8a5d-5e3b117a1239 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:13.854128 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7512a-4b8e-4b17-8a5d-5e3b117a1239 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:13.859027 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77189cfb-9c8c-4915-bf2e-0e04d227bbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:13.859903 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77189cfb-9c8c-4915-bf2e-0e04d227bbc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:13.862666 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77189cfb-9c8c-4915-bf2e-0e04d227bbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:13.862666 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77189cfb-9c8c-4915-bf2e-0e04d227bbc9 admin admin] PATH_INFO: `/v3/projects/94bf645737b24d9bad508ab760e7ccf4/users/63edce05cdb74d2893c736f54fd78310/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:13.881312 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77189cfb-9c8c-4915-bf2e-0e04d227bbc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94bf645737b24d9bad508ab760e7ccf4, user_id=63edce05cdb74d2893c736f54fd78310, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:13.884170 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77189cfb-9c8c-4915-bf2e-0e04d227bbc9 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:13.939809 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 889/1791] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:13 2022] PUT /identity/v3/projects/94bf645737b24d9bad508ab760e7ccf4/users/63edce05cdb74d2893c736f54fd78310/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:13.943413 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4ccf7-824d-4d0b-9ef3-685568eccef0 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:13.954612 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4ccf7-824d-4d0b-9ef3-685568eccef0 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:14.023626 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93265410-ca0f-4a38-af63-21dfaad6333f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:14.024327 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93265410-ca0f-4a38-af63-21dfaad6333f admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:14.024655 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93265410-ca0f-4a38-af63-21dfaad6333f admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:14.024932 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93265410-ca0f-4a38-af63-21dfaad6333f admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:14.025656 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93265410-ca0f-4a38-af63-21dfaad6333f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:14.027337 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93265410-ca0f-4a38-af63-21dfaad6333f admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:14.037203 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 903/1792] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:14.042015 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77189cfb-9c8c-4915-bf2e-0e04d227bbc9 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:14.052435 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77189cfb-9c8c-4915-bf2e-0e04d227bbc9 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:14.057509 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21bb87-b582-444e-b733-706920d10545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:14.058399 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21bb87-b582-444e-b733-706920d10545 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:14.058671 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21bb87-b582-444e-b733-706920d10545 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:14.058970 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21bb87-b582-444e-b733-706920d10545 admin admin] PATH_INFO: `/v3/projects/94bf645737b24d9bad508ab760e7ccf4/users/63edce05cdb74d2893c736f54fd78310/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:14.060934 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21bb87-b582-444e-b733-706920d10545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94bf645737b24d9bad508ab760e7ccf4, user_id=63edce05cdb74d2893c736f54fd78310, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:14.063544 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21bb87-b582-444e-b733-706920d10545 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:14.073680 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 890/1793] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:14 2022] PUT /identity/v3/projects/94bf645737b24d9bad508ab760e7ccf4/users/63edce05cdb74d2893c736f54fd78310/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:14.083416 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709772cb-67bd-4e5f-8398-acaa83602626 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:14.083713 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709772cb-67bd-4e5f-8398-acaa83602626 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:14.083985 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709772cb-67bd-4e5f-8398-acaa83602626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:14.098424 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21bb87-b582-444e-b733-706920d10545 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:14.100101 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-5e21bb87-b582-444e-b733-706920d10545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:14.113758 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-709772cb-67bd-4e5f-8398-acaa83602626 None None] MFA Rules not processed for user `63edce05cdb74d2893c736f54fd78310`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:14.114985 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-709772cb-67bd-4e5f-8398-acaa83602626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:14.168281 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21bb87-b582-444e-b733-706920d10545 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:14.172911 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fdc55d-e3ad-4ddc-97dc-c07b14ced99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:14.173766 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdc55d-e3ad-4ddc-97dc-c07b14ced99f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:14.174044 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdc55d-e3ad-4ddc-97dc-c07b14ced99f admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:14.174321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fdc55d-e3ad-4ddc-97dc-c07b14ced99f admin admin] PATH_INFO: `/v3/projects/3151b1506fe242119eb822f9debaa62c` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:14.175587 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdc55d-e3ad-4ddc-97dc-c07b14ced99f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3151b1506fe242119eb822f9debaa62c)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:14.177463 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fdc55d-e3ad-4ddc-97dc-c07b14ced99f admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:14.183901 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 904/1794] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:14.195799 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709772cb-67bd-4e5f-8398-acaa83602626 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:14.197145 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-709772cb-67bd-4e5f-8398-acaa83602626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:14.263274 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709772cb-67bd-4e5f-8398-acaa83602626 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:14.274521 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-40fdc55d-e3ad-4ddc-97dc-c07b14ced99f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3151b1506fe242119eb822f9debaa62c', 'request_id': 'req-40fdc55d-e3ad-4ddc-97dc-c07b14ced99f'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:14.328353 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba3400-930d-4cde-95d1-a42bdb84e4d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:14.329015 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba3400-930d-4cde-95d1-a42bdb84e4d5 service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:14.329296 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba3400-930d-4cde-95d1-a42bdb84e4d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:14.329571 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba3400-930d-4cde-95d1-a42bdb84e4d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:14.337756 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-40fdc55d-e3ad-4ddc-97dc-c07b14ced99f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3151b1506fe242119eb822f9debaa62c', 'request_id': 'req-40fdc55d-e3ad-4ddc-97dc-c07b14ced99f'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:14.344636 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-40fdc55d-e3ad-4ddc-97dc-c07b14ced99f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3151b1506fe242119eb822f9debaa62c', 'request_id': 'req-40fdc55d-e3ad-4ddc-97dc-c07b14ced99f'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:14.361813 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-40fdc55d-e3ad-4ddc-97dc-c07b14ced99f admin admin] The token cache is being invalidate because project 3151b1506fe242119eb822f9debaa62c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:14.362298 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-40fdc55d-e3ad-4ddc-97dc-c07b14ced99f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:14.363092 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-40fdc55d-e3ad-4ddc-97dc-c07b14ced99f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:14.365293 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 891/1795] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:14 2022] DELETE /identity/v3/projects/3151b1506fe242119eb822f9debaa62c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:14.370365 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b8b9e-c6f3-4a8c-b0be-b4227cc3e446 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:14.370758 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b8b9e-c6f3-4a8c-b0be-b4227cc3e446 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:14.371165 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b8b9e-c6f3-4a8c-b0be-b4227cc3e446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:14.391162 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-513b8b9e-c6f3-4a8c-b0be-b4227cc3e446 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:14.392516 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-513b8b9e-c6f3-4a8c-b0be-b4227cc3e446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:14.401315 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba3400-930d-4cde-95d1-a42bdb84e4d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:14.403661 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba3400-930d-4cde-95d1-a42bdb84e4d5 service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:14.417937 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 905/1796] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:02:14.461821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 892/1797] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:14.469546 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea33a17-239a-4e0e-8e46-5c73f14e9c2f None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:14.469838 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea33a17-239a-4e0e-8e46-5c73f14e9c2f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:14.470124 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea33a17-239a-4e0e-8e46-5c73f14e9c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:14.493099 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-6ea33a17-239a-4e0e-8e46-5c73f14e9c2f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:14.494340 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-6ea33a17-239a-4e0e-8e46-5c73f14e9c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:14.506868 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 906/1798] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:14.511328 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b8b9e-c6f3-4a8c-b0be-b4227cc3e446 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:14.527188 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b8b9e-c6f3-4a8c-b0be-b4227cc3e446 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:14.531353 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1117c283-c8cf-47e0-84e9-a754e19ae948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:14.532183 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117c283-c8cf-47e0-84e9-a754e19ae948 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:14.532539 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117c283-c8cf-47e0-84e9-a754e19ae948 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:14.532887 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1117c283-c8cf-47e0-84e9-a754e19ae948 admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:14.533692 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117c283-c8cf-47e0-84e9-a754e19ae948 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:02:14.534065 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117c283-c8cf-47e0-84e9-a754e19ae948 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:14.535900 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1117c283-c8cf-47e0-84e9-a754e19ae948 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:14.549321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 893/1799] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:02:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:02:14.553668 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea33a17-239a-4e0e-8e46-5c73f14e9c2f None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:14.564638 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea33a17-239a-4e0e-8e46-5c73f14e9c2f None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:14.569328 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da40ad-5841-4f29-ae8c-8ea1c7a53679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:14.570587 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da40ad-5841-4f29-ae8c-8ea1c7a53679 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:14.570888 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da40ad-5841-4f29-ae8c-8ea1c7a53679 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:14.571231 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98da40ad-5841-4f29-ae8c-8ea1c7a53679 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:14.571930 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da40ad-5841-4f29-ae8c-8ea1c7a53679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:14.574905 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98da40ad-5841-4f29-ae8c-8ea1c7a53679 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:14.647088 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551ea5d-7915-4f1b-aa3f-f2339412cf9d None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:14.647689 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551ea5d-7915-4f1b-aa3f-f2339412cf9d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:14.647689 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551ea5d-7915-4f1b-aa3f-f2339412cf9d None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:14.650125 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 894/1800] 10.222.0.24 () {54 vars in 921 bytes} [Tue Apr 12 00:02:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:02:14.659827 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7520fa-e2e6-4aa2-84ae-4805ba450a90 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:14.660676 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7520fa-e2e6-4aa2-84ae-4805ba450a90 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:14.661028 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7520fa-e2e6-4aa2-84ae-4805ba450a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:14.680532 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-3e7520fa-e2e6-4aa2-84ae-4805ba450a90 None None] MFA Rules not processed for user `a9519f49f897415a894c1121278dda9c`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:14.681736 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-3e7520fa-e2e6-4aa2-84ae-4805ba450a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:14.706238 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 907/1801] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:14 2022] POST /identity/v3/projects => generated 369 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:14.708915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da40ad-5841-4f29-ae8c-8ea1c7a53679 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:14.752607 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 895/1802] 10.222.0.24 () {58 vars in 1018 bytes} [Tue Apr 12 00:02:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:14.778042 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7520fa-e2e6-4aa2-84ae-4805ba450a90 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:14.779567 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-3e7520fa-e2e6-4aa2-84ae-4805ba450a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:14.781554 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98da40ad-5841-4f29-ae8c-8ea1c7a53679 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:14.787394 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30155a-9c77-4140-bceb-d2787f77e04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:14.797928 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30155a-9c77-4140-bceb-d2787f77e04d admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:14.798275 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30155a-9c77-4140-bceb-d2787f77e04d admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:14.798522 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7520fa-e2e6-4aa2-84ae-4805ba450a90 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:14.798634 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a30155a-9c77-4140-bceb-d2787f77e04d admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:14.799590 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30155a-9c77-4140-bceb-d2787f77e04d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:14.802249 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a30155a-9c77-4140-bceb-d2787f77e04d admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:14.873948 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32681a85-a57a-4442-82ee-0d13cd932605 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:14.877639 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32681a85-a57a-4442-82ee-0d13cd932605 service nova] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:14.877639 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32681a85-a57a-4442-82ee-0d13cd932605 service nova] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:14.877639 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32681a85-a57a-4442-82ee-0d13cd932605 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:14.887427 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32681a85-a57a-4442-82ee-0d13cd932605 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:14.889063 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32681a85-a57a-4442-82ee-0d13cd932605 service nova] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:14.902722 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 896/1803] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:02:14.904084 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 908/1804] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:14 2022] POST /identity/v3/users => generated 285 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:14.908965 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32681a85-a57a-4442-82ee-0d13cd932605 service nova] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:14.926818 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32681a85-a57a-4442-82ee-0d13cd932605 service nova] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:14.933940 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dfc21-4d03-43ad-84cb-c975574eac7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:14.935031 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dfc21-4d03-43ad-84cb-c975574eac7a admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:14.935697 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dfc21-4d03-43ad-84cb-c975574eac7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:14.936305 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185dfc21-4d03-43ad-84cb-c975574eac7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:14.937300 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dfc21-4d03-43ad-84cb-c975574eac7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:14.939500 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185dfc21-4d03-43ad-84cb-c975574eac7a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:14.956343 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 897/1805] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:14.959797 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30155a-9c77-4140-bceb-d2787f77e04d admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:14.971364 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a30155a-9c77-4140-bceb-d2787f77e04d admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:14.976474 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23760d4-8753-44e5-bfda-e32a5b404229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:14.977439 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23760d4-8753-44e5-bfda-e32a5b404229 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:14.977901 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23760d4-8753-44e5-bfda-e32a5b404229 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:14.978371 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23760d4-8753-44e5-bfda-e32a5b404229 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:14.979349 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23760d4-8753-44e5-bfda-e32a5b404229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:14.981460 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23760d4-8753-44e5-bfda-e32a5b404229 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:14.998543 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 909/1806] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:15.003057 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dfc21-4d03-43ad-84cb-c975574eac7a admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:15.018985 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185dfc21-4d03-43ad-84cb-c975574eac7a admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:15.034789 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb9afb-e2cb-46d8-a044-96d7e598b9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:15.035808 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb9afb-e2cb-46d8-a044-96d7e598b9b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:15.036285 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb9afb-e2cb-46d8-a044-96d7e598b9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:15.036390 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb9afb-e2cb-46d8-a044-96d7e598b9b1 admin admin] PATH_INFO: `/v3/projects/731c4d475016496db4717d97807e7ea0/users/915899fc5cf040d9b8f61b340c57a3c4/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:15.061351 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb9afb-e2cb-46d8-a044-96d7e598b9b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=731c4d475016496db4717d97807e7ea0, user_id=915899fc5cf040d9b8f61b340c57a3c4, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:15.062800 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb9afb-e2cb-46d8-a044-96d7e598b9b1 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:15.170770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 898/1807] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:15 2022] PUT /identity/v3/projects/731c4d475016496db4717d97807e7ea0/users/915899fc5cf040d9b8f61b340c57a3c4/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:15.178216 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d22955-d1f2-4b89-84fd-491bd24e4144 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:15.178628 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d22955-d1f2-4b89-84fd-491bd24e4144 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:15.180002 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d22955-d1f2-4b89-84fd-491bd24e4144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:15.212836 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-e6d22955-d1f2-4b89-84fd-491bd24e4144 None None] MFA Rules not processed for user `915899fc5cf040d9b8f61b340c57a3c4`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:15.214086 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-e6d22955-d1f2-4b89-84fd-491bd24e4144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:15.283114 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 910/1808] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:15.285595 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb9afb-e2cb-46d8-a044-96d7e598b9b1 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:15.347693 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb9afb-e2cb-46d8-a044-96d7e598b9b1 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:15.360213 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76cb21-52e9-43f9-a351-5043b64ee5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:15.361146 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76cb21-52e9-43f9-a351-5043b64ee5a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:15.361292 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76cb21-52e9-43f9-a351-5043b64ee5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:15.361703 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76cb21-52e9-43f9-a351-5043b64ee5a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:15.362464 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76cb21-52e9-43f9-a351-5043b64ee5a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:15.364476 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a76cb21-52e9-43f9-a351-5043b64ee5a9 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:15.466782 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 899/1809] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:15 2022] POST /identity/v3/projects => generated 369 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:15.470276 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d22955-d1f2-4b89-84fd-491bd24e4144 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:15.485309 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d22955-d1f2-4b89-84fd-491bd24e4144 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:15.574595 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76cb21-52e9-43f9-a351-5043b64ee5a9 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:15.577402 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-6a76cb21-52e9-43f9-a351-5043b64ee5a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:15.592383 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd6d97-55f9-498b-85c7-52542b606b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:15.595250 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd6d97-55f9-498b-85c7-52542b606b6d admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:15.596585 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd6d97-55f9-498b-85c7-52542b606b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:15.596966 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bd6d97-55f9-498b-85c7-52542b606b6d admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:15.599423 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd6d97-55f9-498b-85c7-52542b606b6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:15.603098 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bd6d97-55f9-498b-85c7-52542b606b6d admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:15.650952 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76cb21-52e9-43f9-a351-5043b64ee5a9 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:15.655730 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463e266-8514-486f-8202-15245a2f347b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:15.662687 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463e266-8514-486f-8202-15245a2f347b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:15.662687 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463e266-8514-486f-8202-15245a2f347b admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:15.662687 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463e266-8514-486f-8202-15245a2f347b admin admin] PATH_INFO: `/v3/users/b1afef762d434728ba6879fc6d49fe2c` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:15.662687 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463e266-8514-486f-8202-15245a2f347b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1afef762d434728ba6879fc6d49fe2c)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:15.662687 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8463e266-8514-486f-8202-15245a2f347b admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:15.697321 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 911/1810] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:15 2022] POST /identity/v3/users => generated 291 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:15.698398 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd6d97-55f9-498b-85c7-52542b606b6d admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:15.700085 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-41bd6d97-55f9-498b-85c7-52542b606b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:15.761437 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bd6d97-55f9-498b-85c7-52542b606b6d admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:15.765103 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dce98-a312-4b78-b7bd-13787e8eced4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:15.770234 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dce98-a312-4b78-b7bd-13787e8eced4 service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:15.770234 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dce98-a312-4b78-b7bd-13787e8eced4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:15.770234 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8dce98-a312-4b78-b7bd-13787e8eced4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:15.771771 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-ab8dce98-a312-4b78-b7bd-13787e8eced4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:15.830982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8dce98-a312-4b78-b7bd-13787e8eced4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:15.832459 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8dce98-a312-4b78-b7bd-13787e8eced4 service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:15.841730 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 912/1811] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:02:15.842451 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dce98-a312-4b78-b7bd-13787e8eced4 service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:15.852701 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8dce98-a312-4b78-b7bd-13787e8eced4 service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:15.858343 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ef444-9c75-4a5c-b8a8-8b1d7e693fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:15.859252 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ef444-9c75-4a5c-b8a8-8b1d7e693fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:15.859554 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ef444-9c75-4a5c-b8a8-8b1d7e693fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:15.859830 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966ef444-9c75-4a5c-b8a8-8b1d7e693fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:15.860578 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ef444-9c75-4a5c-b8a8-8b1d7e693fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:15.862129 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966ef444-9c75-4a5c-b8a8-8b1d7e693fb1 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:15.876461 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 913/1812] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:15.878387 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ef444-9c75-4a5c-b8a8-8b1d7e693fb1 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:15.882177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8463e266-8514-486f-8202-15245a2f347b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1afef762d434728ba6879fc6d49fe2c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:15.889264 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966ef444-9c75-4a5c-b8a8-8b1d7e693fb1 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:15.893954 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed908095-2d6d-4157-81b6-9584861375d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:15.894818 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed908095-2d6d-4157-81b6-9584861375d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:15.895122 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed908095-2d6d-4157-81b6-9584861375d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:15.895442 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed908095-2d6d-4157-81b6-9584861375d1 admin admin] PATH_INFO: `/v3/projects/2616e14c5a6e4593bf2f5c7e84283f59/users/e81570713f0f4b1fba300c29dfd2eb81/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:15.911440 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed908095-2d6d-4157-81b6-9584861375d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2616e14c5a6e4593bf2f5c7e84283f59, user_id=e81570713f0f4b1fba300c29dfd2eb81, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:15.915086 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed908095-2d6d-4157-81b6-9584861375d1 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:15.942805 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8463e266-8514-486f-8202-15245a2f347b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1afef762d434728ba6879fc6d49fe2c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:15.943486 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8463e266-8514-486f-8202-15245a2f347b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1afef762d434728ba6879fc6d49fe2c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:15.952753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8463e266-8514-486f-8202-15245a2f347b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1afef762d434728ba6879fc6d49fe2c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:15.965497 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8463e266-8514-486f-8202-15245a2f347b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1afef762d434728ba6879fc6d49fe2c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:15.971581 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 900/1813] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:15 2022] DELETE /identity/v3/users/b1afef762d434728ba6879fc6d49fe2c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:15.976584 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce630b1-87db-46ce-8710-bab24651035c None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:15.976869 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce630b1-87db-46ce-8710-bab24651035c None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:15.977141 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce630b1-87db-46ce-8710-bab24651035c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:15.988667 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 914/1814] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:15 2022] PUT /identity/v3/projects/2616e14c5a6e4593bf2f5c7e84283f59/users/e81570713f0f4b1fba300c29dfd2eb81/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:15.993850 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed908095-2d6d-4157-81b6-9584861375d1 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:15.994169 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-0ce630b1-87db-46ce-8710-bab24651035c None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:15.995400 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-0ce630b1-87db-46ce-8710-bab24651035c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:15.995569 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-ed908095-2d6d-4157-81b6-9584861375d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:16.058624 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 901/1815] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:16.069379 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce630b1-87db-46ce-8710-bab24651035c None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:16.071683 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed908095-2d6d-4157-81b6-9584861375d1 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:16.072454 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-0ce630b1-87db-46ce-8710-bab24651035c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:16.076890 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ff108-98f2-48d0-b94c-8a036649d859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:16.077634 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ff108-98f2-48d0-b94c-8a036649d859 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:16.077911 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ff108-98f2-48d0-b94c-8a036649d859 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:16.078180 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ff108-98f2-48d0-b94c-8a036649d859 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:16.079006 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ff108-98f2-48d0-b94c-8a036649d859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:16.090121 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ff108-98f2-48d0-b94c-8a036649d859 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:16.102858 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 915/1816] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:02:16.106759 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ff108-98f2-48d0-b94c-8a036649d859 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:16.119479 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ff108-98f2-48d0-b94c-8a036649d859 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:16.126482 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41061e00-3e5b-4643-b460-c3c36295816f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:16.127667 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41061e00-3e5b-4643-b460-c3c36295816f admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:16.128274 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41061e00-3e5b-4643-b460-c3c36295816f admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:16.134629 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41061e00-3e5b-4643-b460-c3c36295816f admin admin] PATH_INFO: `/v3/projects/2616e14c5a6e4593bf2f5c7e84283f59/users/e81570713f0f4b1fba300c29dfd2eb81/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:16.134629 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41061e00-3e5b-4643-b460-c3c36295816f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2616e14c5a6e4593bf2f5c7e84283f59, user_id=e81570713f0f4b1fba300c29dfd2eb81, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:16.134629 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41061e00-3e5b-4643-b460-c3c36295816f admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:16.143076 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce630b1-87db-46ce-8710-bab24651035c None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:16.145548 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 916/1817] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:16 2022] PUT /identity/v3/projects/2616e14c5a6e4593bf2f5c7e84283f59/users/e81570713f0f4b1fba300c29dfd2eb81/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:16.156084 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d68b3-88d4-4dd1-a172-e985ebc0fd31 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:16.156368 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d68b3-88d4-4dd1-a172-e985ebc0fd31 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:16.156702 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d68b3-88d4-4dd1-a172-e985ebc0fd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:16.184403 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-585d68b3-88d4-4dd1-a172-e985ebc0fd31 None None] MFA Rules not processed for user `e81570713f0f4b1fba300c29dfd2eb81`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:16.185589 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-585d68b3-88d4-4dd1-a172-e985ebc0fd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:16.207217 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8bf113-4c93-4b48-8d62-1b5ebebb53be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:16.207876 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bf113-4c93-4b48-8d62-1b5ebebb53be service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:16.208155 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bf113-4c93-4b48-8d62-1b5ebebb53be service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:16.208423 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bf113-4c93-4b48-8d62-1b5ebebb53be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:16.279429 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 917/1818] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:16 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:16.292609 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d68b3-88d4-4dd1-a172-e985ebc0fd31 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:16.299505 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-585d68b3-88d4-4dd1-a172-e985ebc0fd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:16.307182 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8bf113-4c93-4b48-8d62-1b5ebebb53be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:16.309287 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8bf113-4c93-4b48-8d62-1b5ebebb53be service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:16.321827 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 902/1819] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:02:16.362233 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d68b3-88d4-4dd1-a172-e985ebc0fd31 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:16.365998 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cc5b8-ea95-4578-a3ed-6d55e0487d6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:16.366683 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cc5b8-ea95-4578-a3ed-6d55e0487d6f service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:16.366990 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cc5b8-ea95-4578-a3ed-6d55e0487d6f service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:16.367289 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cc5b8-ea95-4578-a3ed-6d55e0487d6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:16.381817 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cc5b8-ea95-4578-a3ed-6d55e0487d6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:16.384381 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cc5b8-ea95-4578-a3ed-6d55e0487d6f service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:16.395881 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 918/1820] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:16 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:02:16.902706 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8bf113-4c93-4b48-8d62-1b5ebebb53be service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:16.904232 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-cd8bf113-4c93-4b48-8d62-1b5ebebb53be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:16.918255 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8bf113-4c93-4b48-8d62-1b5ebebb53be service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:16.922958 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f24f87-80a3-4f6b-822c-79d38276e5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:16.923842 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f24f87-80a3-4f6b-822c-79d38276e5ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:16.928384 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f24f87-80a3-4f6b-822c-79d38276e5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:16.928384 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f24f87-80a3-4f6b-822c-79d38276e5ad admin admin] PATH_INFO: `/v3/projects/0900961e14a34e289ccb17b6d11da861` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:16.928384 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f24f87-80a3-4f6b-822c-79d38276e5ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=0900961e14a34e289ccb17b6d11da861)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:16.928384 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f24f87-80a3-4f6b-822c-79d38276e5ad admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:17.051126 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-87f24f87-80a3-4f6b-822c-79d38276e5ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0900961e14a34e289ccb17b6d11da861', 'request_id': 'req-87f24f87-80a3-4f6b-822c-79d38276e5ad'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:17.120102 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-87f24f87-80a3-4f6b-822c-79d38276e5ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0900961e14a34e289ccb17b6d11da861', 'request_id': 'req-87f24f87-80a3-4f6b-822c-79d38276e5ad'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:17.125975 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-87f24f87-80a3-4f6b-822c-79d38276e5ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0900961e14a34e289ccb17b6d11da861', 'request_id': 'req-87f24f87-80a3-4f6b-822c-79d38276e5ad'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:17.136584 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-87f24f87-80a3-4f6b-822c-79d38276e5ad admin admin] The token cache is being invalidate because project 0900961e14a34e289ccb17b6d11da861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:17.138757 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-87f24f87-80a3-4f6b-822c-79d38276e5ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:17.138757 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-87f24f87-80a3-4f6b-822c-79d38276e5ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:17.139095 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 903/1821] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:16 2022] DELETE /identity/v3/projects/0900961e14a34e289ccb17b6d11da861 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:17.143037 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cc5b8-ea95-4578-a3ed-6d55e0487d6f service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:17.154098 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cc5b8-ea95-4578-a3ed-6d55e0487d6f service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:17.209036 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd34e0-0419-48f5-b30a-86f5ac7bfc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:17.209902 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd34e0-0419-48f5-b30a-86f5ac7bfc4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:17.211335 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd34e0-0419-48f5-b30a-86f5ac7bfc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:17.211618 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd34e0-0419-48f5-b30a-86f5ac7bfc4d admin admin] PATH_INFO: `/v3/users/51b159b9615c4145a9d052ca03141abb` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:17.212805 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd34e0-0419-48f5-b30a-86f5ac7bfc4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=51b159b9615c4145a9d052ca03141abb)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:17.214703 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd34e0-0419-48f5-b30a-86f5ac7bfc4d admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:17.341008 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-66cd34e0-0419-48f5-b30a-86f5ac7bfc4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51b159b9615c4145a9d052ca03141abb'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:17.348543 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-66cd34e0-0419-48f5-b30a-86f5ac7bfc4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51b159b9615c4145a9d052ca03141abb'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:17.394276 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-66cd34e0-0419-48f5-b30a-86f5ac7bfc4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51b159b9615c4145a9d052ca03141abb'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:17.394816 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-66cd34e0-0419-48f5-b30a-86f5ac7bfc4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51b159b9615c4145a9d052ca03141abb'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:17.407873 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-66cd34e0-0419-48f5-b30a-86f5ac7bfc4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51b159b9615c4145a9d052ca03141abb'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:17.414717 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 919/1822] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:17 2022] DELETE /identity/v3/users/51b159b9615c4145a9d052ca03141abb => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:17.863316 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f24f87-80a3-4f6b-822c-79d38276e5ad admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:17.864743 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-87f24f87-80a3-4f6b-822c-79d38276e5ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:17.882737 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f24f87-80a3-4f6b-822c-79d38276e5ad admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:17.955038 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8250b3-0048-4432-8920-55f6d977a3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:17.956068 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8250b3-0048-4432-8920-55f6d977a3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:17.956348 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8250b3-0048-4432-8920-55f6d977a3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:17.956621 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8250b3-0048-4432-8920-55f6d977a3fe admin admin] PATH_INFO: `/v3/projects/15addcbecb294bc2b841fc31881f0047` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:17.957905 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8250b3-0048-4432-8920-55f6d977a3fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=15addcbecb294bc2b841fc31881f0047)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:17.959901 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8250b3-0048-4432-8920-55f6d977a3fe admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:18.063098 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bc8250b3-0048-4432-8920-55f6d977a3fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15addcbecb294bc2b841fc31881f0047', 'request_id': 'req-bc8250b3-0048-4432-8920-55f6d977a3fe'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:18.142894 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bc8250b3-0048-4432-8920-55f6d977a3fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15addcbecb294bc2b841fc31881f0047', 'request_id': 'req-bc8250b3-0048-4432-8920-55f6d977a3fe'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:18.149324 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bc8250b3-0048-4432-8920-55f6d977a3fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15addcbecb294bc2b841fc31881f0047', 'request_id': 'req-bc8250b3-0048-4432-8920-55f6d977a3fe'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:18.162541 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bc8250b3-0048-4432-8920-55f6d977a3fe admin admin] The token cache is being invalidate because project 15addcbecb294bc2b841fc31881f0047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:18.162856 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bc8250b3-0048-4432-8920-55f6d977a3fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:18.163739 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bc8250b3-0048-4432-8920-55f6d977a3fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:18.165499 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 904/1823] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:17 2022] DELETE /identity/v3/projects/15addcbecb294bc2b841fc31881f0047 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:18.172210 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ebc09-114e-47e1-a5b6-96b11a709eca None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:18.172689 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ebc09-114e-47e1-a5b6-96b11a709eca None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:18.172933 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757ebc09-114e-47e1-a5b6-96b11a709eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:18.192344 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-757ebc09-114e-47e1-a5b6-96b11a709eca None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:18.193616 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-757ebc09-114e-47e1-a5b6-96b11a709eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:18.258875 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 920/1824] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:18.267293 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a7c57-cfb5-4655-9784-aa2fe1ae179b None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:18.267707 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a7c57-cfb5-4655-9784-aa2fe1ae179b None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:18.267999 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a7c57-cfb5-4655-9784-aa2fe1ae179b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:18.307652 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-825a7c57-cfb5-4655-9784-aa2fe1ae179b None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:18.312299 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-825a7c57-cfb5-4655-9784-aa2fe1ae179b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:18.318695 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 905/1825] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:18.323217 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ebc09-114e-47e1-a5b6-96b11a709eca None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:18.335960 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757ebc09-114e-47e1-a5b6-96b11a709eca None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:18.341402 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9940f5-74e6-4e47-9875-e48b8ea1b2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:18.342376 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9940f5-74e6-4e47-9875-e48b8ea1b2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:18.342805 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9940f5-74e6-4e47-9875-e48b8ea1b2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:18.343387 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9940f5-74e6-4e47-9875-e48b8ea1b2f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:18.344333 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9940f5-74e6-4e47-9875-e48b8ea1b2f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:02:18.344779 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9940f5-74e6-4e47-9875-e48b8ea1b2f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:18.346519 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9940f5-74e6-4e47-9875-e48b8ea1b2f8 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:18.360347 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 921/1826] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:02:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:02:18.365113 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a7c57-cfb5-4655-9784-aa2fe1ae179b None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:18.375609 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825a7c57-cfb5-4655-9784-aa2fe1ae179b None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:18.380474 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec9b14-49c8-42e6-ad04-5c5b0e0126ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:18.381148 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec9b14-49c8-42e6-ad04-5c5b0e0126ea admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:18.381440 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec9b14-49c8-42e6-ad04-5c5b0e0126ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:18.381700 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eec9b14-49c8-42e6-ad04-5c5b0e0126ea admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:18.382430 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec9b14-49c8-42e6-ad04-5c5b0e0126ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:18.384393 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eec9b14-49c8-42e6-ad04-5c5b0e0126ea admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:18.488555 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 906/1827] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:18 2022] POST /identity/v3/projects => generated 401 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:18.496445 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9940f5-74e6-4e47-9875-e48b8ea1b2f8 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:18.510808 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9940f5-74e6-4e47-9875-e48b8ea1b2f8 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:18.585511 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebab5d-f3ae-4dbc-8e74-f8b16e905399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:18.586342 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebab5d-f3ae-4dbc-8e74-f8b16e905399 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:18.593765 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebab5d-f3ae-4dbc-8e74-f8b16e905399 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:18.593765 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebab5d-f3ae-4dbc-8e74-f8b16e905399 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:18.593765 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ebab5d-f3ae-4dbc-8e74-f8b16e905399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:18.593765 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ebab5d-f3ae-4dbc-8e74-f8b16e905399 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:18.708347 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 922/1828] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:18 2022] POST /identity/v3/users => generated 301 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:18.709411 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec9b14-49c8-42e6-ad04-5c5b0e0126ea admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:18.721426 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eec9b14-49c8-42e6-ad04-5c5b0e0126ea admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:18.727485 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e816d-0f5d-49cd-b8f1-306cfba02533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:18.728012 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e816d-0f5d-49cd-b8f1-306cfba02533 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:18.728297 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e816d-0f5d-49cd-b8f1-306cfba02533 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:18.728574 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e816d-0f5d-49cd-b8f1-306cfba02533 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:18.729315 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e816d-0f5d-49cd-b8f1-306cfba02533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:18.731247 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e816d-0f5d-49cd-b8f1-306cfba02533 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:18.746109 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 907/1829] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:18.747619 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebab5d-f3ae-4dbc-8e74-f8b16e905399 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:18.758935 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebab5d-f3ae-4dbc-8e74-f8b16e905399 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:18.766317 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eeccfa-5056-4e79-acee-8d836b9510e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:18.767241 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeccfa-5056-4e79-acee-8d836b9510e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:18.767618 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeccfa-5056-4e79-acee-8d836b9510e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:18.768021 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eeccfa-5056-4e79-acee-8d836b9510e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:18.768853 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eeccfa-5056-4e79-acee-8d836b9510e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:18.770604 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eeccfa-5056-4e79-acee-8d836b9510e1 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:18.783030 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 923/1830] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:18.786621 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e816d-0f5d-49cd-b8f1-306cfba02533 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:18.797207 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e816d-0f5d-49cd-b8f1-306cfba02533 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:18.802028 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7534a-2279-40f4-a27a-2475b17e3a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:18.803018 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7534a-2279-40f4-a27a-2475b17e3a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:18.803378 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7534a-2279-40f4-a27a-2475b17e3a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:18.803812 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d7534a-2279-40f4-a27a-2475b17e3a69 admin admin] PATH_INFO: `/v3/projects/d8a58ce3e75a4835bc5fa9542f884e37/users/efd82494963b449a8fd6ccdfc93e88a1/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:18.821619 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7534a-2279-40f4-a27a-2475b17e3a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8a58ce3e75a4835bc5fa9542f884e37, user_id=efd82494963b449a8fd6ccdfc93e88a1, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:18.824495 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d7534a-2279-40f4-a27a-2475b17e3a69 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:18.903123 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 908/1831] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:18 2022] PUT /identity/v3/projects/d8a58ce3e75a4835bc5fa9542f884e37/users/efd82494963b449a8fd6ccdfc93e88a1/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:18.914977 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ca157-04f4-4657-a15b-bcf9fefe38a8 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:18.915261 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ca157-04f4-4657-a15b-bcf9fefe38a8 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:18.915535 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ca157-04f4-4657-a15b-bcf9fefe38a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:18.942480 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-b96ca157-04f4-4657-a15b-bcf9fefe38a8 None None] MFA Rules not processed for user `efd82494963b449a8fd6ccdfc93e88a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:18.943702 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-b96ca157-04f4-4657-a15b-bcf9fefe38a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:19.026202 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 924/1832] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:19.030614 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7534a-2279-40f4-a27a-2475b17e3a69 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:19.098597 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d7534a-2279-40f4-a27a-2475b17e3a69 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:19.104641 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7215b4b-91cb-42cd-ac3a-eb2eed3af056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:19.105842 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7215b4b-91cb-42cd-ac3a-eb2eed3af056 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:19.106312 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7215b4b-91cb-42cd-ac3a-eb2eed3af056 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:19.111295 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7215b4b-91cb-42cd-ac3a-eb2eed3af056 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:19.111295 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7215b4b-91cb-42cd-ac3a-eb2eed3af056 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:19.111295 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7215b4b-91cb-42cd-ac3a-eb2eed3af056 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:19.285057 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 909/1833] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:19 2022] POST /identity/v3/projects => generated 401 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:19.288728 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ca157-04f4-4657-a15b-bcf9fefe38a8 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:19.299885 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ca157-04f4-4657-a15b-bcf9fefe38a8 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:19.332974 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7215b4b-91cb-42cd-ac3a-eb2eed3af056 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:19.338318 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-e7215b4b-91cb-42cd-ac3a-eb2eed3af056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:19.388183 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a4faa-f09b-45e4-b124-b6e4d28c524a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:19.393183 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a4faa-f09b-45e4-b124-b6e4d28c524a admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:19.393183 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a4faa-f09b-45e4-b124-b6e4d28c524a admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:19.393183 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4a4faa-f09b-45e4-b124-b6e4d28c524a admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:19.393183 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a4faa-f09b-45e4-b124-b6e4d28c524a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:19.393183 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4a4faa-f09b-45e4-b124-b6e4d28c524a admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:19.414815 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7215b4b-91cb-42cd-ac3a-eb2eed3af056 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:19.419494 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace7fe4a-c9d0-4e25-82f0-77a0c80b7579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:19.420394 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7fe4a-c9d0-4e25-82f0-77a0c80b7579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:19.420674 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7fe4a-c9d0-4e25-82f0-77a0c80b7579 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:19.420949 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace7fe4a-c9d0-4e25-82f0-77a0c80b7579 admin admin] PATH_INFO: `/v3/users/915899fc5cf040d9b8f61b340c57a3c4` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:19.422363 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7fe4a-c9d0-4e25-82f0-77a0c80b7579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=915899fc5cf040d9b8f61b340c57a3c4)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:19.424326 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace7fe4a-c9d0-4e25-82f0-77a0c80b7579 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:19.531524 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 925/1834] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:19 2022] POST /identity/v3/users => generated 307 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:19.535427 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a4faa-f09b-45e4-b124-b6e4d28c524a admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:19.545226 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4a4faa-f09b-45e4-b124-b6e4d28c524a admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:19.550079 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b637318-064e-49d5-b16b-522a0bd2c193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:19.550732 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b637318-064e-49d5-b16b-522a0bd2c193 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:19.551160 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b637318-064e-49d5-b16b-522a0bd2c193 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:19.551436 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b637318-064e-49d5-b16b-522a0bd2c193 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:19.552219 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b637318-064e-49d5-b16b-522a0bd2c193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:19.554237 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b637318-064e-49d5-b16b-522a0bd2c193 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:19.566135 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 926/1835] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:02:19.573107 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b637318-064e-49d5-b16b-522a0bd2c193 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:19.585373 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b637318-064e-49d5-b16b-522a0bd2c193 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:19.590114 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89abf27-f73c-4928-8b80-b83b20b4cb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:19.591029 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89abf27-f73c-4928-8b80-b83b20b4cb64 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:19.591308 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89abf27-f73c-4928-8b80-b83b20b4cb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:19.591587 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89abf27-f73c-4928-8b80-b83b20b4cb64 admin admin] PATH_INFO: `/v3/projects/0d4cd1f853f141528061c038a6ef4243/users/29be8bad84394b02b286246c5b8ee9d1/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:19.606428 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89abf27-f73c-4928-8b80-b83b20b4cb64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d4cd1f853f141528061c038a6ef4243, user_id=29be8bad84394b02b286246c5b8ee9d1, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:19.609081 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89abf27-f73c-4928-8b80-b83b20b4cb64 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:19.659986 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ace7fe4a-c9d0-4e25-82f0-77a0c80b7579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '915899fc5cf040d9b8f61b340c57a3c4'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:19.709090 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 927/1836] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:19 2022] PUT /identity/v3/projects/0d4cd1f853f141528061c038a6ef4243/users/29be8bad84394b02b286246c5b8ee9d1/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:19.713108 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89abf27-f73c-4928-8b80-b83b20b4cb64 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:19.744518 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ace7fe4a-c9d0-4e25-82f0-77a0c80b7579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '915899fc5cf040d9b8f61b340c57a3c4'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:19.745609 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ace7fe4a-c9d0-4e25-82f0-77a0c80b7579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '915899fc5cf040d9b8f61b340c57a3c4'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:19.784168 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89abf27-f73c-4928-8b80-b83b20b4cb64 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:19.785604 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ace7fe4a-c9d0-4e25-82f0-77a0c80b7579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '915899fc5cf040d9b8f61b340c57a3c4'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:19.789772 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf6cd4-0d0a-44f3-9dd8-d78713d1db9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:19.790450 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf6cd4-0d0a-44f3-9dd8-d78713d1db9d admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:19.790727 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf6cd4-0d0a-44f3-9dd8-d78713d1db9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:19.791238 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bf6cd4-0d0a-44f3-9dd8-d78713d1db9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:19.791866 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf6cd4-0d0a-44f3-9dd8-d78713d1db9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:19.793513 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bf6cd4-0d0a-44f3-9dd8-d78713d1db9d admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:19.805101 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 928/1837] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:19.809060 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf6cd4-0d0a-44f3-9dd8-d78713d1db9d admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:19.812211 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ace7fe4a-c9d0-4e25-82f0-77a0c80b7579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '915899fc5cf040d9b8f61b340c57a3c4'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:19.813517 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-b9bf6cd4-0d0a-44f3-9dd8-d78713d1db9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:19.828180 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 910/1838] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:19 2022] DELETE /identity/v3/users/915899fc5cf040d9b8f61b340c57a3c4 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:19.832871 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab33e0-2cef-49f7-8e3c-d8c84f62dc39 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:19.833155 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab33e0-2cef-49f7-8e3c-d8c84f62dc39 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:19.833431 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab33e0-2cef-49f7-8e3c-d8c84f62dc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:19.841962 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bf6cd4-0d0a-44f3-9dd8-d78713d1db9d admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:19.854267 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-c2ab33e0-2cef-49f7-8e3c-d8c84f62dc39 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:19.856107 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-c2ab33e0-2cef-49f7-8e3c-d8c84f62dc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:19.915640 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee30cfa-9c27-487a-9790-e924104da15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:19.916619 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee30cfa-9c27-487a-9790-e924104da15c admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:19.916976 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee30cfa-9c27-487a-9790-e924104da15c admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:19.917257 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee30cfa-9c27-487a-9790-e924104da15c admin admin] PATH_INFO: `/v3/projects/0d4cd1f853f141528061c038a6ef4243/users/29be8bad84394b02b286246c5b8ee9d1/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:19.919416 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee30cfa-9c27-487a-9790-e924104da15c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d4cd1f853f141528061c038a6ef4243, user_id=29be8bad84394b02b286246c5b8ee9d1, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:19.922552 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee30cfa-9c27-487a-9790-e924104da15c admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:19.935703 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 911/1839] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:19.936467 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 929/1840] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:19 2022] PUT /identity/v3/projects/0d4cd1f853f141528061c038a6ef4243/users/29be8bad84394b02b286246c5b8ee9d1/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:19.947115 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0f609-dfc4-48e7-b0ce-d230d7f6793c None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:19.947450 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0f609-dfc4-48e7-b0ce-d230d7f6793c None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:19.947732 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab0f609-dfc4-48e7-b0ce-d230d7f6793c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:19.981906 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-fab0f609-dfc4-48e7-b0ce-d230d7f6793c None None] MFA Rules not processed for user `29be8bad84394b02b286246c5b8ee9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:19.984889 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-fab0f609-dfc4-48e7-b0ce-d230d7f6793c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:20.069852 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 912/1841] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:19 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:20.088055 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee30cfa-9c27-487a-9790-e924104da15c admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:20.089976 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-9ee30cfa-9c27-487a-9790-e924104da15c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:20.114574 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0f609-dfc4-48e7-b0ce-d230d7f6793c None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:20.116071 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-fab0f609-dfc4-48e7-b0ce-d230d7f6793c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:20.179055 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee30cfa-9c27-487a-9790-e924104da15c admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:20.184043 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a24601-7564-416f-8966-147104b1dc7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:20.184720 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a24601-7564-416f-8966-147104b1dc7c service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:20.185088 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a24601-7564-416f-8966-147104b1dc7c service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:20.185366 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a24601-7564-416f-8966-147104b1dc7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:20.195684 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab0f609-dfc4-48e7-b0ce-d230d7f6793c None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:20.196147 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a24601-7564-416f-8966-147104b1dc7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:20.197884 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a24601-7564-416f-8966-147104b1dc7c service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:20.199932 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87716e87-e73a-48a5-a77d-65013a5e793a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:20.201032 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87716e87-e73a-48a5-a77d-65013a5e793a service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:20.201032 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87716e87-e73a-48a5-a77d-65013a5e793a service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:20.201224 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87716e87-e73a-48a5-a77d-65013a5e793a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:20.209335 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 930/1842] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:20 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:02:20.268721 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87716e87-e73a-48a5-a77d-65013a5e793a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:20.270745 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87716e87-e73a-48a5-a77d-65013a5e793a service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:20.281710 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 913/1843] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:02:20.417290 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a24601-7564-416f-8966-147104b1dc7c service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:20.427991 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a24601-7564-416f-8966-147104b1dc7c service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:20.433871 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971b321-7571-4063-b72f-2b1821a12395 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:20.434717 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971b321-7571-4063-b72f-2b1821a12395 service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:20.435330 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971b321-7571-4063-b72f-2b1821a12395 service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:20.435454 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971b321-7571-4063-b72f-2b1821a12395 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:20.437193 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-5971b321-7571-4063-b72f-2b1821a12395 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:20.498091 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971b321-7571-4063-b72f-2b1821a12395 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:20.499870 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971b321-7571-4063-b72f-2b1821a12395 service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:20.510359 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 931/1844] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:20 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:02:20.830183 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87716e87-e73a-48a5-a77d-65013a5e793a service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:20.831627 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-87716e87-e73a-48a5-a77d-65013a5e793a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:20.846714 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87716e87-e73a-48a5-a77d-65013a5e793a service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:20.852122 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324d7c9-a8fb-4ed7-9383-3a91fb26a01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:20.852978 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324d7c9-a8fb-4ed7-9383-3a91fb26a01a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:20.853242 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324d7c9-a8fb-4ed7-9383-3a91fb26a01a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:20.853532 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324d7c9-a8fb-4ed7-9383-3a91fb26a01a admin admin] PATH_INFO: `/v3/projects/731c4d475016496db4717d97807e7ea0` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:20.854720 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324d7c9-a8fb-4ed7-9383-3a91fb26a01a admin admin] RBAC: Authorizing `identity:delete_project(project_id=731c4d475016496db4717d97807e7ea0)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:20.857226 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324d7c9-a8fb-4ed7-9383-3a91fb26a01a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:20.970699 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d324d7c9-a8fb-4ed7-9383-3a91fb26a01a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '731c4d475016496db4717d97807e7ea0', 'request_id': 'req-d324d7c9-a8fb-4ed7-9383-3a91fb26a01a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:21.085507 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d324d7c9-a8fb-4ed7-9383-3a91fb26a01a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '731c4d475016496db4717d97807e7ea0', 'request_id': 'req-d324d7c9-a8fb-4ed7-9383-3a91fb26a01a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:21.091410 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d324d7c9-a8fb-4ed7-9383-3a91fb26a01a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '731c4d475016496db4717d97807e7ea0', 'request_id': 'req-d324d7c9-a8fb-4ed7-9383-3a91fb26a01a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:21.102270 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d324d7c9-a8fb-4ed7-9383-3a91fb26a01a admin admin] The token cache is being invalidate because project 731c4d475016496db4717d97807e7ea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:21.102588 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d324d7c9-a8fb-4ed7-9383-3a91fb26a01a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:21.104441 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d324d7c9-a8fb-4ed7-9383-3a91fb26a01a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:21.106405 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 914/1845] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:20 2022] DELETE /identity/v3/projects/731c4d475016496db4717d97807e7ea0 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:21.110477 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971b321-7571-4063-b72f-2b1821a12395 service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:21.121602 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971b321-7571-4063-b72f-2b1821a12395 service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:21.181822 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a718d-1fb5-4de2-a05e-ad101533b529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:21.182885 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a718d-1fb5-4de2-a05e-ad101533b529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:21.183165 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a718d-1fb5-4de2-a05e-ad101533b529 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:21.183433 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a718d-1fb5-4de2-a05e-ad101533b529 admin admin] PATH_INFO: `/v3/users/e81570713f0f4b1fba300c29dfd2eb81` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:21.185578 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a718d-1fb5-4de2-a05e-ad101533b529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e81570713f0f4b1fba300c29dfd2eb81)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:21.191703 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a718d-1fb5-4de2-a05e-ad101533b529 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:21.359909 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-962a718d-1fb5-4de2-a05e-ad101533b529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e81570713f0f4b1fba300c29dfd2eb81'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:21.377015 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-962a718d-1fb5-4de2-a05e-ad101533b529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e81570713f0f4b1fba300c29dfd2eb81'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:21.496907 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-962a718d-1fb5-4de2-a05e-ad101533b529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e81570713f0f4b1fba300c29dfd2eb81'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:21.501643 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-962a718d-1fb5-4de2-a05e-ad101533b529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e81570713f0f4b1fba300c29dfd2eb81'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:21.513022 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-962a718d-1fb5-4de2-a05e-ad101533b529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e81570713f0f4b1fba300c29dfd2eb81'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:21.519796 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 932/1846] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:21 2022] DELETE /identity/v3/users/e81570713f0f4b1fba300c29dfd2eb81 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:22.014718 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324d7c9-a8fb-4ed7-9383-3a91fb26a01a admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:22.016582 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d324d7c9-a8fb-4ed7-9383-3a91fb26a01a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:22.047310 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324d7c9-a8fb-4ed7-9383-3a91fb26a01a admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:22.107314 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1f2ad5-d635-4828-a966-f1728ee20f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:22.108173 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f2ad5-d635-4828-a966-f1728ee20f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:22.108518 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f2ad5-d635-4828-a966-f1728ee20f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:22.108725 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1f2ad5-d635-4828-a966-f1728ee20f06 admin admin] PATH_INFO: `/v3/projects/2616e14c5a6e4593bf2f5c7e84283f59` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:22.109900 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f2ad5-d635-4828-a966-f1728ee20f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2616e14c5a6e4593bf2f5c7e84283f59)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:22.111837 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1f2ad5-d635-4828-a966-f1728ee20f06 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:22.256571 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1e1f2ad5-d635-4828-a966-f1728ee20f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2616e14c5a6e4593bf2f5c7e84283f59', 'request_id': 'req-1e1f2ad5-d635-4828-a966-f1728ee20f06'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:22.331421 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1e1f2ad5-d635-4828-a966-f1728ee20f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2616e14c5a6e4593bf2f5c7e84283f59', 'request_id': 'req-1e1f2ad5-d635-4828-a966-f1728ee20f06'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:22.337336 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1e1f2ad5-d635-4828-a966-f1728ee20f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2616e14c5a6e4593bf2f5c7e84283f59', 'request_id': 'req-1e1f2ad5-d635-4828-a966-f1728ee20f06'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:22.348359 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1e1f2ad5-d635-4828-a966-f1728ee20f06 admin admin] The token cache is being invalidate because project 2616e14c5a6e4593bf2f5c7e84283f59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:22.348645 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1e1f2ad5-d635-4828-a966-f1728ee20f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:22.349662 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1e1f2ad5-d635-4828-a966-f1728ee20f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:22.352055 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 915/1847] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:22 2022] DELETE /identity/v3/projects/2616e14c5a6e4593bf2f5c7e84283f59 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:22.357065 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab3140-a113-4c25-b423-8d766128f222 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:22.357351 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab3140-a113-4c25-b423-8d766128f222 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:22.357652 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ab3140-a113-4c25-b423-8d766128f222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:22.377764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-85ab3140-a113-4c25-b423-8d766128f222 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:22.378955 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-85ab3140-a113-4c25-b423-8d766128f222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:22.438872 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 933/1848] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:22.446758 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409810fd-a1ee-41f9-9b4b-d12d9a8f299b None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:22.446758 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409810fd-a1ee-41f9-9b4b-d12d9a8f299b None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:22.446987 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409810fd-a1ee-41f9-9b4b-d12d9a8f299b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:22.474115 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-409810fd-a1ee-41f9-9b4b-d12d9a8f299b None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:22.475354 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-409810fd-a1ee-41f9-9b4b-d12d9a8f299b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:22.485814 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 916/1849] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:22.496493 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab3140-a113-4c25-b423-8d766128f222 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:22.516072 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ab3140-a113-4c25-b423-8d766128f222 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:22.520112 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b193ebf-70f0-44d4-ab51-28d40e5eff54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:22.521004 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b193ebf-70f0-44d4-ab51-28d40e5eff54 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:22.521475 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b193ebf-70f0-44d4-ab51-28d40e5eff54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:22.521928 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b193ebf-70f0-44d4-ab51-28d40e5eff54 admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:22.523441 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b193ebf-70f0-44d4-ab51-28d40e5eff54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:02:22.523990 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b193ebf-70f0-44d4-ab51-28d40e5eff54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:22.526879 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b193ebf-70f0-44d4-ab51-28d40e5eff54 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:22.552427 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 934/1850] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:02:22.558636 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409810fd-a1ee-41f9-9b4b-d12d9a8f299b None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:22.572734 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409810fd-a1ee-41f9-9b4b-d12d9a8f299b None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:22.588107 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd36c0-dfc0-4661-abb8-e765bfdf80b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:22.588806 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd36c0-dfc0-4661-abb8-e765bfdf80b0 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:22.589069 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd36c0-dfc0-4661-abb8-e765bfdf80b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:22.589395 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfd36c0-dfc0-4661-abb8-e765bfdf80b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:22.590107 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd36c0-dfc0-4661-abb8-e765bfdf80b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:22.595329 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfd36c0-dfc0-4661-abb8-e765bfdf80b0 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:22.700650 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 917/1851] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:22 2022] POST /identity/v3/projects => generated 375 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:22.704423 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b193ebf-70f0-44d4-ab51-28d40e5eff54 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:22.716463 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b193ebf-70f0-44d4-ab51-28d40e5eff54 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:22.808249 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db332a0-ec0d-4c07-a93b-e9414c5ae667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:22.809305 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db332a0-ec0d-4c07-a93b-e9414c5ae667 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:22.809835 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db332a0-ec0d-4c07-a93b-e9414c5ae667 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:22.810445 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db332a0-ec0d-4c07-a93b-e9414c5ae667 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:22.811547 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db332a0-ec0d-4c07-a93b-e9414c5ae667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:22.813664 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db332a0-ec0d-4c07-a93b-e9414c5ae667 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:22.950566 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd36c0-dfc0-4661-abb8-e765bfdf80b0 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:22.957546 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 935/1852] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:22 2022] POST /identity/v3/users => generated 288 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:22.962533 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfd36c0-dfc0-4661-abb8-e765bfdf80b0 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:22.967569 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6a7a0-ba5d-4c62-a82a-11b2569bad88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:22.968249 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6a7a0-ba5d-4c62-a82a-11b2569bad88 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:22.968533 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6a7a0-ba5d-4c62-a82a-11b2569bad88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:22.974599 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba6a7a0-ba5d-4c62-a82a-11b2569bad88 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:22.974599 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6a7a0-ba5d-4c62-a82a-11b2569bad88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:22.974599 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba6a7a0-ba5d-4c62-a82a-11b2569bad88 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:23.011188 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 918/1853] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:23.013480 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db332a0-ec0d-4c07-a93b-e9414c5ae667 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:23.027521 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db332a0-ec0d-4c07-a93b-e9414c5ae667 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:23.056283 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3b9c4-652b-4163-8951-058f90f13573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:23.059039 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3b9c4-652b-4163-8951-058f90f13573 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:23.059356 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3b9c4-652b-4163-8951-058f90f13573 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:23.059625 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3b9c4-652b-4163-8951-058f90f13573 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:23.060376 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3b9c4-652b-4163-8951-058f90f13573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:23.068794 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3b9c4-652b-4163-8951-058f90f13573 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:23.098748 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 936/1854] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:02:23.105857 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6a7a0-ba5d-4c62-a82a-11b2569bad88 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:23.120233 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba6a7a0-ba5d-4c62-a82a-11b2569bad88 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:23.130685 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb681e-5bd1-4c6e-8b3a-4b38643124d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:23.136728 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb681e-5bd1-4c6e-8b3a-4b38643124d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:23.136728 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb681e-5bd1-4c6e-8b3a-4b38643124d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:23.136728 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb681e-5bd1-4c6e-8b3a-4b38643124d9 admin admin] PATH_INFO: `/v3/projects/5664aa6340ac43e6bedeb293f6fa9bc6/users/1633eb313c7c4af6a10a824c53894bb7/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:23.166543 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb681e-5bd1-4c6e-8b3a-4b38643124d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5664aa6340ac43e6bedeb293f6fa9bc6, user_id=1633eb313c7c4af6a10a824c53894bb7, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:23.169189 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb681e-5bd1-4c6e-8b3a-4b38643124d9 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:23.240676 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 919/1855] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:23 2022] PUT /identity/v3/projects/5664aa6340ac43e6bedeb293f6fa9bc6/users/1633eb313c7c4af6a10a824c53894bb7/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:23.254393 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89239a02-1f83-4d89-b3c3-d8de905de387 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:23.254882 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89239a02-1f83-4d89-b3c3-d8de905de387 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:23.255424 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89239a02-1f83-4d89-b3c3-d8de905de387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:23.302064 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-89239a02-1f83-4d89-b3c3-d8de905de387 None None] MFA Rules not processed for user `1633eb313c7c4af6a10a824c53894bb7`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:23.303627 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-89239a02-1f83-4d89-b3c3-d8de905de387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:23.392322 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 937/1856] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:23.396551 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb681e-5bd1-4c6e-8b3a-4b38643124d9 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:23.448762 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89239a02-1f83-4d89-b3c3-d8de905de387 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:23.450289 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-89239a02-1f83-4d89-b3c3-d8de905de387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:23.475826 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb681e-5bd1-4c6e-8b3a-4b38643124d9 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:23.481926 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1baf4-32e0-4df4-9ff8-dfff4dc5a67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:23.482930 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1baf4-32e0-4df4-9ff8-dfff4dc5a67a admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:23.483405 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1baf4-32e0-4df4-9ff8-dfff4dc5a67a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:23.483781 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1baf4-32e0-4df4-9ff8-dfff4dc5a67a admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:23.484722 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1baf4-32e0-4df4-9ff8-dfff4dc5a67a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:23.487114 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1baf4-32e0-4df4-9ff8-dfff4dc5a67a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:23.526353 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89239a02-1f83-4d89-b3c3-d8de905de387 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:23.529961 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13e3f4-fa59-4a84-875a-ad1d8455002e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:23.530613 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13e3f4-fa59-4a84-875a-ad1d8455002e service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:23.530935 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13e3f4-fa59-4a84-875a-ad1d8455002e service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:23.531212 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d13e3f4-fa59-4a84-875a-ad1d8455002e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:23.533021 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1d13e3f4-fa59-4a84-875a-ad1d8455002e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:23.590919 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13e3f4-fa59-4a84-875a-ad1d8455002e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:23.592337 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d13e3f4-fa59-4a84-875a-ad1d8455002e service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:23.602504 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 938/1857] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:02:23.613731 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 920/1858] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:23 2022] POST /identity/v3/projects => generated 375 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:23.619135 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13e3f4-fa59-4a84-875a-ad1d8455002e service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:23.629813 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d13e3f4-fa59-4a84-875a-ad1d8455002e service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:23.711416 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09245d57-e065-4e26-b8f8-28212d2e69db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:23.712298 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09245d57-e065-4e26-b8f8-28212d2e69db admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:23.712730 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09245d57-e065-4e26-b8f8-28212d2e69db admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:23.713047 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09245d57-e065-4e26-b8f8-28212d2e69db admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:23.713763 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09245d57-e065-4e26-b8f8-28212d2e69db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:23.715964 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09245d57-e065-4e26-b8f8-28212d2e69db admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:23.852500 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 939/1859] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:23 2022] POST /identity/v3/users => generated 294 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:23.856808 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1baf4-32e0-4df4-9ff8-dfff4dc5a67a admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:23.867903 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1baf4-32e0-4df4-9ff8-dfff4dc5a67a admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:23.872521 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b76b8-c4b1-42a5-959c-8ad45b1b3742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:23.873177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b76b8-c4b1-42a5-959c-8ad45b1b3742 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:23.873461 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b76b8-c4b1-42a5-959c-8ad45b1b3742 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:23.873731 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b76b8-c4b1-42a5-959c-8ad45b1b3742 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:23.874453 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b76b8-c4b1-42a5-959c-8ad45b1b3742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:23.876077 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b76b8-c4b1-42a5-959c-8ad45b1b3742 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:23.886195 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 921/1860] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:02:23.890194 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09245d57-e065-4e26-b8f8-28212d2e69db admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:23.901083 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09245d57-e065-4e26-b8f8-28212d2e69db admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:23.913805 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d18f68-b7d9-4c62-8b21-26704f45cb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:23.914667 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d18f68-b7d9-4c62-8b21-26704f45cb93 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:23.914974 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d18f68-b7d9-4c62-8b21-26704f45cb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:23.915246 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d18f68-b7d9-4c62-8b21-26704f45cb93 admin admin] PATH_INFO: `/v3/projects/64a1909c146b4a2ca9e2a27c87ca5999/users/af5f5eff81a04d1185dec86a1ea41610/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:23.931271 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d18f68-b7d9-4c62-8b21-26704f45cb93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a1909c146b4a2ca9e2a27c87ca5999, user_id=af5f5eff81a04d1185dec86a1ea41610, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:23.934016 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d18f68-b7d9-4c62-8b21-26704f45cb93 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:24.009551 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 940/1861] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:23 2022] PUT /identity/v3/projects/64a1909c146b4a2ca9e2a27c87ca5999/users/af5f5eff81a04d1185dec86a1ea41610/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:24.013492 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b76b8-c4b1-42a5-959c-8ad45b1b3742 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:24.030515 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b76b8-c4b1-42a5-959c-8ad45b1b3742 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:24.091485 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09c208a-458c-4e29-8221-574e4ef86345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:24.092258 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c208a-458c-4e29-8221-574e4ef86345 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:24.092601 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c208a-458c-4e29-8221-574e4ef86345 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:24.092874 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09c208a-458c-4e29-8221-574e4ef86345 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:24.093597 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c208a-458c-4e29-8221-574e4ef86345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:24.095435 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09c208a-458c-4e29-8221-574e4ef86345 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:24.106226 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 922/1862] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:24.110423 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d18f68-b7d9-4c62-8b21-26704f45cb93 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:24.120959 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d18f68-b7d9-4c62-8b21-26704f45cb93 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:24.126616 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8a0f7-7f97-473d-8e4c-558c3bb781dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:24.127749 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8a0f7-7f97-473d-8e4c-558c3bb781dd admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:24.128193 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8a0f7-7f97-473d-8e4c-558c3bb781dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:24.128611 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8a0f7-7f97-473d-8e4c-558c3bb781dd admin admin] PATH_INFO: `/v3/projects/64a1909c146b4a2ca9e2a27c87ca5999/users/af5f5eff81a04d1185dec86a1ea41610/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:24.130821 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8a0f7-7f97-473d-8e4c-558c3bb781dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=64a1909c146b4a2ca9e2a27c87ca5999, user_id=af5f5eff81a04d1185dec86a1ea41610, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:24.135927 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8a0f7-7f97-473d-8e4c-558c3bb781dd admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:24.144437 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 941/1863] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:24 2022] PUT /identity/v3/projects/64a1909c146b4a2ca9e2a27c87ca5999/users/af5f5eff81a04d1185dec86a1ea41610/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:24.155262 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6d5e9-8a08-4188-a04c-081670539499 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:24.155731 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6d5e9-8a08-4188-a04c-081670539499 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:24.155924 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a6d5e9-8a08-4188-a04c-081670539499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:24.182704 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-91a6d5e9-8a08-4188-a04c-081670539499 None None] MFA Rules not processed for user `af5f5eff81a04d1185dec86a1ea41610`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:24.184011 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-91a6d5e9-8a08-4188-a04c-081670539499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:24.250414 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 923/1864] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:24 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:24.295429 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8a0f7-7f97-473d-8e4c-558c3bb781dd admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:24.297195 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-fac8a0f7-7f97-473d-8e4c-558c3bb781dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:24.355059 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8a0f7-7f97-473d-8e4c-558c3bb781dd admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:24.359190 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ef524-7220-4497-a21b-87ea7983366e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:24.359838 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ef524-7220-4497-a21b-87ea7983366e service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:24.360118 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ef524-7220-4497-a21b-87ea7983366e service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:24.360388 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ef524-7220-4497-a21b-87ea7983366e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:24.440539 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ef524-7220-4497-a21b-87ea7983366e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:24.441967 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ef524-7220-4497-a21b-87ea7983366e service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:24.452752 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 942/1865] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:02:27.650472 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6d5e9-8a08-4188-a04c-081670539499 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:27.651919 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-91a6d5e9-8a08-4188-a04c-081670539499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:27.721282 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a6d5e9-8a08-4188-a04c-081670539499 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:27.728495 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d39b59-e5fa-490b-9f18-463cb4283ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:27.729930 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d39b59-e5fa-490b-9f18-463cb4283ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:27.729930 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d39b59-e5fa-490b-9f18-463cb4283ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:27.730124 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d39b59-e5fa-490b-9f18-463cb4283ea4 admin admin] PATH_INFO: `/v3/users/efd82494963b449a8fd6ccdfc93e88a1` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:27.731895 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d39b59-e5fa-490b-9f18-463cb4283ea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efd82494963b449a8fd6ccdfc93e88a1)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:27.733630 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d39b59-e5fa-490b-9f18-463cb4283ea4 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:27.890114 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-10d39b59-e5fa-490b-9f18-463cb4283ea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efd82494963b449a8fd6ccdfc93e88a1'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:27.999776 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-10d39b59-e5fa-490b-9f18-463cb4283ea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efd82494963b449a8fd6ccdfc93e88a1'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:28.000376 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-10d39b59-e5fa-490b-9f18-463cb4283ea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efd82494963b449a8fd6ccdfc93e88a1'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:28.008737 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-10d39b59-e5fa-490b-9f18-463cb4283ea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efd82494963b449a8fd6ccdfc93e88a1'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:28.020439 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-10d39b59-e5fa-490b-9f18-463cb4283ea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efd82494963b449a8fd6ccdfc93e88a1'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:28.026559 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 924/1866] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:27 2022] DELETE /identity/v3/users/efd82494963b449a8fd6ccdfc93e88a1 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:28.031092 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d3b26-86f9-488b-b90f-706ad1d4b57e None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:28.031577 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d3b26-86f9-488b-b90f-706ad1d4b57e None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:28.031670 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d3b26-86f9-488b-b90f-706ad1d4b57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:28.049525 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-4c2d3b26-86f9-488b-b90f-706ad1d4b57e None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:28.050715 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-4c2d3b26-86f9-488b-b90f-706ad1d4b57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:28.112927 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 943/1867] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:28.122739 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d39b59-e5fa-490b-9f18-463cb4283ea4 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:28.124417 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-10d39b59-e5fa-490b-9f18-463cb4283ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:28.181032 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d39b59-e5fa-490b-9f18-463cb4283ea4 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:28.184600 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0493f78-b2b5-4b93-b42a-4d2384716212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:28.185232 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0493f78-b2b5-4b93-b42a-4d2384716212 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:28.185509 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0493f78-b2b5-4b93-b42a-4d2384716212 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:28.185783 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0493f78-b2b5-4b93-b42a-4d2384716212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:28.195047 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0493f78-b2b5-4b93-b42a-4d2384716212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:28.196448 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0493f78-b2b5-4b93-b42a-4d2384716212 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:28.205814 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 925/1868] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:02:28.619280 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d3b26-86f9-488b-b90f-706ad1d4b57e None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:28.620821 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-4c2d3b26-86f9-488b-b90f-706ad1d4b57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:28.651340 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d3b26-86f9-488b-b90f-706ad1d4b57e None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:28.656244 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7a18f-b3d1-4b6a-8b59-7c0284080c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:28.656987 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7a18f-b3d1-4b6a-8b59-7c0284080c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:28.657267 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7a18f-b3d1-4b6a-8b59-7c0284080c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:28.657696 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec7a18f-b3d1-4b6a-8b59-7c0284080c2b admin admin] PATH_INFO: `/v3/projects/d8a58ce3e75a4835bc5fa9542f884e37` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:28.659054 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7a18f-b3d1-4b6a-8b59-7c0284080c2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8a58ce3e75a4835bc5fa9542f884e37)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:28.660968 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec7a18f-b3d1-4b6a-8b59-7c0284080c2b admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:28.700615 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0493f78-b2b5-4b93-b42a-4d2384716212 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:28.702086 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-f0493f78-b2b5-4b93-b42a-4d2384716212 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:28.715991 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0493f78-b2b5-4b93-b42a-4d2384716212 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:28.720665 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97251aab-d125-45e2-9e1e-fb1a2f02c95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:28.721527 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97251aab-d125-45e2-9e1e-fb1a2f02c95a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:28.721805 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97251aab-d125-45e2-9e1e-fb1a2f02c95a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:28.722076 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97251aab-d125-45e2-9e1e-fb1a2f02c95a admin admin] PATH_INFO: `/v3/users/a14e130d67bb40ecb0dff2049251d75f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:28.723284 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97251aab-d125-45e2-9e1e-fb1a2f02c95a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a14e130d67bb40ecb0dff2049251d75f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:28.725238 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97251aab-d125-45e2-9e1e-fb1a2f02c95a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:28.811590 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-1ec7a18f-b3d1-4b6a-8b59-7c0284080c2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8a58ce3e75a4835bc5fa9542f884e37', 'request_id': 'req-1ec7a18f-b3d1-4b6a-8b59-7c0284080c2b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:28.817120 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-1ec7a18f-b3d1-4b6a-8b59-7c0284080c2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8a58ce3e75a4835bc5fa9542f884e37', 'request_id': 'req-1ec7a18f-b3d1-4b6a-8b59-7c0284080c2b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:28.874122 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-1ec7a18f-b3d1-4b6a-8b59-7c0284080c2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8a58ce3e75a4835bc5fa9542f884e37', 'request_id': 'req-1ec7a18f-b3d1-4b6a-8b59-7c0284080c2b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:28.885631 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-1ec7a18f-b3d1-4b6a-8b59-7c0284080c2b admin admin] The token cache is being invalidate because project d8a58ce3e75a4835bc5fa9542f884e37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:28.885918 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-1ec7a18f-b3d1-4b6a-8b59-7c0284080c2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:28.886534 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-1ec7a18f-b3d1-4b6a-8b59-7c0284080c2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:28.888085 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 944/1869] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:28 2022] DELETE /identity/v3/projects/d8a58ce3e75a4835bc5fa9542f884e37 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:28.891821 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7a18f-b3d1-4b6a-8b59-7c0284080c2b admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:28.893169 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1ec7a18f-b3d1-4b6a-8b59-7c0284080c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:28.927423 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-97251aab-d125-45e2-9e1e-fb1a2f02c95a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a14e130d67bb40ecb0dff2049251d75f'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:28.956252 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec7a18f-b3d1-4b6a-8b59-7c0284080c2b admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:28.960976 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf10563-afbe-4263-85f5-5d173dee6bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:28.961841 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf10563-afbe-4263-85f5-5d173dee6bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:28.962123 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf10563-afbe-4263-85f5-5d173dee6bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:28.962394 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf10563-afbe-4263-85f5-5d173dee6bd0 admin admin] PATH_INFO: `/v3/users/29be8bad84394b02b286246c5b8ee9d1` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:28.963694 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf10563-afbe-4263-85f5-5d173dee6bd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29be8bad84394b02b286246c5b8ee9d1)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:28.965558 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf10563-afbe-4263-85f5-5d173dee6bd0 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:28.993759 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-97251aab-d125-45e2-9e1e-fb1a2f02c95a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a14e130d67bb40ecb0dff2049251d75f'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:28.994383 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-97251aab-d125-45e2-9e1e-fb1a2f02c95a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a14e130d67bb40ecb0dff2049251d75f'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:29.001351 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-97251aab-d125-45e2-9e1e-fb1a2f02c95a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a14e130d67bb40ecb0dff2049251d75f'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:29.013084 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-97251aab-d125-45e2-9e1e-fb1a2f02c95a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a14e130d67bb40ecb0dff2049251d75f'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:29.019212 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 926/1870] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:28 2022] DELETE /identity/v3/users/a14e130d67bb40ecb0dff2049251d75f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:29.025626 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03cbdd8-7cc2-4ca9-96b7-7d8d9d6745e6 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:29.026106 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03cbdd8-7cc2-4ca9-96b7-7d8d9d6745e6 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:29.026538 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03cbdd8-7cc2-4ca9-96b7-7d8d9d6745e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:29.051359 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-b03cbdd8-7cc2-4ca9-96b7-7d8d9d6745e6 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:29.052572 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-b03cbdd8-7cc2-4ca9-96b7-7d8d9d6745e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:29.124080 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 927/1871] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:29.133914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03cbdd8-7cc2-4ca9-96b7-7d8d9d6745e6 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:29.135153 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-9cf10563-afbe-4263-85f5-5d173dee6bd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29be8bad84394b02b286246c5b8ee9d1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:29.135574 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-b03cbdd8-7cc2-4ca9-96b7-7d8d9d6745e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:29.143353 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-9cf10563-afbe-4263-85f5-5d173dee6bd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29be8bad84394b02b286246c5b8ee9d1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:29.195124 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03cbdd8-7cc2-4ca9-96b7-7d8d9d6745e6 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:29.199031 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbf1b2-6cbf-4139-aef3-561604d1ff8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:29.199855 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbf1b2-6cbf-4139-aef3-561604d1ff8f service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:29.200144 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbf1b2-6cbf-4139-aef3-561604d1ff8f service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:29.200423 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dbf1b2-6cbf-4139-aef3-561604d1ff8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:29.210072 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbf1b2-6cbf-4139-aef3-561604d1ff8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:29.212051 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dbf1b2-6cbf-4139-aef3-561604d1ff8f service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:29.216776 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-9cf10563-afbe-4263-85f5-5d173dee6bd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29be8bad84394b02b286246c5b8ee9d1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:29.217554 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-9cf10563-afbe-4263-85f5-5d173dee6bd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29be8bad84394b02b286246c5b8ee9d1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:29.221963 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 928/1872] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:02:29.240646 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-9cf10563-afbe-4263-85f5-5d173dee6bd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29be8bad84394b02b286246c5b8ee9d1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:29.247915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 945/1873] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:28 2022] DELETE /identity/v3/users/29be8bad84394b02b286246c5b8ee9d1 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:29.670069 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbf1b2-6cbf-4139-aef3-561604d1ff8f service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:29.671824 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-36dbf1b2-6cbf-4139-aef3-561604d1ff8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:29.696456 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf10563-afbe-4263-85f5-5d173dee6bd0 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:29.700239 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-9cf10563-afbe-4263-85f5-5d173dee6bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:29.700456 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dbf1b2-6cbf-4139-aef3-561604d1ff8f service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:29.764664 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577df1ec-343d-43ac-8bb3-1a1084eebba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:29.765524 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577df1ec-343d-43ac-8bb3-1a1084eebba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:29.765802 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577df1ec-343d-43ac-8bb3-1a1084eebba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:29.766073 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577df1ec-343d-43ac-8bb3-1a1084eebba5 admin admin] PATH_INFO: `/v3/projects/d8f5cefa2dee450f8ffbdbede785d1ab` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:29.767290 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577df1ec-343d-43ac-8bb3-1a1084eebba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8f5cefa2dee450f8ffbdbede785d1ab)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:29.769187 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577df1ec-343d-43ac-8bb3-1a1084eebba5 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:29.782360 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf10563-afbe-4263-85f5-5d173dee6bd0 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:29.787115 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b1d22-61cc-4577-8a40-3af98a064723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:29.787973 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b1d22-61cc-4577-8a40-3af98a064723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:29.792289 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b1d22-61cc-4577-8a40-3af98a064723 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:29.792289 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b1d22-61cc-4577-8a40-3af98a064723 admin admin] PATH_INFO: `/v3/projects/0d4cd1f853f141528061c038a6ef4243` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:29.792289 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b1d22-61cc-4577-8a40-3af98a064723 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d4cd1f853f141528061c038a6ef4243)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:29.792289 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b1d22-61cc-4577-8a40-3af98a064723 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:29.907969 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-577df1ec-343d-43ac-8bb3-1a1084eebba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8f5cefa2dee450f8ffbdbede785d1ab', 'request_id': 'req-577df1ec-343d-43ac-8bb3-1a1084eebba5'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:29.953850 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a01b1d22-61cc-4577-8a40-3af98a064723 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d4cd1f853f141528061c038a6ef4243', 'request_id': 'req-a01b1d22-61cc-4577-8a40-3af98a064723'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:29.959057 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a01b1d22-61cc-4577-8a40-3af98a064723 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d4cd1f853f141528061c038a6ef4243', 'request_id': 'req-a01b1d22-61cc-4577-8a40-3af98a064723'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:29.982506 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-577df1ec-343d-43ac-8bb3-1a1084eebba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8f5cefa2dee450f8ffbdbede785d1ab', 'request_id': 'req-577df1ec-343d-43ac-8bb3-1a1084eebba5'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:29.988891 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-577df1ec-343d-43ac-8bb3-1a1084eebba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8f5cefa2dee450f8ffbdbede785d1ab', 'request_id': 'req-577df1ec-343d-43ac-8bb3-1a1084eebba5'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:30.001381 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-577df1ec-343d-43ac-8bb3-1a1084eebba5 admin admin] The token cache is being invalidate because project d8f5cefa2dee450f8ffbdbede785d1ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:30.001663 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-577df1ec-343d-43ac-8bb3-1a1084eebba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:30.002319 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-577df1ec-343d-43ac-8bb3-1a1084eebba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:30.003989 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 929/1874] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:29 2022] DELETE /identity/v3/projects/d8f5cefa2dee450f8ffbdbede785d1ab => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:30.008580 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577df1ec-343d-43ac-8bb3-1a1084eebba5 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:30.009827 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-577df1ec-343d-43ac-8bb3-1a1084eebba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:30.033609 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a01b1d22-61cc-4577-8a40-3af98a064723 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d4cd1f853f141528061c038a6ef4243', 'request_id': 'req-a01b1d22-61cc-4577-8a40-3af98a064723'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:30.045711 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a01b1d22-61cc-4577-8a40-3af98a064723 admin admin] The token cache is being invalidate because project 0d4cd1f853f141528061c038a6ef4243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:30.045995 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a01b1d22-61cc-4577-8a40-3af98a064723 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:30.046853 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a01b1d22-61cc-4577-8a40-3af98a064723 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:30.048402 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 946/1875] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:29 2022] DELETE /identity/v3/projects/0d4cd1f853f141528061c038a6ef4243 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:30.053265 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34550e37-7e60-4f15-b4cd-80c27a38dd35 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:30.053581 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34550e37-7e60-4f15-b4cd-80c27a38dd35 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:30.053855 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34550e37-7e60-4f15-b4cd-80c27a38dd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:30.072378 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-34550e37-7e60-4f15-b4cd-80c27a38dd35 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:30.072883 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577df1ec-343d-43ac-8bb3-1a1084eebba5 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:30.073560 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-34550e37-7e60-4f15-b4cd-80c27a38dd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:30.125926 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62c04c-0cea-43e3-a87a-0c07e249f9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:30.126790 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62c04c-0cea-43e3-a87a-0c07e249f9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:30.127102 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62c04c-0cea-43e3-a87a-0c07e249f9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:30.127374 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db62c04c-0cea-43e3-a87a-0c07e249f9bf admin admin] PATH_INFO: `/v3/users/3b61b58a42dc4906a807dea488ed52ad` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:30.128553 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62c04c-0cea-43e3-a87a-0c07e249f9bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b61b58a42dc4906a807dea488ed52ad)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:30.129425 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 947/1876] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:30.130444 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db62c04c-0cea-43e3-a87a-0c07e249f9bf admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:30.137990 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa908c1-9f24-4e5f-a6ce-2de4d28a8de6 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:30.138439 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa908c1-9f24-4e5f-a6ce-2de4d28a8de6 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:30.138541 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa908c1-9f24-4e5f-a6ce-2de4d28a8de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:30.159369 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-bfa908c1-9f24-4e5f-a6ce-2de4d28a8de6 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:30.159369 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-bfa908c1-9f24-4e5f-a6ce-2de4d28a8de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:30.169860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 948/1877] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:30.173932 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa908c1-9f24-4e5f-a6ce-2de4d28a8de6 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:30.183642 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa908c1-9f24-4e5f-a6ce-2de4d28a8de6 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:30.188335 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c88a7a-92a9-46b5-8964-c79c02a7c300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:30.188978 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c88a7a-92a9-46b5-8964-c79c02a7c300 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:30.189278 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c88a7a-92a9-46b5-8964-c79c02a7c300 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:30.189554 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c88a7a-92a9-46b5-8964-c79c02a7c300 admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:30.190267 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c88a7a-92a9-46b5-8964-c79c02a7c300 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:02:30.190566 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c88a7a-92a9-46b5-8964-c79c02a7c300 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:30.192184 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c88a7a-92a9-46b5-8964-c79c02a7c300 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:30.204315 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 949/1878] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:02:30.208469 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c88a7a-92a9-46b5-8964-c79c02a7c300 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:30.217810 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c88a7a-92a9-46b5-8964-c79c02a7c300 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:30.222926 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761944a2-ffd2-4d22-9469-b2383edb9477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:30.223130 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761944a2-ffd2-4d22-9469-b2383edb9477 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:30.223370 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761944a2-ffd2-4d22-9469-b2383edb9477 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:30.223639 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761944a2-ffd2-4d22-9469-b2383edb9477 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:30.224815 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761944a2-ffd2-4d22-9469-b2383edb9477 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:30.226702 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761944a2-ffd2-4d22-9469-b2383edb9477 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:30.338509 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-db62c04c-0cea-43e3-a87a-0c07e249f9bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b61b58a42dc4906a807dea488ed52ad'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:30.368492 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 950/1879] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:30 2022] POST /identity/v3/projects => generated 371 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:30.373588 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761944a2-ffd2-4d22-9469-b2383edb9477 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:30.405605 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-db62c04c-0cea-43e3-a87a-0c07e249f9bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b61b58a42dc4906a807dea488ed52ad'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:30.406615 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-db62c04c-0cea-43e3-a87a-0c07e249f9bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b61b58a42dc4906a807dea488ed52ad'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:30.418037 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-db62c04c-0cea-43e3-a87a-0c07e249f9bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b61b58a42dc4906a807dea488ed52ad'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:30.433501 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-db62c04c-0cea-43e3-a87a-0c07e249f9bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b61b58a42dc4906a807dea488ed52ad'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:30.439643 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 930/1880] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:30 2022] DELETE /identity/v3/users/3b61b58a42dc4906a807dea488ed52ad => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:30.444101 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761944a2-ffd2-4d22-9469-b2383edb9477 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:30.519250 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49532342-85a8-45bc-9094-d4d36464d31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:30.520155 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49532342-85a8-45bc-9094-d4d36464d31e admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:30.520579 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49532342-85a8-45bc-9094-d4d36464d31e admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:30.520945 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49532342-85a8-45bc-9094-d4d36464d31e admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:30.521756 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49532342-85a8-45bc-9094-d4d36464d31e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:30.524068 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49532342-85a8-45bc-9094-d4d36464d31e admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:30.618215 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 951/1881] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:30 2022] POST /identity/v3/users => generated 286 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:30.622570 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62c04c-0cea-43e3-a87a-0c07e249f9bf admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:30.624062 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-db62c04c-0cea-43e3-a87a-0c07e249f9bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:30.642654 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db62c04c-0cea-43e3-a87a-0c07e249f9bf admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:30.649313 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18603c7d-6dd1-45e6-b8cb-3e0119ad7564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:30.650006 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18603c7d-6dd1-45e6-b8cb-3e0119ad7564 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:30.650283 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18603c7d-6dd1-45e6-b8cb-3e0119ad7564 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:30.650556 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18603c7d-6dd1-45e6-b8cb-3e0119ad7564 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:30.651665 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18603c7d-6dd1-45e6-b8cb-3e0119ad7564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:30.653267 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18603c7d-6dd1-45e6-b8cb-3e0119ad7564 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:30.668566 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 931/1882] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:30.669783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49532342-85a8-45bc-9094-d4d36464d31e admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:30.681828 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49532342-85a8-45bc-9094-d4d36464d31e admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:30.688221 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad194d9-22d3-41bc-b99b-6cc78063b293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:30.689150 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad194d9-22d3-41bc-b99b-6cc78063b293 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:30.689794 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad194d9-22d3-41bc-b99b-6cc78063b293 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:30.690673 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad194d9-22d3-41bc-b99b-6cc78063b293 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:30.691178 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad194d9-22d3-41bc-b99b-6cc78063b293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:30.692904 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad194d9-22d3-41bc-b99b-6cc78063b293 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:30.713809 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 952/1883] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:30.718215 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18603c7d-6dd1-45e6-b8cb-3e0119ad7564 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:30.729477 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18603c7d-6dd1-45e6-b8cb-3e0119ad7564 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:30.736666 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818dd03-15ff-4031-927a-726551fc5db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:30.749475 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818dd03-15ff-4031-927a-726551fc5db9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:30.750003 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818dd03-15ff-4031-927a-726551fc5db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:30.750463 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818dd03-15ff-4031-927a-726551fc5db9 admin admin] PATH_INFO: `/v3/projects/479c3968044743398ae8418e2b0d5483/users/8c69ae8ba4a344fa8158584fce641c8a/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:30.776685 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818dd03-15ff-4031-927a-726551fc5db9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=479c3968044743398ae8418e2b0d5483, user_id=8c69ae8ba4a344fa8158584fce641c8a, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:30.780541 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818dd03-15ff-4031-927a-726551fc5db9 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:30.877332 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 932/1884] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:30 2022] PUT /identity/v3/projects/479c3968044743398ae8418e2b0d5483/users/8c69ae8ba4a344fa8158584fce641c8a/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:30.883155 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5d8cf-7f35-45e9-8510-12a8b72f04bb None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:30.883444 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5d8cf-7f35-45e9-8510-12a8b72f04bb None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:30.883796 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5d8cf-7f35-45e9-8510-12a8b72f04bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:30.902986 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-acb5d8cf-7f35-45e9-8510-12a8b72f04bb None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:30.904230 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-acb5d8cf-7f35-45e9-8510-12a8b72f04bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:30.929340 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818dd03-15ff-4031-927a-726551fc5db9 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:30.930580 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-3818dd03-15ff-4031-927a-726551fc5db9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:30.997101 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 953/1885] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:31.007401 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5d8cf-7f35-45e9-8510-12a8b72f04bb None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:31.009350 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-acb5d8cf-7f35-45e9-8510-12a8b72f04bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:31.032471 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818dd03-15ff-4031-927a-726551fc5db9 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:31.037281 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f815b-cc7b-4b6c-97e4-a310e8b0a608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:31.038134 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f815b-cc7b-4b6c-97e4-a310e8b0a608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:31.038597 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f815b-cc7b-4b6c-97e4-a310e8b0a608 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:31.039024 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f815b-cc7b-4b6c-97e4-a310e8b0a608 admin admin] PATH_INFO: `/v3/projects/21fa57c9746144cebd3f68a17e217da6` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:31.040338 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f815b-cc7b-4b6c-97e4-a310e8b0a608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21fa57c9746144cebd3f68a17e217da6)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:31.044352 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f815b-cc7b-4b6c-97e4-a310e8b0a608 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:31.065811 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5d8cf-7f35-45e9-8510-12a8b72f04bb None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:31.069577 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faebfb6-261d-43c6-a0bc-8c99149ff951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:31.070773 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faebfb6-261d-43c6-a0bc-8c99149ff951 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:31.071083 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faebfb6-261d-43c6-a0bc-8c99149ff951 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:31.071356 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faebfb6-261d-43c6-a0bc-8c99149ff951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:31.080531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faebfb6-261d-43c6-a0bc-8c99149ff951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:31.081959 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faebfb6-261d-43c6-a0bc-8c99149ff951 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:31.092103 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 954/1886] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:02:31.137867 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-2b5f815b-cc7b-4b6c-97e4-a310e8b0a608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21fa57c9746144cebd3f68a17e217da6', 'request_id': 'req-2b5f815b-cc7b-4b6c-97e4-a310e8b0a608'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:31.182615 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-2b5f815b-cc7b-4b6c-97e4-a310e8b0a608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21fa57c9746144cebd3f68a17e217da6', 'request_id': 'req-2b5f815b-cc7b-4b6c-97e4-a310e8b0a608'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:31.188406 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-2b5f815b-cc7b-4b6c-97e4-a310e8b0a608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21fa57c9746144cebd3f68a17e217da6', 'request_id': 'req-2b5f815b-cc7b-4b6c-97e4-a310e8b0a608'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:31.200795 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-2b5f815b-cc7b-4b6c-97e4-a310e8b0a608 admin admin] The token cache is being invalidate because project 21fa57c9746144cebd3f68a17e217da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:31.201161 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-2b5f815b-cc7b-4b6c-97e4-a310e8b0a608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:31.201926 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-2b5f815b-cc7b-4b6c-97e4-a310e8b0a608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:31.203590 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 933/1887] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:30 2022] DELETE /identity/v3/projects/21fa57c9746144cebd3f68a17e217da6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:31.207601 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faebfb6-261d-43c6-a0bc-8c99149ff951 service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:31.218516 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faebfb6-261d-43c6-a0bc-8c99149ff951 service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:31.274707 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8da3e-15de-4624-95b4-60896d069db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:31.275622 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8da3e-15de-4624-95b4-60896d069db1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:31.275901 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8da3e-15de-4624-95b4-60896d069db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:31.276171 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8da3e-15de-4624-95b4-60896d069db1 admin admin] PATH_INFO: `/v3/users/63edce05cdb74d2893c736f54fd78310` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:31.277355 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8da3e-15de-4624-95b4-60896d069db1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63edce05cdb74d2893c736f54fd78310)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:31.279362 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8da3e-15de-4624-95b4-60896d069db1 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:31.417329 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f815b-cc7b-4b6c-97e4-a310e8b0a608 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:31.420063 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-2b5f815b-cc7b-4b6c-97e4-a310e8b0a608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:31.487859 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f815b-cc7b-4b6c-97e4-a310e8b0a608 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:31.492875 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081782fd-c958-4996-8b84-413a78542aaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:31.493560 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081782fd-c958-4996-8b84-413a78542aaa service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:31.493914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081782fd-c958-4996-8b84-413a78542aaa service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:31.494301 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081782fd-c958-4996-8b84-413a78542aaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:31.496374 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-081782fd-c958-4996-8b84-413a78542aaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:31.512594 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c0f8da3e-15de-4624-95b4-60896d069db1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63edce05cdb74d2893c736f54fd78310'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:31.527599 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c0f8da3e-15de-4624-95b4-60896d069db1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63edce05cdb74d2893c736f54fd78310'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:31.589980 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081782fd-c958-4996-8b84-413a78542aaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:31.591730 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081782fd-c958-4996-8b84-413a78542aaa service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:31.602858 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 934/1888] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:02:31.606243 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c0f8da3e-15de-4624-95b4-60896d069db1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63edce05cdb74d2893c736f54fd78310'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:31.606857 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c0f8da3e-15de-4624-95b4-60896d069db1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63edce05cdb74d2893c736f54fd78310'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:31.622796 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c0f8da3e-15de-4624-95b4-60896d069db1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63edce05cdb74d2893c736f54fd78310'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:31.629094 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 955/1889] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:31 2022] DELETE /identity/v3/users/63edce05cdb74d2893c736f54fd78310 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:32.155604 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081782fd-c958-4996-8b84-413a78542aaa service cinder] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:32.157581 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-081782fd-c958-4996-8b84-413a78542aaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:32.173855 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081782fd-c958-4996-8b84-413a78542aaa service cinder] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:32.229972 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e06606-b95e-4578-b16c-30aeb79e73fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:32.231129 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e06606-b95e-4578-b16c-30aeb79e73fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:32.231409 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e06606-b95e-4578-b16c-30aeb79e73fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:32.231682 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e06606-b95e-4578-b16c-30aeb79e73fe admin admin] PATH_INFO: `/v3/projects/94bf645737b24d9bad508ab760e7ccf4` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:32.232862 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e06606-b95e-4578-b16c-30aeb79e73fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=94bf645737b24d9bad508ab760e7ccf4)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:32.234753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e06606-b95e-4578-b16c-30aeb79e73fe admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:32.365043 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-02e06606-b95e-4578-b16c-30aeb79e73fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94bf645737b24d9bad508ab760e7ccf4', 'request_id': 'req-02e06606-b95e-4578-b16c-30aeb79e73fe'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:32.424256 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3902450-efb2-4c1c-8ae2-8faed5b1b988 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:32.424697 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3902450-efb2-4c1c-8ae2-8faed5b1b988 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:32.424792 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3902450-efb2-4c1c-8ae2-8faed5b1b988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:32.458190 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-c3902450-efb2-4c1c-8ae2-8faed5b1b988 None None] MFA Rules not processed for user `8c69ae8ba4a344fa8158584fce641c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:32.459443 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-c3902450-efb2-4c1c-8ae2-8faed5b1b988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:32.468548 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-02e06606-b95e-4578-b16c-30aeb79e73fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94bf645737b24d9bad508ab760e7ccf4', 'request_id': 'req-02e06606-b95e-4578-b16c-30aeb79e73fe'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:32.476166 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-02e06606-b95e-4578-b16c-30aeb79e73fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94bf645737b24d9bad508ab760e7ccf4', 'request_id': 'req-02e06606-b95e-4578-b16c-30aeb79e73fe'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:32.490817 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-02e06606-b95e-4578-b16c-30aeb79e73fe admin admin] The token cache is being invalidate because project 94bf645737b24d9bad508ab760e7ccf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:32.491614 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-02e06606-b95e-4578-b16c-30aeb79e73fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:32.492479 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-02e06606-b95e-4578-b16c-30aeb79e73fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:32.508859 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 935/1890] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:32 2022] DELETE /identity/v3/projects/94bf645737b24d9bad508ab760e7ccf4 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:32.508859 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4755e-75a9-4a51-8895-650ced51f89f None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:32.508859 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4755e-75a9-4a51-8895-650ced51f89f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:32.508859 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4755e-75a9-4a51-8895-650ced51f89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:32.522698 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-27b4755e-75a9-4a51-8895-650ced51f89f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:32.524586 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-27b4755e-75a9-4a51-8895-650ced51f89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:32.545897 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 956/1891] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:32.557644 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3902450-efb2-4c1c-8ae2-8faed5b1b988 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:32.559123 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-c3902450-efb2-4c1c-8ae2-8faed5b1b988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:32.589383 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 936/1892] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:32.598392 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f414d-63d1-4f82-8f50-88735fff104d None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:32.598912 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f414d-63d1-4f82-8f50-88735fff104d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:32.599192 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f414d-63d1-4f82-8f50-88735fff104d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:32.618341 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3902450-efb2-4c1c-8ae2-8faed5b1b988 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:32.620143 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-a79f414d-63d1-4f82-8f50-88735fff104d None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:32.621388 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-a79f414d-63d1-4f82-8f50-88735fff104d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:32.622330 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b12ed-1c23-4fbf-808c-aaf1a912861b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:32.623081 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b12ed-1c23-4fbf-808c-aaf1a912861b service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:32.623425 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b12ed-1c23-4fbf-808c-aaf1a912861b service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:32.623765 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b12ed-1c23-4fbf-808c-aaf1a912861b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:32.633746 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 937/1893] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:32.634043 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b12ed-1c23-4fbf-808c-aaf1a912861b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:32.634884 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f414d-63d1-4f82-8f50-88735fff104d None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:32.635644 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b12ed-1c23-4fbf-808c-aaf1a912861b service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:32.644829 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f414d-63d1-4f82-8f50-88735fff104d None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:32.647733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 957/1894] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:02:32.650038 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fccc3-a313-443e-9067-de4974bd6ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:32.650828 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fccc3-a313-443e-9067-de4974bd6ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:32.651212 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fccc3-a313-443e-9067-de4974bd6ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:32.651615 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984fccc3-a313-443e-9067-de4974bd6ca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:32.652562 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fccc3-a313-443e-9067-de4974bd6ca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:02:32.653063 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fccc3-a313-443e-9067-de4974bd6ca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:32.655356 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984fccc3-a313-443e-9067-de4974bd6ca0 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:32.668703 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 938/1895] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:02:32.673606 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b12ed-1c23-4fbf-808c-aaf1a912861b service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:32.689176 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b12ed-1c23-4fbf-808c-aaf1a912861b service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:32.695962 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c8ec9-fc0f-4c61-8862-753ad1244946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:32.695962 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c8ec9-fc0f-4c61-8862-753ad1244946 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:32.696433 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c8ec9-fc0f-4c61-8862-753ad1244946 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:32.696805 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c8ec9-fc0f-4c61-8862-753ad1244946 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:32.697690 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c8ec9-fc0f-4c61-8862-753ad1244946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:32.699713 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c8ec9-fc0f-4c61-8862-753ad1244946 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:32.818168 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 958/1896] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:32 2022] POST /identity/v3/projects => generated 391 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:32.823118 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fccc3-a313-443e-9067-de4974bd6ca0 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:32.833236 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984fccc3-a313-443e-9067-de4974bd6ca0 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:32.888423 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a7b2d-dbcc-4c25-a7af-57981e802c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:32.889081 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a7b2d-dbcc-4c25-a7af-57981e802c59 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:32.889358 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a7b2d-dbcc-4c25-a7af-57981e802c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:32.889627 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a7b2d-dbcc-4c25-a7af-57981e802c59 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:32.890300 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a7b2d-dbcc-4c25-a7af-57981e802c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:32.892208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a7b2d-dbcc-4c25-a7af-57981e802c59 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:33.004638 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 939/1897] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:32 2022] POST /identity/v3/users => generated 296 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:33.009023 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c8ec9-fc0f-4c61-8862-753ad1244946 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:33.023371 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c8ec9-fc0f-4c61-8862-753ad1244946 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:33.029881 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee317d-a66a-4ce1-bfce-06191f55cdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:33.030857 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee317d-a66a-4ce1-bfce-06191f55cdb6 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:33.031296 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee317d-a66a-4ce1-bfce-06191f55cdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:33.031702 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee317d-a66a-4ce1-bfce-06191f55cdb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:33.034327 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee317d-a66a-4ce1-bfce-06191f55cdb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:33.035333 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee317d-a66a-4ce1-bfce-06191f55cdb6 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:33.049441 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 959/1898] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:33.054128 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a7b2d-dbcc-4c25-a7af-57981e802c59 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:33.064791 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a7b2d-dbcc-4c25-a7af-57981e802c59 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:33.069521 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb062d3-e392-4e0e-892c-6d19595404c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:33.070782 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb062d3-e392-4e0e-892c-6d19595404c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:33.077186 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb062d3-e392-4e0e-892c-6d19595404c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:33.077186 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb062d3-e392-4e0e-892c-6d19595404c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:33.077186 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb062d3-e392-4e0e-892c-6d19595404c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:33.077186 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb062d3-e392-4e0e-892c-6d19595404c6 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:33.083658 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 940/1899] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:33.087954 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee317d-a66a-4ce1-bfce-06191f55cdb6 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:33.097909 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee317d-a66a-4ce1-bfce-06191f55cdb6 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:33.102663 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7aab8-d97c-4fad-a515-74d950bb4660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:33.103620 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7aab8-d97c-4fad-a515-74d950bb4660 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:33.103896 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7aab8-d97c-4fad-a515-74d950bb4660 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:33.104169 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe7aab8-d97c-4fad-a515-74d950bb4660 admin admin] PATH_INFO: `/v3/projects/76f67cfe802e485796de22cfab8c8d91/users/d75a828348d14ae9b7e9bfa17b2dd329/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:33.119200 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7aab8-d97c-4fad-a515-74d950bb4660 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f67cfe802e485796de22cfab8c8d91, user_id=d75a828348d14ae9b7e9bfa17b2dd329, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:33.121897 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe7aab8-d97c-4fad-a515-74d950bb4660 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:33.170526 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 960/1900] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:33 2022] PUT /identity/v3/projects/76f67cfe802e485796de22cfab8c8d91/users/d75a828348d14ae9b7e9bfa17b2dd329/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:33.182209 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c87522-cb81-44ab-b1d9-6b0ec8037d14 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:33.182716 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c87522-cb81-44ab-b1d9-6b0ec8037d14 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:33.182807 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c87522-cb81-44ab-b1d9-6b0ec8037d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:33.208861 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-39c87522-cb81-44ab-b1d9-6b0ec8037d14 None None] MFA Rules not processed for user `d75a828348d14ae9b7e9bfa17b2dd329`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:33.210137 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-39c87522-cb81-44ab-b1d9-6b0ec8037d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:33.279238 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 941/1901] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:33.280511 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7aab8-d97c-4fad-a515-74d950bb4660 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:33.342732 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe7aab8-d97c-4fad-a515-74d950bb4660 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:33.347641 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1972c79-5732-41be-baa8-f34288f58aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:33.348299 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1972c79-5732-41be-baa8-f34288f58aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:33.348579 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1972c79-5732-41be-baa8-f34288f58aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:33.348851 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1972c79-5732-41be-baa8-f34288f58aa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:33.350735 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1972c79-5732-41be-baa8-f34288f58aa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:33.352001 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1972c79-5732-41be-baa8-f34288f58aa8 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:33.468048 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 961/1902] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:33 2022] POST /identity/v3/projects => generated 391 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:33.468985 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c87522-cb81-44ab-b1d9-6b0ec8037d14 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:33.484588 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c87522-cb81-44ab-b1d9-6b0ec8037d14 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:33.540617 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795b143-3c29-47fc-9552-694c9af95a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:33.541284 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795b143-3c29-47fc-9552-694c9af95a58 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:33.541557 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795b143-3c29-47fc-9552-694c9af95a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:33.541823 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795b143-3c29-47fc-9552-694c9af95a58 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:33.542550 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795b143-3c29-47fc-9552-694c9af95a58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:33.544530 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795b143-3c29-47fc-9552-694c9af95a58 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:33.650755 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 942/1903] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:33 2022] POST /identity/v3/users => generated 302 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:33.655255 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1972c79-5732-41be-baa8-f34288f58aa8 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:33.665575 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1972c79-5732-41be-baa8-f34288f58aa8 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:33.673939 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd499a-0979-4a05-8e37-f1f827dd2288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:33.674600 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd499a-0979-4a05-8e37-f1f827dd2288 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:33.674924 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd499a-0979-4a05-8e37-f1f827dd2288 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:33.675202 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd499a-0979-4a05-8e37-f1f827dd2288 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:33.675939 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd499a-0979-4a05-8e37-f1f827dd2288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:33.677523 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd499a-0979-4a05-8e37-f1f827dd2288 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:33.688997 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 962/1904] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:33.693405 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795b143-3c29-47fc-9552-694c9af95a58 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:33.705799 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795b143-3c29-47fc-9552-694c9af95a58 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:33.713732 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc134e-0bf3-4839-baf5-04c526ce889c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:33.715294 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc134e-0bf3-4839-baf5-04c526ce889c admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:33.715572 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc134e-0bf3-4839-baf5-04c526ce889c admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:33.716042 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cc134e-0bf3-4839-baf5-04c526ce889c admin admin] PATH_INFO: `/v3/projects/c48b3c0452284d109b9c95c1a9827e3b/users/0f0919946123405ca849792f78cbaff3/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:33.731907 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc134e-0bf3-4839-baf5-04c526ce889c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48b3c0452284d109b9c95c1a9827e3b, user_id=0f0919946123405ca849792f78cbaff3, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:33.734522 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cc134e-0bf3-4839-baf5-04c526ce889c admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:33.863274 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 943/1905] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:33 2022] PUT /identity/v3/projects/c48b3c0452284d109b9c95c1a9827e3b/users/0f0919946123405ca849792f78cbaff3/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:33.867695 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd499a-0979-4a05-8e37-f1f827dd2288 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:33.877573 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd499a-0979-4a05-8e37-f1f827dd2288 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:33.933038 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd96bd3-f09e-442b-99e1-6dc3a1bdfafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:33.933623 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd96bd3-f09e-442b-99e1-6dc3a1bdfafd admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:33.933899 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd96bd3-f09e-442b-99e1-6dc3a1bdfafd admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:33.934170 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd96bd3-f09e-442b-99e1-6dc3a1bdfafd admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:33.934972 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd96bd3-f09e-442b-99e1-6dc3a1bdfafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:33.936618 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd96bd3-f09e-442b-99e1-6dc3a1bdfafd admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:33.946947 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 963/1906] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:33.951712 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc134e-0bf3-4839-baf5-04c526ce889c admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:33.961930 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cc134e-0bf3-4839-baf5-04c526ce889c admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:33.966628 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b35c4-b44b-41b4-91db-e57e5bdb3f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:33.967561 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b35c4-b44b-41b4-91db-e57e5bdb3f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:33.967843 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b35c4-b44b-41b4-91db-e57e5bdb3f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:33.968115 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2b35c4-b44b-41b4-91db-e57e5bdb3f41 admin admin] PATH_INFO: `/v3/projects/c48b3c0452284d109b9c95c1a9827e3b/users/0f0919946123405ca849792f78cbaff3/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:33.970128 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b35c4-b44b-41b4-91db-e57e5bdb3f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48b3c0452284d109b9c95c1a9827e3b, user_id=0f0919946123405ca849792f78cbaff3, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:33.972778 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2b35c4-b44b-41b4-91db-e57e5bdb3f41 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:33.983236 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 944/1907] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:33 2022] PUT /identity/v3/projects/c48b3c0452284d109b9c95c1a9827e3b/users/0f0919946123405ca849792f78cbaff3/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:33.993613 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f0b76-5a06-4db5-8523-98eb4babec64 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:33.993902 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f0b76-5a06-4db5-8523-98eb4babec64 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:33.994180 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f0b76-5a06-4db5-8523-98eb4babec64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:34.021289 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-e28f0b76-5a06-4db5-8523-98eb4babec64 None None] MFA Rules not processed for user `0f0919946123405ca849792f78cbaff3`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:34.022512 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-e28f0b76-5a06-4db5-8523-98eb4babec64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:34.093256 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 964/1908] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:34.104605 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b35c4-b44b-41b4-91db-e57e5bdb3f41 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:34.106516 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-3f2b35c4-b44b-41b4-91db-e57e5bdb3f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:34.159816 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2b35c4-b44b-41b4-91db-e57e5bdb3f41 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:34.163428 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc1226-471d-4685-ab16-ed5e151173f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:34.164567 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc1226-471d-4685-ab16-ed5e151173f5 service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:34.164844 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc1226-471d-4685-ab16-ed5e151173f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:34.165116 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc1226-471d-4685-ab16-ed5e151173f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:34.173810 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc1226-471d-4685-ab16-ed5e151173f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:34.175254 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc1226-471d-4685-ab16-ed5e151173f5 service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:34.185070 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 945/1909] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:02:34.232899 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f0b76-5a06-4db5-8523-98eb4babec64 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:34.242681 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f0b76-5a06-4db5-8523-98eb4babec64 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:34.246266 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff5665-57f3-4e96-9fc7-b1cd9faab22a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:34.246933 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff5665-57f3-4e96-9fc7-b1cd9faab22a service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:34.247219 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff5665-57f3-4e96-9fc7-b1cd9faab22a service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:34.247491 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff5665-57f3-4e96-9fc7-b1cd9faab22a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:34.300887 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff5665-57f3-4e96-9fc7-b1cd9faab22a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:34.302304 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff5665-57f3-4e96-9fc7-b1cd9faab22a service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:34.311603 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 965/1910] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:02:40.621653 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8fdec-7bd5-4f4b-83f6-7bc448161a78 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:40.621653 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8fdec-7bd5-4f4b-83f6-7bc448161a78 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:40.622196 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8fdec-7bd5-4f4b-83f6-7bc448161a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:40.640639 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-b4c8fdec-7bd5-4f4b-83f6-7bc448161a78 None None] MFA Rules not processed for user `8c69ae8ba4a344fa8158584fce641c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:40.641869 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-b4c8fdec-7bd5-4f4b-83f6-7bc448161a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:40.699517 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 946/1911] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:43.324869 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff5665-57f3-4e96-9fc7-b1cd9faab22a service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:43.326680 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d9ff5665-57f3-4e96-9fc7-b1cd9faab22a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:43.348438 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8fdec-7bd5-4f4b-83f6-7bc448161a78 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:43.398706 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff5665-57f3-4e96-9fc7-b1cd9faab22a service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:43.403537 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73604a19-3eb1-43ec-b333-6dd29096ca6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:43.404535 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73604a19-3eb1-43ec-b333-6dd29096ca6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:43.404918 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73604a19-3eb1-43ec-b333-6dd29096ca6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:43.405285 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73604a19-3eb1-43ec-b333-6dd29096ca6b admin admin] PATH_INFO: `/v3/users/4a999b1c1098441fb478ecda69a350a1` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:43.406575 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73604a19-3eb1-43ec-b333-6dd29096ca6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a999b1c1098441fb478ecda69a350a1)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:43.408596 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73604a19-3eb1-43ec-b333-6dd29096ca6b admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:43.416085 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8fdec-7bd5-4f4b-83f6-7bc448161a78 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:43.420933 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a47659-80df-4cba-9a3a-f8e1a6f45444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:43.421815 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a47659-80df-4cba-9a3a-f8e1a6f45444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:43.422098 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a47659-80df-4cba-9a3a-f8e1a6f45444 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:43.422394 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a47659-80df-4cba-9a3a-f8e1a6f45444 admin admin] PATH_INFO: `/v3/users/d75a828348d14ae9b7e9bfa17b2dd329` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:43.423619 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a47659-80df-4cba-9a3a-f8e1a6f45444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d75a828348d14ae9b7e9bfa17b2dd329)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:43.425666 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a47659-80df-4cba-9a3a-f8e1a6f45444 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:43.561821 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-73604a19-3eb1-43ec-b333-6dd29096ca6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a999b1c1098441fb478ecda69a350a1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:43.568499 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-73604a19-3eb1-43ec-b333-6dd29096ca6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a999b1c1098441fb478ecda69a350a1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:43.645796 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-07a47659-80df-4cba-9a3a-f8e1a6f45444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd75a828348d14ae9b7e9bfa17b2dd329'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:43.650972 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-73604a19-3eb1-43ec-b333-6dd29096ca6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a999b1c1098441fb478ecda69a350a1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:43.654690 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-73604a19-3eb1-43ec-b333-6dd29096ca6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a999b1c1098441fb478ecda69a350a1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:43.665122 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-73604a19-3eb1-43ec-b333-6dd29096ca6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a999b1c1098441fb478ecda69a350a1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:43.670700 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 966/1912] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:43 2022] DELETE /identity/v3/users/4a999b1c1098441fb478ecda69a350a1 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:43.680478 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d57cf7-abab-4626-bcca-49b13bef6385 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:43.680769 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d57cf7-abab-4626-bcca-49b13bef6385 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:43.681046 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d57cf7-abab-4626-bcca-49b13bef6385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:43.699180 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-a4d57cf7-abab-4626-bcca-49b13bef6385 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:43.703077 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a4d57cf7-abab-4626-bcca-49b13bef6385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:43.736588 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-07a47659-80df-4cba-9a3a-f8e1a6f45444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd75a828348d14ae9b7e9bfa17b2dd329'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:43.737230 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-07a47659-80df-4cba-9a3a-f8e1a6f45444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd75a828348d14ae9b7e9bfa17b2dd329'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:43.745470 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-07a47659-80df-4cba-9a3a-f8e1a6f45444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd75a828348d14ae9b7e9bfa17b2dd329'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:43.759579 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-07a47659-80df-4cba-9a3a-f8e1a6f45444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd75a828348d14ae9b7e9bfa17b2dd329'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:43.769927 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 947/1913] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:43 2022] DELETE /identity/v3/users/d75a828348d14ae9b7e9bfa17b2dd329 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:43.770111 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 967/1914] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:43.775308 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4a163-688c-479c-a434-ded1e542bc69 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:43.775308 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4a163-688c-479c-a434-ded1e542bc69 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:43.775308 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de4a163-688c-479c-a434-ded1e542bc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:43.786586 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d57cf7-abab-4626-bcca-49b13bef6385 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:43.788107 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a4d57cf7-abab-4626-bcca-49b13bef6385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:43.794257 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-4de4a163-688c-479c-a434-ded1e542bc69 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:43.795531 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-4de4a163-688c-479c-a434-ded1e542bc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:43.854697 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d57cf7-abab-4626-bcca-49b13bef6385 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:43.856797 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 948/1915] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:43.867093 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4a163-688c-479c-a434-ded1e542bc69 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:43.909058 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d220db-0d84-41c6-88d2-e385e6577619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:43.909711 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d220db-0d84-41c6-88d2-e385e6577619 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:43.910055 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d220db-0d84-41c6-88d2-e385e6577619 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:43.910346 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d220db-0d84-41c6-88d2-e385e6577619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:43.920498 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d220db-0d84-41c6-88d2-e385e6577619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:43.922111 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d220db-0d84-41c6-88d2-e385e6577619 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:43.929852 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de4a163-688c-479c-a434-ded1e542bc69 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:43.934309 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00566f-840a-4e1f-aeac-93b6e5a27e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:43.934491 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 968/1916] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:02:43.935139 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00566f-840a-4e1f-aeac-93b6e5a27e98 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:43.935417 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00566f-840a-4e1f-aeac-93b6e5a27e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:43.935777 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00566f-840a-4e1f-aeac-93b6e5a27e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:43.945730 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00566f-840a-4e1f-aeac-93b6e5a27e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:43.947187 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e00566f-840a-4e1f-aeac-93b6e5a27e98 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:43.958246 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 949/1917] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:02:44.790764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d220db-0d84-41c6-88d2-e385e6577619 service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:44.792977 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-94d220db-0d84-41c6-88d2-e385e6577619 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:44.806200 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d220db-0d84-41c6-88d2-e385e6577619 service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:44.811882 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558cb8c-8eaa-4e27-a1a8-78810e392028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:44.813040 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558cb8c-8eaa-4e27-a1a8-78810e392028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:44.816059 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558cb8c-8eaa-4e27-a1a8-78810e392028 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:44.816059 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558cb8c-8eaa-4e27-a1a8-78810e392028 admin admin] PATH_INFO: `/v3/projects/502a61fa984340a1b0d452d8eb70236a` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:44.816059 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558cb8c-8eaa-4e27-a1a8-78810e392028 admin admin] RBAC: Authorizing `identity:delete_project(project_id=502a61fa984340a1b0d452d8eb70236a)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:44.816895 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558cb8c-8eaa-4e27-a1a8-78810e392028 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:44.864324 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00566f-840a-4e1f-aeac-93b6e5a27e98 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:44.865934 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-5e00566f-840a-4e1f-aeac-93b6e5a27e98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:44.880173 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e00566f-840a-4e1f-aeac-93b6e5a27e98 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:44.896633 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b3dfe-5468-49b8-be5c-40d4f6a26018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:44.897502 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b3dfe-5468-49b8-be5c-40d4f6a26018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:44.897860 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b3dfe-5468-49b8-be5c-40d4f6a26018 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:44.898035 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b3dfe-5468-49b8-be5c-40d4f6a26018 admin admin] PATH_INFO: `/v3/projects/76f67cfe802e485796de22cfab8c8d91` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:44.899384 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b3dfe-5468-49b8-be5c-40d4f6a26018 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76f67cfe802e485796de22cfab8c8d91)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:44.901855 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b3dfe-5468-49b8-be5c-40d4f6a26018 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:44.954330 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-d558cb8c-8eaa-4e27-a1a8-78810e392028 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '502a61fa984340a1b0d452d8eb70236a', 'request_id': 'req-d558cb8c-8eaa-4e27-a1a8-78810e392028'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:44.959741 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-d558cb8c-8eaa-4e27-a1a8-78810e392028 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '502a61fa984340a1b0d452d8eb70236a', 'request_id': 'req-d558cb8c-8eaa-4e27-a1a8-78810e392028'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:45.010900 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1b8b3dfe-5468-49b8-be5c-40d4f6a26018 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f67cfe802e485796de22cfab8c8d91', 'request_id': 'req-1b8b3dfe-5468-49b8-be5c-40d4f6a26018'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:45.016503 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-d558cb8c-8eaa-4e27-a1a8-78810e392028 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '502a61fa984340a1b0d452d8eb70236a', 'request_id': 'req-d558cb8c-8eaa-4e27-a1a8-78810e392028'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:45.028075 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-d558cb8c-8eaa-4e27-a1a8-78810e392028 admin admin] The token cache is being invalidate because project 502a61fa984340a1b0d452d8eb70236a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:45.028345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-d558cb8c-8eaa-4e27-a1a8-78810e392028 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:45.028962 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-d558cb8c-8eaa-4e27-a1a8-78810e392028 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:45.030566 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 969/1918] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:44 2022] DELETE /identity/v3/projects/502a61fa984340a1b0d452d8eb70236a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:45.034508 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558cb8c-8eaa-4e27-a1a8-78810e392028 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:45.035791 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d558cb8c-8eaa-4e27-a1a8-78810e392028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:45.062285 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1b8b3dfe-5468-49b8-be5c-40d4f6a26018 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f67cfe802e485796de22cfab8c8d91', 'request_id': 'req-1b8b3dfe-5468-49b8-be5c-40d4f6a26018'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:45.071092 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1b8b3dfe-5468-49b8-be5c-40d4f6a26018 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f67cfe802e485796de22cfab8c8d91', 'request_id': 'req-1b8b3dfe-5468-49b8-be5c-40d4f6a26018'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:45.082969 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1b8b3dfe-5468-49b8-be5c-40d4f6a26018 admin admin] The token cache is being invalidate because project 76f67cfe802e485796de22cfab8c8d91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:45.083269 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1b8b3dfe-5468-49b8-be5c-40d4f6a26018 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:45.083944 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1b8b3dfe-5468-49b8-be5c-40d4f6a26018 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:45.085597 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 950/1919] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:44 2022] DELETE /identity/v3/projects/76f67cfe802e485796de22cfab8c8d91 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:45.089542 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b3dfe-5468-49b8-be5c-40d4f6a26018 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:45.090817 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-1b8b3dfe-5468-49b8-be5c-40d4f6a26018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:45.098430 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558cb8c-8eaa-4e27-a1a8-78810e392028 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:45.152914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b3dfe-5468-49b8-be5c-40d4f6a26018 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:45.153407 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a830e-6894-4963-a6c9-6d3b3f34a9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:45.154287 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a830e-6894-4963-a6c9-6d3b3f34a9fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:45.154565 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a830e-6894-4963-a6c9-6d3b3f34a9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:45.154857 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a830e-6894-4963-a6c9-6d3b3f34a9fe admin admin] PATH_INFO: `/v3/users/36badcddd9ce4fba9ca3a1ac237b572c` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:45.156048 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a830e-6894-4963-a6c9-6d3b3f34a9fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=36badcddd9ce4fba9ca3a1ac237b572c)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:45.157591 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efd49c-aaa2-4ba1-9eed-05291492a362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:45.157963 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a830e-6894-4963-a6c9-6d3b3f34a9fe admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:45.158445 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efd49c-aaa2-4ba1-9eed-05291492a362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:45.158726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efd49c-aaa2-4ba1-9eed-05291492a362 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:45.159028 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18efd49c-aaa2-4ba1-9eed-05291492a362 admin admin] PATH_INFO: `/v3/users/0f0919946123405ca849792f78cbaff3` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:45.160224 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18efd49c-aaa2-4ba1-9eed-05291492a362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f0919946123405ca849792f78cbaff3)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:45.162116 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18efd49c-aaa2-4ba1-9eed-05291492a362 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:45.361743 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-304a830e-6894-4963-a6c9-6d3b3f34a9fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36badcddd9ce4fba9ca3a1ac237b572c'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:45.368377 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-304a830e-6894-4963-a6c9-6d3b3f34a9fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36badcddd9ce4fba9ca3a1ac237b572c'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:45.373881 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-18efd49c-aaa2-4ba1-9eed-05291492a362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f0919946123405ca849792f78cbaff3'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:45.417356 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-304a830e-6894-4963-a6c9-6d3b3f34a9fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36badcddd9ce4fba9ca3a1ac237b572c'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:45.417990 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-304a830e-6894-4963-a6c9-6d3b3f34a9fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36badcddd9ce4fba9ca3a1ac237b572c'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:45.430143 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-304a830e-6894-4963-a6c9-6d3b3f34a9fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36badcddd9ce4fba9ca3a1ac237b572c'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:45.436755 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 970/1920] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:45 2022] DELETE /identity/v3/users/36badcddd9ce4fba9ca3a1ac237b572c => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:45.456958 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-18efd49c-aaa2-4ba1-9eed-05291492a362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f0919946123405ca849792f78cbaff3'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:45.457306 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-18efd49c-aaa2-4ba1-9eed-05291492a362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f0919946123405ca849792f78cbaff3'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:45.464595 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-18efd49c-aaa2-4ba1-9eed-05291492a362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f0919946123405ca849792f78cbaff3'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:45.476882 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-18efd49c-aaa2-4ba1-9eed-05291492a362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f0919946123405ca849792f78cbaff3'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:45.483748 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 951/1921] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:45 2022] DELETE /identity/v3/users/0f0919946123405ca849792f78cbaff3 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:45.865327 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a830e-6894-4963-a6c9-6d3b3f34a9fe admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:45.867034 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-304a830e-6894-4963-a6c9-6d3b3f34a9fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:45.939982 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efd49c-aaa2-4ba1-9eed-05291492a362 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:45.943790 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-18efd49c-aaa2-4ba1-9eed-05291492a362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:45.949158 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a830e-6894-4963-a6c9-6d3b3f34a9fe admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:46.024034 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18efd49c-aaa2-4ba1-9eed-05291492a362 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:46.029324 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588cbbf-a686-4df7-8924-e1e7174eb2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:46.029791 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cfcbbc-a901-45dd-ada5-5afce54fe172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:46.030190 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588cbbf-a686-4df7-8924-e1e7174eb2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:46.030467 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588cbbf-a686-4df7-8924-e1e7174eb2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:46.030656 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfcbbc-a901-45dd-ada5-5afce54fe172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:46.030908 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588cbbf-a686-4df7-8924-e1e7174eb2f5 admin admin] PATH_INFO: `/v3/projects/c48b3c0452284d109b9c95c1a9827e3b` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:46.031005 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfcbbc-a901-45dd-ada5-5afce54fe172 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:46.031231 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cfcbbc-a901-45dd-ada5-5afce54fe172 admin admin] PATH_INFO: `/v3/projects/88337c7021784b10b3a511128271ae7a` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:46.032109 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588cbbf-a686-4df7-8924-e1e7174eb2f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c48b3c0452284d109b9c95c1a9827e3b)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:46.033359 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfcbbc-a901-45dd-ada5-5afce54fe172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88337c7021784b10b3a511128271ae7a)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:46.034012 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588cbbf-a686-4df7-8924-e1e7174eb2f5 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:46.035286 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cfcbbc-a901-45dd-ada5-5afce54fe172 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:46.142212 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-2588cbbf-a686-4df7-8924-e1e7174eb2f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48b3c0452284d109b9c95c1a9827e3b', 'request_id': 'req-2588cbbf-a686-4df7-8924-e1e7174eb2f5'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:46.170076 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-60cfcbbc-a901-45dd-ada5-5afce54fe172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88337c7021784b10b3a511128271ae7a', 'request_id': 'req-60cfcbbc-a901-45dd-ada5-5afce54fe172'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:46.175581 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-60cfcbbc-a901-45dd-ada5-5afce54fe172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88337c7021784b10b3a511128271ae7a', 'request_id': 'req-60cfcbbc-a901-45dd-ada5-5afce54fe172'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:46.204590 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-2588cbbf-a686-4df7-8924-e1e7174eb2f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48b3c0452284d109b9c95c1a9827e3b', 'request_id': 'req-2588cbbf-a686-4df7-8924-e1e7174eb2f5'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:46.210359 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-2588cbbf-a686-4df7-8924-e1e7174eb2f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48b3c0452284d109b9c95c1a9827e3b', 'request_id': 'req-2588cbbf-a686-4df7-8924-e1e7174eb2f5'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:46.221723 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-2588cbbf-a686-4df7-8924-e1e7174eb2f5 admin admin] The token cache is being invalidate because project c48b3c0452284d109b9c95c1a9827e3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:46.222007 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-2588cbbf-a686-4df7-8924-e1e7174eb2f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:46.222639 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-2588cbbf-a686-4df7-8924-e1e7174eb2f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:46.224228 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 952/1922] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:45 2022] DELETE /identity/v3/projects/c48b3c0452284d109b9c95c1a9827e3b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:46.228850 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82763d-9fe5-45d9-9c56-838c57b12d76 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:46.229135 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82763d-9fe5-45d9-9c56-838c57b12d76 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:46.229408 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82763d-9fe5-45d9-9c56-838c57b12d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:46.246673 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-ab82763d-9fe5-45d9-9c56-838c57b12d76 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:46.247938 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ab82763d-9fe5-45d9-9c56-838c57b12d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:46.273767 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-60cfcbbc-a901-45dd-ada5-5afce54fe172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88337c7021784b10b3a511128271ae7a', 'request_id': 'req-60cfcbbc-a901-45dd-ada5-5afce54fe172'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:46.287018 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-60cfcbbc-a901-45dd-ada5-5afce54fe172 admin admin] The token cache is being invalidate because project 88337c7021784b10b3a511128271ae7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:46.287314 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-60cfcbbc-a901-45dd-ada5-5afce54fe172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:46.287948 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-60cfcbbc-a901-45dd-ada5-5afce54fe172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:46.289485 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 971/1923] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:45 2022] DELETE /identity/v3/projects/88337c7021784b10b3a511128271ae7a => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:46.294152 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1f3e0-3776-4639-9791-8975e69622c7 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:46.294442 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1f3e0-3776-4639-9791-8975e69622c7 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:46.294722 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1f3e0-3776-4639-9791-8975e69622c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:46.308270 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 953/1924] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:46.312987 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-e4e1f3e0-3776-4639-9791-8975e69622c7 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:46.318907 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-e4e1f3e0-3776-4639-9791-8975e69622c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:46.319020 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4616a-1de4-4051-b82e-3aa1abd0ba4e None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:46.319020 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4616a-1de4-4051-b82e-3aa1abd0ba4e None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:46.319020 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4616a-1de4-4051-b82e-3aa1abd0ba4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:46.329162 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 972/1925] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:46.331284 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24a520-fd79-4ce3-9b83-7574d3b185c0 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:46.331575 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24a520-fd79-4ce3-9b83-7574d3b185c0 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:46.331854 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c24a520-fd79-4ce3-9b83-7574d3b185c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:46.340114 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-fdb4616a-1de4-4051-b82e-3aa1abd0ba4e None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:46.341363 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-fdb4616a-1de4-4051-b82e-3aa1abd0ba4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:46.349888 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 954/1926] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:46.350342 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-8c24a520-fd79-4ce3-9b83-7574d3b185c0 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:46.351568 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-8c24a520-fd79-4ce3-9b83-7574d3b185c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:46.353598 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4616a-1de4-4051-b82e-3aa1abd0ba4e None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:46.360160 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 973/1927] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:46.364150 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24a520-fd79-4ce3-9b83-7574d3b185c0 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:46.365868 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4616a-1de4-4051-b82e-3aa1abd0ba4e None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:46.371352 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c5030-50b3-4dd3-bc7f-3db4925afbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:46.372013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c5030-50b3-4dd3-bc7f-3db4925afbf7 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:46.372294 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c5030-50b3-4dd3-bc7f-3db4925afbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:46.372567 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c5030-50b3-4dd3-bc7f-3db4925afbf7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:46.373296 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c5030-50b3-4dd3-bc7f-3db4925afbf7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:02:46.373584 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c24a520-fd79-4ce3-9b83-7574d3b185c0 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:46.373692 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c5030-50b3-4dd3-bc7f-3db4925afbf7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:46.375219 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c5030-50b3-4dd3-bc7f-3db4925afbf7 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:46.378257 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd29793-41e7-4dca-a813-0df975db20de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:46.378930 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd29793-41e7-4dca-a813-0df975db20de admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:46.379220 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd29793-41e7-4dca-a813-0df975db20de admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:46.379491 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd29793-41e7-4dca-a813-0df975db20de admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:46.380217 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd29793-41e7-4dca-a813-0df975db20de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:02:46.380526 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd29793-41e7-4dca-a813-0df975db20de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:46.382088 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd29793-41e7-4dca-a813-0df975db20de admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:46.387168 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 955/1928] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:02:46.391437 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c5030-50b3-4dd3-bc7f-3db4925afbf7 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:46.397502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 974/1929] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:02:46.398636 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd29793-41e7-4dca-a813-0df975db20de admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:46.401126 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c5030-50b3-4dd3-bc7f-3db4925afbf7 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:46.405883 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f7910-04cd-4e66-be77-5b86fd18a236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:46.406555 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f7910-04cd-4e66-be77-5b86fd18a236 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:46.406861 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f7910-04cd-4e66-be77-5b86fd18a236 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:46.407149 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f7910-04cd-4e66-be77-5b86fd18a236 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:46.407833 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f7910-04cd-4e66-be77-5b86fd18a236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:46.408270 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd29793-41e7-4dca-a813-0df975db20de admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:46.409740 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f7910-04cd-4e66-be77-5b86fd18a236 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:46.412873 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb2fb4-b61a-4c44-8c8b-0a23a6d2a04d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:46.413531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb2fb4-b61a-4c44-8c8b-0a23a6d2a04d admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:46.413812 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb2fb4-b61a-4c44-8c8b-0a23a6d2a04d admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:46.414085 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb2fb4-b61a-4c44-8c8b-0a23a6d2a04d admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:46.414776 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb2fb4-b61a-4c44-8c8b-0a23a6d2a04d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:46.416800 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb2fb4-b61a-4c44-8c8b-0a23a6d2a04d admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:46.505384 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 956/1930] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:46 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:46.507584 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f7910-04cd-4e66-be77-5b86fd18a236 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:46.532303 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 975/1931] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:46 2022] POST /identity/v3/projects => generated 385 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:46.544426 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb2fb4-b61a-4c44-8c8b-0a23a6d2a04d admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:46.568269 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f7910-04cd-4e66-be77-5b86fd18a236 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:46.620793 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb2fb4-b61a-4c44-8c8b-0a23a6d2a04d admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:46.626335 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f18fa-4045-4711-bd39-85873c755d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:46.627042 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f18fa-4045-4711-bd39-85873c755d63 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:46.627325 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f18fa-4045-4711-bd39-85873c755d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:46.627599 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f18fa-4045-4711-bd39-85873c755d63 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:46.628293 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f18fa-4045-4711-bd39-85873c755d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:46.628574 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938d725-f579-4bb0-92e6-9d3df3921a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:46.629237 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938d725-f579-4bb0-92e6-9d3df3921a51 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:46.629518 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938d725-f579-4bb0-92e6-9d3df3921a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:46.629914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c938d725-f579-4bb0-92e6-9d3df3921a51 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:46.630203 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f18fa-4045-4711-bd39-85873c755d63 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:46.630612 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938d725-f579-4bb0-92e6-9d3df3921a51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:46.632733 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c938d725-f579-4bb0-92e6-9d3df3921a51 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:46.743151 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 976/1932] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:46 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:46.750945 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f18fa-4045-4711-bd39-85873c755d63 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:46.768776 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f18fa-4045-4711-bd39-85873c755d63 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:46.770875 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 957/1933] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:46 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:46.774936 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938d725-f579-4bb0-92e6-9d3df3921a51 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:46.775738 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d9102-a951-4d64-963b-89c7799aae99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:46.776469 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d9102-a951-4d64-963b-89c7799aae99 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:46.776754 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d9102-a951-4d64-963b-89c7799aae99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:46.777090 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d9102-a951-4d64-963b-89c7799aae99 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:46.777837 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d9102-a951-4d64-963b-89c7799aae99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:46.779613 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d9102-a951-4d64-963b-89c7799aae99 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:46.793123 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 977/1934] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:02:46.797130 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c938d725-f579-4bb0-92e6-9d3df3921a51 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:46.799666 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d9102-a951-4d64-963b-89c7799aae99 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:46.803726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37095e51-c1d7-47df-b7da-f789e3df4940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:46.804410 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37095e51-c1d7-47df-b7da-f789e3df4940 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:46.804688 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37095e51-c1d7-47df-b7da-f789e3df4940 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:46.804957 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37095e51-c1d7-47df-b7da-f789e3df4940 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:46.806660 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37095e51-c1d7-47df-b7da-f789e3df4940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:46.809088 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37095e51-c1d7-47df-b7da-f789e3df4940 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:46.816954 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d9102-a951-4d64-963b-89c7799aae99 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:46.821125 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 958/1935] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:02:46.826034 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37095e51-c1d7-47df-b7da-f789e3df4940 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:46.826979 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a646b-9e12-407f-8eae-8d9eb3769790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:46.827428 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a646b-9e12-407f-8eae-8d9eb3769790 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:46.827609 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a646b-9e12-407f-8eae-8d9eb3769790 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:46.828682 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a646b-9e12-407f-8eae-8d9eb3769790 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:46.828682 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a646b-9e12-407f-8eae-8d9eb3769790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:46.830190 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a646b-9e12-407f-8eae-8d9eb3769790 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:46.844421 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 978/1936] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:46.848282 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a646b-9e12-407f-8eae-8d9eb3769790 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:46.849100 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37095e51-c1d7-47df-b7da-f789e3df4940 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:46.858229 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bd2ec-10d2-4337-aaed-50d6566c4497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:46.859218 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bd2ec-10d2-4337-aaed-50d6566c4497 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:46.859936 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bd2ec-10d2-4337-aaed-50d6566c4497 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:46.860055 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a646b-9e12-407f-8eae-8d9eb3769790 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:46.860461 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9bd2ec-10d2-4337-aaed-50d6566c4497 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:46.861641 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9bd2ec-10d2-4337-aaed-50d6566c4497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:46.864333 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9bd2ec-10d2-4337-aaed-50d6566c4497 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:46.870015 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403337f1-9b27-4a0e-9cb9-e9e0678c4fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:46.870015 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403337f1-9b27-4a0e-9cb9-e9e0678c4fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:46.870015 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403337f1-9b27-4a0e-9cb9-e9e0678c4fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:46.870015 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403337f1-9b27-4a0e-9cb9-e9e0678c4fe9 admin admin] PATH_INFO: `/v3/projects/eab2613deecb455494790b86b3690ed9/users/73f964867ebb4f9195e2950da281cc22/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:46.881216 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 959/1937] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:02:46.885084 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bd2ec-10d2-4337-aaed-50d6566c4497 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:46.889943 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403337f1-9b27-4a0e-9cb9-e9e0678c4fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eab2613deecb455494790b86b3690ed9, user_id=73f964867ebb4f9195e2950da281cc22, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:46.892762 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403337f1-9b27-4a0e-9cb9-e9e0678c4fe9 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:46.898164 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9bd2ec-10d2-4337-aaed-50d6566c4497 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:46.903849 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab4c9d7-0a56-40b2-934c-8a37865d9b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:46.904794 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4c9d7-0a56-40b2-934c-8a37865d9b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:46.905195 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4c9d7-0a56-40b2-934c-8a37865d9b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:46.905376 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab4c9d7-0a56-40b2-934c-8a37865d9b16 admin admin] PATH_INFO: `/v3/projects/2287a933b0b04186b698b5293ce1e0be/users/e8b8baa58aeb4751856eaf868fe4065a/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:46.921662 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4c9d7-0a56-40b2-934c-8a37865d9b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2287a933b0b04186b698b5293ce1e0be, user_id=e8b8baa58aeb4751856eaf868fe4065a, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:46.924366 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab4c9d7-0a56-40b2-934c-8a37865d9b16 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:46.977289 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 979/1938] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:46 2022] PUT /identity/v3/projects/eab2613deecb455494790b86b3690ed9/users/73f964867ebb4f9195e2950da281cc22/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:46.991647 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4822e-f6e9-48ed-afa4-a0b09370b940 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:46.991933 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4822e-f6e9-48ed-afa4-a0b09370b940 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:46.992369 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd4822e-f6e9-48ed-afa4-a0b09370b940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:47.010585 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 960/1939] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:46 2022] PUT /identity/v3/projects/2287a933b0b04186b698b5293ce1e0be/users/e8b8baa58aeb4751856eaf868fe4065a/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:47.020239 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cd91f-322c-4c50-8eaf-52d8d6ea5c85 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:47.020527 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cd91f-322c-4c50-8eaf-52d8d6ea5c85 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:47.020891 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cd91f-322c-4c50-8eaf-52d8d6ea5c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:47.052827 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-ffd4822e-f6e9-48ed-afa4-a0b09370b940 None None] MFA Rules not processed for user `73f964867ebb4f9195e2950da281cc22`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:47.053656 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-b39cd91f-322c-4c50-8eaf-52d8d6ea5c85 None None] MFA Rules not processed for user `e8b8baa58aeb4751856eaf868fe4065a`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:47.055165 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-ffd4822e-f6e9-48ed-afa4-a0b09370b940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:47.055519 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-b39cd91f-322c-4c50-8eaf-52d8d6ea5c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:47.152468 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 980/1940] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:47.153433 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 961/1941] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:47.158454 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cd91f-322c-4c50-8eaf-52d8d6ea5c85 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:47.158972 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4822e-f6e9-48ed-afa4-a0b09370b940 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:47.249102 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cd91f-322c-4c50-8eaf-52d8d6ea5c85 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:47.254410 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e4a09-65f1-4173-bfa5-fb82de5cfdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:47.255747 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e4a09-65f1-4173-bfa5-fb82de5cfdd8 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:47.256034 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e4a09-65f1-4173-bfa5-fb82de5cfdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:47.256344 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e4a09-65f1-4173-bfa5-fb82de5cfdd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:47.257094 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e4a09-65f1-4173-bfa5-fb82de5cfdd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:47.259787 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e4a09-65f1-4173-bfa5-fb82de5cfdd8 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:47.295702 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd4822e-f6e9-48ed-afa4-a0b09370b940 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:47.301623 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e13d3-4408-43ef-a42b-60e0d7730369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:47.302953 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e13d3-4408-43ef-a42b-60e0d7730369 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:47.307166 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e13d3-4408-43ef-a42b-60e0d7730369 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:47.307166 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e13d3-4408-43ef-a42b-60e0d7730369 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:47.307166 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e13d3-4408-43ef-a42b-60e0d7730369 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:47.307166 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e13d3-4408-43ef-a42b-60e0d7730369 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:47.392344 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 981/1942] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:47 2022] POST /identity/v3/projects => generated 387 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:47.396928 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e13d3-4408-43ef-a42b-60e0d7730369 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:47.413704 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 962/1943] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:47 2022] POST /identity/v3/projects => generated 385 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:47.413704 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e4a09-65f1-4173-bfa5-fb82de5cfdd8 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:47.476765 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e13d3-4408-43ef-a42b-60e0d7730369 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:47.483252 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449f862-4c42-4386-b5a2-e2fa36346a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:47.483927 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449f862-4c42-4386-b5a2-e2fa36346a27 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:47.484214 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449f862-4c42-4386-b5a2-e2fa36346a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:47.484535 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a449f862-4c42-4386-b5a2-e2fa36346a27 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:47.485240 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449f862-4c42-4386-b5a2-e2fa36346a27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:47.485644 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e4a09-65f1-4173-bfa5-fb82de5cfdd8 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:47.487367 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a449f862-4c42-4386-b5a2-e2fa36346a27 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:47.490741 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44637f5-9644-4fdf-a42e-f7fd5311e552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:47.491443 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44637f5-9644-4fdf-a42e-f7fd5311e552 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:47.491727 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44637f5-9644-4fdf-a42e-f7fd5311e552 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:47.492002 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44637f5-9644-4fdf-a42e-f7fd5311e552 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:47.492696 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44637f5-9644-4fdf-a42e-f7fd5311e552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:47.494626 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44637f5-9644-4fdf-a42e-f7fd5311e552 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:47.571200 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 982/1944] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:47 2022] POST /identity/v3/users => generated 300 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:47.575520 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449f862-4c42-4386-b5a2-e2fa36346a27 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:47.585458 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 963/1945] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:47 2022] POST /identity/v3/users => generated 299 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:47.586187 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a449f862-4c42-4386-b5a2-e2fa36346a27 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:47.586770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44637f5-9644-4fdf-a42e-f7fd5311e552 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:47.591649 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a6e66-eba4-45e3-8c94-7753d623062a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:47.592534 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a6e66-eba4-45e3-8c94-7753d623062a admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:47.592814 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a6e66-eba4-45e3-8c94-7753d623062a admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:47.593087 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a6e66-eba4-45e3-8c94-7753d623062a admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:47.593819 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a6e66-eba4-45e3-8c94-7753d623062a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:47.595634 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a6e66-eba4-45e3-8c94-7753d623062a admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:47.598555 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44637f5-9644-4fdf-a42e-f7fd5311e552 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:47.604452 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a50193-bdd6-4ddc-9519-9f3197f20e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:47.605449 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a50193-bdd6-4ddc-9519-9f3197f20e05 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:47.605906 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a50193-bdd6-4ddc-9519-9f3197f20e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:47.606343 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 983/1946] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:02:47.606773 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a50193-bdd6-4ddc-9519-9f3197f20e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:47.607553 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a50193-bdd6-4ddc-9519-9f3197f20e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:47.609165 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a50193-bdd6-4ddc-9519-9f3197f20e05 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:47.610304 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a6e66-eba4-45e3-8c94-7753d623062a admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:47.622171 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a6e66-eba4-45e3-8c94-7753d623062a admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:47.622367 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 964/1947] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:02:47.626520 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a50193-bdd6-4ddc-9519-9f3197f20e05 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:47.629621 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261cc3b-e60d-4e9c-97cd-30ad8842032c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:47.630547 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261cc3b-e60d-4e9c-97cd-30ad8842032c admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:47.630861 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261cc3b-e60d-4e9c-97cd-30ad8842032c admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:47.631139 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261cc3b-e60d-4e9c-97cd-30ad8842032c admin admin] PATH_INFO: `/v3/projects/0606efeb4660490b875d2660a84312ac/users/92c38fd798d6494b80b94e58bf0c21a1/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:47.637395 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a50193-bdd6-4ddc-9519-9f3197f20e05 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:47.642347 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4c0b9-dcd8-48fd-8924-294e27c21a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:47.643398 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4c0b9-dcd8-48fd-8924-294e27c21a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:47.643674 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4c0b9-dcd8-48fd-8924-294e27c21a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:47.643949 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4c0b9-dcd8-48fd-8924-294e27c21a6e admin admin] PATH_INFO: `/v3/projects/e74d4cc0e0b5430eb05cf110f710149e/users/3652889c381645a5a37068395b82cd0a/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:47.652002 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4261cc3b-e60d-4e9c-97cd-30ad8842032c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0606efeb4660490b875d2660a84312ac, user_id=92c38fd798d6494b80b94e58bf0c21a1, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:47.655322 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4261cc3b-e60d-4e9c-97cd-30ad8842032c admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:47.680368 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4c0b9-dcd8-48fd-8924-294e27c21a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e74d4cc0e0b5430eb05cf110f710149e, user_id=3652889c381645a5a37068395b82cd0a, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:47.683203 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4c0b9-dcd8-48fd-8924-294e27c21a6e admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:47.737244 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 984/1948] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:47 2022] PUT /identity/v3/projects/0606efeb4660490b875d2660a84312ac/users/92c38fd798d6494b80b94e58bf0c21a1/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:47.741220 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261cc3b-e60d-4e9c-97cd-30ad8842032c admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:47.776433 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 965/1949] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:47 2022] PUT /identity/v3/projects/e74d4cc0e0b5430eb05cf110f710149e/users/3652889c381645a5a37068395b82cd0a/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:47.780050 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4c0b9-dcd8-48fd-8924-294e27c21a6e admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:47.843988 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261cc3b-e60d-4e9c-97cd-30ad8842032c admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:47.864768 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4c0b9-dcd8-48fd-8924-294e27c21a6e admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:47.870084 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c5376-feb1-4194-b414-dd24955b2c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:47.870910 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c5376-feb1-4194-b414-dd24955b2c2c admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:47.871222 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c5376-feb1-4194-b414-dd24955b2c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:47.871490 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796c5376-feb1-4194-b414-dd24955b2c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:47.872291 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c5376-feb1-4194-b414-dd24955b2c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:47.873855 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796c5376-feb1-4194-b414-dd24955b2c2c admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:47.883756 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 966/1950] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:02:47.888274 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c5376-feb1-4194-b414-dd24955b2c2c admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:47.897871 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796c5376-feb1-4194-b414-dd24955b2c2c admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:47.901959 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a134df8-c4a4-43fa-bc4a-116b2716965a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:47.902602 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef1c856-6764-4783-931b-beec3b620096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:47.902741 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a134df8-c4a4-43fa-bc4a-116b2716965a admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:47.902925 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a134df8-c4a4-43fa-bc4a-116b2716965a admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:47.903201 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a134df8-c4a4-43fa-bc4a-116b2716965a admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:47.903492 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1c856-6764-4783-931b-beec3b620096 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:47.903775 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1c856-6764-4783-931b-beec3b620096 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:47.903956 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a134df8-c4a4-43fa-bc4a-116b2716965a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:47.904076 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1c856-6764-4783-931b-beec3b620096 admin admin] PATH_INFO: `/v3/projects/e74d4cc0e0b5430eb05cf110f710149e/users/3652889c381645a5a37068395b82cd0a/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:47.905530 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a134df8-c4a4-43fa-bc4a-116b2716965a admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:47.906105 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1c856-6764-4783-931b-beec3b620096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e74d4cc0e0b5430eb05cf110f710149e, user_id=3652889c381645a5a37068395b82cd0a, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:47.913214 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef1c856-6764-4783-931b-beec3b620096 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:47.918717 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 985/1951] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:02:47.921860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a134df8-c4a4-43fa-bc4a-116b2716965a admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:47.924978 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 967/1952] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:47 2022] PUT /identity/v3/projects/e74d4cc0e0b5430eb05cf110f710149e/users/3652889c381645a5a37068395b82cd0a/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:47.933427 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a134df8-c4a4-43fa-bc4a-116b2716965a admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:47.935739 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5678f4-d3d1-4d51-ac12-f6dbff34e294 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:47.936042 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5678f4-d3d1-4d51-ac12-f6dbff34e294 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:47.936314 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5678f4-d3d1-4d51-ac12-f6dbff34e294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:47.978918 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-6a5678f4-d3d1-4d51-ac12-f6dbff34e294 None None] MFA Rules not processed for user `3652889c381645a5a37068395b82cd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:47.979887 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-6a5678f4-d3d1-4d51-ac12-f6dbff34e294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:48.005833 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52f624e-a129-4073-9e6e-4df19edcea69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:48.006912 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f624e-a129-4073-9e6e-4df19edcea69 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:48.007447 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f624e-a129-4073-9e6e-4df19edcea69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:48.007790 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52f624e-a129-4073-9e6e-4df19edcea69 admin admin] PATH_INFO: `/v3/projects/0606efeb4660490b875d2660a84312ac/users/92c38fd798d6494b80b94e58bf0c21a1/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:48.010676 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f624e-a129-4073-9e6e-4df19edcea69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0606efeb4660490b875d2660a84312ac, user_id=92c38fd798d6494b80b94e58bf0c21a1, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:48.013503 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52f624e-a129-4073-9e6e-4df19edcea69 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:48.026158 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 986/1953] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:47 2022] PUT /identity/v3/projects/0606efeb4660490b875d2660a84312ac/users/92c38fd798d6494b80b94e58bf0c21a1/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:48.037238 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba1ae9-d427-4da0-8e68-92804b697a4e None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:48.037525 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba1ae9-d427-4da0-8e68-92804b697a4e None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:48.037805 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba1ae9-d427-4da0-8e68-92804b697a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:48.068799 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 968/1954] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:48.069483 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-a6ba1ae9-d427-4da0-8e68-92804b697a4e None None] MFA Rules not processed for user `92c38fd798d6494b80b94e58bf0c21a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:48.070265 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a6ba1ae9-d427-4da0-8e68-92804b697a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:48.112794 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5678f4-d3d1-4d51-ac12-f6dbff34e294 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:48.114469 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-6a5678f4-d3d1-4d51-ac12-f6dbff34e294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:48.164768 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 987/1955] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:48.189481 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5678f4-d3d1-4d51-ac12-f6dbff34e294 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:48.257051 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba1ae9-d427-4da0-8e68-92804b697a4e None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:48.258510 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a6ba1ae9-d427-4da0-8e68-92804b697a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:48.269797 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0e97b-d9f3-4dfb-a522-416633dcde79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:48.271149 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0e97b-d9f3-4dfb-a522-416633dcde79 service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:48.271608 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0e97b-d9f3-4dfb-a522-416633dcde79 service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:48.272030 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0e97b-d9f3-4dfb-a522-416633dcde79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:48.362823 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0e97b-d9f3-4dfb-a522-416633dcde79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:48.363872 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba1ae9-d427-4da0-8e68-92804b697a4e None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:48.364565 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0e97b-d9f3-4dfb-a522-416633dcde79 service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:48.368031 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ebee5-b1f5-48d6-93f7-6e5b417d2d38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:48.368678 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ebee5-b1f5-48d6-93f7-6e5b417d2d38 service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:48.368954 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ebee5-b1f5-48d6-93f7-6e5b417d2d38 service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:48.370006 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ebee5-b1f5-48d6-93f7-6e5b417d2d38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:48.376538 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 969/1956] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:02:48.381875 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ebee5-b1f5-48d6-93f7-6e5b417d2d38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:48.383515 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ebee5-b1f5-48d6-93f7-6e5b417d2d38 service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:48.394419 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 988/1957] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:02:48.418669 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0e97b-d9f3-4dfb-a522-416633dcde79 service cinder] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:48.549908 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0e97b-d9f3-4dfb-a522-416633dcde79 service cinder] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:48.563642 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6233117-3bae-4de4-b034-6cc7abd2e999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:48.563642 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6233117-3bae-4de4-b034-6cc7abd2e999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:48.563642 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6233117-3bae-4de4-b034-6cc7abd2e999 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:48.563642 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6233117-3bae-4de4-b034-6cc7abd2e999 admin admin] PATH_INFO: `/v3/users/73f964867ebb4f9195e2950da281cc22` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:48.564017 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6233117-3bae-4de4-b034-6cc7abd2e999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f964867ebb4f9195e2950da281cc22)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:48.564017 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6233117-3bae-4de4-b034-6cc7abd2e999 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:48.839570 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f6233117-3bae-4de4-b034-6cc7abd2e999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f964867ebb4f9195e2950da281cc22'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:48.925042 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f6233117-3bae-4de4-b034-6cc7abd2e999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f964867ebb4f9195e2950da281cc22'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:48.925654 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f6233117-3bae-4de4-b034-6cc7abd2e999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f964867ebb4f9195e2950da281cc22'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:48.933298 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f6233117-3bae-4de4-b034-6cc7abd2e999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f964867ebb4f9195e2950da281cc22'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:48.952377 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f6233117-3bae-4de4-b034-6cc7abd2e999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f964867ebb4f9195e2950da281cc22'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:48.958741 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 970/1958] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:48 2022] DELETE /identity/v3/users/73f964867ebb4f9195e2950da281cc22 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:48.971560 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f894a5-17de-43d3-a8a6-5a4fc4960bb3 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:48.972532 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f894a5-17de-43d3-a8a6-5a4fc4960bb3 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:48.977450 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f894a5-17de-43d3-a8a6-5a4fc4960bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:48.992822 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-e1f894a5-17de-43d3-a8a6-5a4fc4960bb3 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:48.993578 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-e1f894a5-17de-43d3-a8a6-5a4fc4960bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:49.061074 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 989/1959] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:49.071058 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6233117-3bae-4de4-b034-6cc7abd2e999 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:49.073218 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-f6233117-3bae-4de4-b034-6cc7abd2e999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:49.148509 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6233117-3bae-4de4-b034-6cc7abd2e999 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:49.153593 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07c274-8903-484d-940c-976d2007ef18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:49.154265 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07c274-8903-484d-940c-976d2007ef18 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:49.154551 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07c274-8903-484d-940c-976d2007ef18 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:49.154998 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07c274-8903-484d-940c-976d2007ef18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:49.173781 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07c274-8903-484d-940c-976d2007ef18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:49.175395 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07c274-8903-484d-940c-976d2007ef18 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:49.185871 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 971/1960] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:02:49.634651 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f894a5-17de-43d3-a8a6-5a4fc4960bb3 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:49.636666 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-e1f894a5-17de-43d3-a8a6-5a4fc4960bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:49.643928 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07c274-8903-484d-940c-976d2007ef18 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:49.643928 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-0f07c274-8903-484d-940c-976d2007ef18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:49.660025 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f894a5-17de-43d3-a8a6-5a4fc4960bb3 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:49.665710 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6ff6d-8005-4b1b-a92c-233140f77a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:49.667030 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6ff6d-8005-4b1b-a92c-233140f77a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:49.677243 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6ff6d-8005-4b1b-a92c-233140f77a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:49.677243 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6ff6d-8005-4b1b-a92c-233140f77a2e admin admin] PATH_INFO: `/v3/users/e8b8baa58aeb4751856eaf868fe4065a` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:49.677243 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6ff6d-8005-4b1b-a92c-233140f77a2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8b8baa58aeb4751856eaf868fe4065a)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:49.677824 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07c274-8903-484d-940c-976d2007ef18 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:49.681390 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6ff6d-8005-4b1b-a92c-233140f77a2e admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:49.686218 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12e528-afab-4e7d-b4aa-1119cdc62256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:49.687318 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12e528-afab-4e7d-b4aa-1119cdc62256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:49.688335 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12e528-afab-4e7d-b4aa-1119cdc62256 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:49.688630 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12e528-afab-4e7d-b4aa-1119cdc62256 admin admin] PATH_INFO: `/v3/projects/eab2613deecb455494790b86b3690ed9` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:49.690106 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12e528-afab-4e7d-b4aa-1119cdc62256 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eab2613deecb455494790b86b3690ed9)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:49.692244 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12e528-afab-4e7d-b4aa-1119cdc62256 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:49.904318 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c0c6ff6d-8005-4b1b-a92c-233140f77a2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8b8baa58aeb4751856eaf868fe4065a'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:49.904778 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ab12e528-afab-4e7d-b4aa-1119cdc62256 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eab2613deecb455494790b86b3690ed9', 'request_id': 'req-ab12e528-afab-4e7d-b4aa-1119cdc62256'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:49.920286 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c0c6ff6d-8005-4b1b-a92c-233140f77a2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8b8baa58aeb4751856eaf868fe4065a'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:49.959432 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ab12e528-afab-4e7d-b4aa-1119cdc62256 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eab2613deecb455494790b86b3690ed9', 'request_id': 'req-ab12e528-afab-4e7d-b4aa-1119cdc62256'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:49.965210 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ab12e528-afab-4e7d-b4aa-1119cdc62256 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eab2613deecb455494790b86b3690ed9', 'request_id': 'req-ab12e528-afab-4e7d-b4aa-1119cdc62256'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:49.976082 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ab12e528-afab-4e7d-b4aa-1119cdc62256 admin admin] The token cache is being invalidate because project eab2613deecb455494790b86b3690ed9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:49.976368 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ab12e528-afab-4e7d-b4aa-1119cdc62256 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:49.976987 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ab12e528-afab-4e7d-b4aa-1119cdc62256 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:49.979211 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 972/1961] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:49 2022] DELETE /identity/v3/projects/eab2613deecb455494790b86b3690ed9 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:49.983390 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12e528-afab-4e7d-b4aa-1119cdc62256 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:49.984684 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ab12e528-afab-4e7d-b4aa-1119cdc62256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:50.039431 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c0c6ff6d-8005-4b1b-a92c-233140f77a2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8b8baa58aeb4751856eaf868fe4065a'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:50.040059 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c0c6ff6d-8005-4b1b-a92c-233140f77a2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8b8baa58aeb4751856eaf868fe4065a'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:50.045446 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12e528-afab-4e7d-b4aa-1119cdc62256 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:50.050061 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d09a8b-4a41-4e32-a50b-ac4f6c2fae44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:50.050980 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d09a8b-4a41-4e32-a50b-ac4f6c2fae44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:50.051257 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d09a8b-4a41-4e32-a50b-ac4f6c2fae44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:50.051528 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d09a8b-4a41-4e32-a50b-ac4f6c2fae44 admin admin] PATH_INFO: `/v3/users/3652889c381645a5a37068395b82cd0a` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:50.052710 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d09a8b-4a41-4e32-a50b-ac4f6c2fae44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3652889c381645a5a37068395b82cd0a)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:50.053479 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c0c6ff6d-8005-4b1b-a92c-233140f77a2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8b8baa58aeb4751856eaf868fe4065a'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:50.054605 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d09a8b-4a41-4e32-a50b-ac4f6c2fae44 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:50.060262 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 990/1962] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:49 2022] DELETE /identity/v3/users/e8b8baa58aeb4751856eaf868fe4065a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:50.064729 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0fca4-2dc6-4d5f-9b40-5d6e243086a6 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:50.065020 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0fca4-2dc6-4d5f-9b40-5d6e243086a6 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:50.065296 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e0fca4-2dc6-4d5f-9b40-5d6e243086a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:50.081823 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-64e0fca4-2dc6-4d5f-9b40-5d6e243086a6 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:50.083117 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-64e0fca4-2dc6-4d5f-9b40-5d6e243086a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:50.145242 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 991/1963] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:50.155141 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0fca4-2dc6-4d5f-9b40-5d6e243086a6 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:50.156507 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-64e0fca4-2dc6-4d5f-9b40-5d6e243086a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:50.210296 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e0fca4-2dc6-4d5f-9b40-5d6e243086a6 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:50.214350 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ddc92-958f-47f9-9d91-9129fc347d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:50.215091 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ddc92-958f-47f9-9d91-9129fc347d5a service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:50.215392 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ddc92-958f-47f9-9d91-9129fc347d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:50.215609 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ddc92-958f-47f9-9d91-9129fc347d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:50.224650 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ddc92-958f-47f9-9d91-9129fc347d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:50.226096 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ddc92-958f-47f9-9d91-9129fc347d5a service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:50.236722 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 992/1964] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:02:50.258794 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e7d09a8b-4a41-4e32-a50b-ac4f6c2fae44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3652889c381645a5a37068395b82cd0a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:50.342508 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e7d09a8b-4a41-4e32-a50b-ac4f6c2fae44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3652889c381645a5a37068395b82cd0a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:50.343183 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e7d09a8b-4a41-4e32-a50b-ac4f6c2fae44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3652889c381645a5a37068395b82cd0a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:50.350683 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e7d09a8b-4a41-4e32-a50b-ac4f6c2fae44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3652889c381645a5a37068395b82cd0a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:50.363167 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e7d09a8b-4a41-4e32-a50b-ac4f6c2fae44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3652889c381645a5a37068395b82cd0a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:50.368960 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 973/1965] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:49 2022] DELETE /identity/v3/users/3652889c381645a5a37068395b82cd0a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:50.669083 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ddc92-958f-47f9-9d91-9129fc347d5a service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:50.671035 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-030ddc92-958f-47f9-9d91-9129fc347d5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:50.693375 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ddc92-958f-47f9-9d91-9129fc347d5a service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:50.756760 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d09a8b-4a41-4e32-a50b-ac4f6c2fae44 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:50.758742 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec29c6-c6a6-42df-8c80-0dc3ba0d7aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:50.759929 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec29c6-c6a6-42df-8c80-0dc3ba0d7aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:50.760430 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec29c6-c6a6-42df-8c80-0dc3ba0d7aea admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:50.760888 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec29c6-c6a6-42df-8c80-0dc3ba0d7aea admin admin] PATH_INFO: `/v3/projects/2287a933b0b04186b698b5293ce1e0be` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:50.761762 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-e7d09a8b-4a41-4e32-a50b-ac4f6c2fae44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:50.762502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec29c6-c6a6-42df-8c80-0dc3ba0d7aea admin admin] RBAC: Authorizing `identity:delete_project(project_id=2287a933b0b04186b698b5293ce1e0be)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:50.764851 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec29c6-c6a6-42df-8c80-0dc3ba0d7aea admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:50.780809 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d09a8b-4a41-4e32-a50b-ac4f6c2fae44 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:50.786487 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90370461-19f1-4feb-bfb5-6d7677d62a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:50.787416 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90370461-19f1-4feb-bfb5-6d7677d62a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:50.787836 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90370461-19f1-4feb-bfb5-6d7677d62a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:50.788120 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90370461-19f1-4feb-bfb5-6d7677d62a85 admin admin] PATH_INFO: `/v3/projects/e74d4cc0e0b5430eb05cf110f710149e` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:50.789700 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90370461-19f1-4feb-bfb5-6d7677d62a85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e74d4cc0e0b5430eb05cf110f710149e)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:50.792765 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90370461-19f1-4feb-bfb5-6d7677d62a85 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:50.860342 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-9eec29c6-c6a6-42df-8c80-0dc3ba0d7aea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2287a933b0b04186b698b5293ce1e0be', 'request_id': 'req-9eec29c6-c6a6-42df-8c80-0dc3ba0d7aea'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:50.865873 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-9eec29c6-c6a6-42df-8c80-0dc3ba0d7aea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2287a933b0b04186b698b5293ce1e0be', 'request_id': 'req-9eec29c6-c6a6-42df-8c80-0dc3ba0d7aea'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:50.903345 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-90370461-19f1-4feb-bfb5-6d7677d62a85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e74d4cc0e0b5430eb05cf110f710149e', 'request_id': 'req-90370461-19f1-4feb-bfb5-6d7677d62a85'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:50.930591 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-9eec29c6-c6a6-42df-8c80-0dc3ba0d7aea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2287a933b0b04186b698b5293ce1e0be', 'request_id': 'req-9eec29c6-c6a6-42df-8c80-0dc3ba0d7aea'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:50.944122 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-9eec29c6-c6a6-42df-8c80-0dc3ba0d7aea admin admin] The token cache is being invalidate because project 2287a933b0b04186b698b5293ce1e0be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:50.944552 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-9eec29c6-c6a6-42df-8c80-0dc3ba0d7aea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:50.945517 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-9eec29c6-c6a6-42df-8c80-0dc3ba0d7aea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:50.948101 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 993/1966] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:50 2022] DELETE /identity/v3/projects/2287a933b0b04186b698b5293ce1e0be => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:50.951682 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec29c6-c6a6-42df-8c80-0dc3ba0d7aea admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:50.953193 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-9eec29c6-c6a6-42df-8c80-0dc3ba0d7aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:50.965284 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-90370461-19f1-4feb-bfb5-6d7677d62a85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e74d4cc0e0b5430eb05cf110f710149e', 'request_id': 'req-90370461-19f1-4feb-bfb5-6d7677d62a85'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:50.971729 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-90370461-19f1-4feb-bfb5-6d7677d62a85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e74d4cc0e0b5430eb05cf110f710149e', 'request_id': 'req-90370461-19f1-4feb-bfb5-6d7677d62a85'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:50.983960 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-90370461-19f1-4feb-bfb5-6d7677d62a85 admin admin] The token cache is being invalidate because project e74d4cc0e0b5430eb05cf110f710149e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:50.984327 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-90370461-19f1-4feb-bfb5-6d7677d62a85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:50.984986 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-90370461-19f1-4feb-bfb5-6d7677d62a85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:50.986595 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 974/1967] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:50 2022] DELETE /identity/v3/projects/e74d4cc0e0b5430eb05cf110f710149e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:50.991497 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc0f53-3f80-4cd0-9bd5-cc5577c7a1a8 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:50.991782 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc0f53-3f80-4cd0-9bd5-cc5577c7a1a8 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:50.992051 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc0f53-3f80-4cd0-9bd5-cc5577c7a1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:51.011247 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-34cc0f53-3f80-4cd0-9bd5-cc5577c7a1a8 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:51.012427 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-34cc0f53-3f80-4cd0-9bd5-cc5577c7a1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:51.024352 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec29c6-c6a6-42df-8c80-0dc3ba0d7aea admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:51.068097 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 975/1968] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:51.075555 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2511203-21e0-4a31-8762-0157ca0c3074 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:51.075872 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2511203-21e0-4a31-8762-0157ca0c3074 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:51.076149 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2511203-21e0-4a31-8762-0157ca0c3074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:51.077871 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd09681-8a91-4505-a26a-90819abea0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:51.078742 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd09681-8a91-4505-a26a-90819abea0e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:51.079046 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd09681-8a91-4505-a26a-90819abea0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:51.079316 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd09681-8a91-4505-a26a-90819abea0e2 admin admin] PATH_INFO: `/v3/users/92c38fd798d6494b80b94e58bf0c21a1` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:51.080481 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd09681-8a91-4505-a26a-90819abea0e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92c38fd798d6494b80b94e58bf0c21a1)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:51.082380 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd09681-8a91-4505-a26a-90819abea0e2 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:51.093992 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-d2511203-21e0-4a31-8762-0157ca0c3074 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:51.095210 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d2511203-21e0-4a31-8762-0157ca0c3074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:51.103112 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 976/1969] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:51.108758 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2511203-21e0-4a31-8762-0157ca0c3074 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:51.118006 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2511203-21e0-4a31-8762-0157ca0c3074 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:51.123282 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11300747-0d37-4512-ad59-488581174094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:51.123861 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11300747-0d37-4512-ad59-488581174094 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:51.124145 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11300747-0d37-4512-ad59-488581174094 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:51.124421 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11300747-0d37-4512-ad59-488581174094 admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:51.125155 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11300747-0d37-4512-ad59-488581174094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:02:51.125474 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11300747-0d37-4512-ad59-488581174094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:51.127106 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11300747-0d37-4512-ad59-488581174094 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:51.138765 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 977/1970] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:02:51.143161 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11300747-0d37-4512-ad59-488581174094 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:51.153231 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11300747-0d37-4512-ad59-488581174094 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:51.160801 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797bdc5-af1f-4964-90bb-5a12a019cdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:51.160801 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797bdc5-af1f-4964-90bb-5a12a019cdba admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:51.160801 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797bdc5-af1f-4964-90bb-5a12a019cdba admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:51.160801 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797bdc5-af1f-4964-90bb-5a12a019cdba admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:51.161200 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797bdc5-af1f-4964-90bb-5a12a019cdba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:51.162008 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797bdc5-af1f-4964-90bb-5a12a019cdba admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:51.234872 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 978/1971] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:51 2022] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:51.235816 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-2bd09681-8a91-4505-a26a-90819abea0e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92c38fd798d6494b80b94e58bf0c21a1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:51.238979 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797bdc5-af1f-4964-90bb-5a12a019cdba admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:51.243052 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-2bd09681-8a91-4505-a26a-90819abea0e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92c38fd798d6494b80b94e58bf0c21a1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:51.290822 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-2bd09681-8a91-4505-a26a-90819abea0e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92c38fd798d6494b80b94e58bf0c21a1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:51.291464 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-2bd09681-8a91-4505-a26a-90819abea0e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92c38fd798d6494b80b94e58bf0c21a1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:51.298967 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797bdc5-af1f-4964-90bb-5a12a019cdba admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:51.303668 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88414e4-f2c0-4ffe-a8ed-9057784e0374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:51.303804 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-2bd09681-8a91-4505-a26a-90819abea0e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92c38fd798d6494b80b94e58bf0c21a1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:51.304327 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88414e4-f2c0-4ffe-a8ed-9057784e0374 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:51.304604 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88414e4-f2c0-4ffe-a8ed-9057784e0374 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:51.304881 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88414e4-f2c0-4ffe-a8ed-9057784e0374 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:51.305575 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88414e4-f2c0-4ffe-a8ed-9057784e0374 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:51.307554 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88414e4-f2c0-4ffe-a8ed-9057784e0374 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:51.309939 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 994/1972] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:50 2022] DELETE /identity/v3/users/92c38fd798d6494b80b94e58bf0c21a1 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:51.373887 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 979/1973] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:51 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:51.375150 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd09681-8a91-4505-a26a-90819abea0e2 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:51.376642 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-2bd09681-8a91-4505-a26a-90819abea0e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:51.438254 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd09681-8a91-4505-a26a-90819abea0e2 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:51.442814 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e78d8-84d5-4cc5-ac41-96a461762713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:51.443500 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e78d8-84d5-4cc5-ac41-96a461762713 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:51.443781 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e78d8-84d5-4cc5-ac41-96a461762713 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:51.444052 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e78d8-84d5-4cc5-ac41-96a461762713 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:51.444772 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e78d8-84d5-4cc5-ac41-96a461762713 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:51.446358 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517e78d8-84d5-4cc5-ac41-96a461762713 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:51.456305 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 995/1974] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:02:51.460517 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88414e4-f2c0-4ffe-a8ed-9057784e0374 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:51.471279 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88414e4-f2c0-4ffe-a8ed-9057784e0374 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:51.475907 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe5005c-04e0-455e-81d3-f8c07355a2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:51.476555 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5005c-04e0-455e-81d3-f8c07355a2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:51.476831 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5005c-04e0-455e-81d3-f8c07355a2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:51.477103 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5005c-04e0-455e-81d3-f8c07355a2f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:51.477823 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5005c-04e0-455e-81d3-f8c07355a2f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:51.479493 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe5005c-04e0-455e-81d3-f8c07355a2f0 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:51.489554 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 980/1975] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:51.497483 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e78d8-84d5-4cc5-ac41-96a461762713 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:51.507551 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e78d8-84d5-4cc5-ac41-96a461762713 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:51.514074 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba425f8-f8ab-4e7e-b011-f3801ddbe37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:51.515000 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba425f8-f8ab-4e7e-b011-f3801ddbe37e admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:51.515276 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba425f8-f8ab-4e7e-b011-f3801ddbe37e admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:51.515545 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba425f8-f8ab-4e7e-b011-f3801ddbe37e admin admin] PATH_INFO: `/v3/projects/5d5e4c2fcb124f1ea73ec8a8a5110941/users/b1d580b8e7954c3da72f27cfb2e6786b/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:51.532086 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba425f8-f8ab-4e7e-b011-f3801ddbe37e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d5e4c2fcb124f1ea73ec8a8a5110941, user_id=b1d580b8e7954c3da72f27cfb2e6786b, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:51.534726 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba425f8-f8ab-4e7e-b011-f3801ddbe37e admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:51.640142 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 996/1976] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:51 2022] PUT /identity/v3/projects/5d5e4c2fcb124f1ea73ec8a8a5110941/users/b1d580b8e7954c3da72f27cfb2e6786b/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:51.651584 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369258cd-a7d0-43bb-a4aa-a733ef8f68ec None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:51.651873 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369258cd-a7d0-43bb-a4aa-a733ef8f68ec None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:51.652163 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369258cd-a7d0-43bb-a4aa-a733ef8f68ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:51.677410 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-369258cd-a7d0-43bb-a4aa-a733ef8f68ec None None] MFA Rules not processed for user `b1d580b8e7954c3da72f27cfb2e6786b`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:51.678608 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-369258cd-a7d0-43bb-a4aa-a733ef8f68ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:51.715774 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba425f8-f8ab-4e7e-b011-f3801ddbe37e admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:51.717506 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1ba425f8-f8ab-4e7e-b011-f3801ddbe37e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:51.744875 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 981/1977] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:51.759459 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369258cd-a7d0-43bb-a4aa-a733ef8f68ec None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:51.793224 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba425f8-f8ab-4e7e-b011-f3801ddbe37e admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:51.797883 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334423a7-c0c3-44c1-97f3-b37ab80a62b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:51.798733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334423a7-c0c3-44c1-97f3-b37ab80a62b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:51.799045 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334423a7-c0c3-44c1-97f3-b37ab80a62b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:51.799324 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334423a7-c0c3-44c1-97f3-b37ab80a62b0 admin admin] PATH_INFO: `/v3/projects/0606efeb4660490b875d2660a84312ac` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:51.800581 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334423a7-c0c3-44c1-97f3-b37ab80a62b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0606efeb4660490b875d2660a84312ac)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:51.802489 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334423a7-c0c3-44c1-97f3-b37ab80a62b0 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:51.829132 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369258cd-a7d0-43bb-a4aa-a733ef8f68ec None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:51.834935 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c5b75-c823-4cb9-b559-e445de39adc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:51.835601 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c5b75-c823-4cb9-b559-e445de39adc5 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:51.835884 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c5b75-c823-4cb9-b559-e445de39adc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:51.836158 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c5b75-c823-4cb9-b559-e445de39adc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:51.836852 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c5b75-c823-4cb9-b559-e445de39adc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:51.839243 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c5b75-c823-4cb9-b559-e445de39adc5 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:51.919032 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-334423a7-c0c3-44c1-97f3-b37ab80a62b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0606efeb4660490b875d2660a84312ac', 'request_id': 'req-334423a7-c0c3-44c1-97f3-b37ab80a62b0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:51.924551 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-334423a7-c0c3-44c1-97f3-b37ab80a62b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0606efeb4660490b875d2660a84312ac', 'request_id': 'req-334423a7-c0c3-44c1-97f3-b37ab80a62b0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:51.941545 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 982/1978] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:51 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:51.942677 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c5b75-c823-4cb9-b559-e445de39adc5 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:51.992882 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-334423a7-c0c3-44c1-97f3-b37ab80a62b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0606efeb4660490b875d2660a84312ac', 'request_id': 'req-334423a7-c0c3-44c1-97f3-b37ab80a62b0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:52.002049 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-334423a7-c0c3-44c1-97f3-b37ab80a62b0 admin admin] The token cache is being invalidate because project 0606efeb4660490b875d2660a84312ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:52.002342 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-334423a7-c0c3-44c1-97f3-b37ab80a62b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:52.003060 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-334423a7-c0c3-44c1-97f3-b37ab80a62b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:52.004937 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 997/1979] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:51 2022] DELETE /identity/v3/projects/0606efeb4660490b875d2660a84312ac => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:52.009806 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15724ffc-b117-494b-8c2e-5652fe3e4b6e None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:52.010168 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15724ffc-b117-494b-8c2e-5652fe3e4b6e None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:52.010507 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15724ffc-b117-494b-8c2e-5652fe3e4b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:52.023989 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c5b75-c823-4cb9-b559-e445de39adc5 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:52.029123 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2556ede-6459-4087-8f44-bcda8ff6d29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:52.030244 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2556ede-6459-4087-8f44-bcda8ff6d29f admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:52.030531 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2556ede-6459-4087-8f44-bcda8ff6d29f admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:52.030803 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2556ede-6459-4087-8f44-bcda8ff6d29f admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:52.031372 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-15724ffc-b117-494b-8c2e-5652fe3e4b6e None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:52.031594 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2556ede-6459-4087-8f44-bcda8ff6d29f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:52.032948 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-15724ffc-b117-494b-8c2e-5652fe3e4b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:52.033789 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2556ede-6459-4087-8f44-bcda8ff6d29f admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:52.043221 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 998/1980] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:52.051526 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca17391-1a85-4b2c-8bbb-57ad7c6f47d0 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:52.051934 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca17391-1a85-4b2c-8bbb-57ad7c6f47d0 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:52.052327 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca17391-1a85-4b2c-8bbb-57ad7c6f47d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:52.072977 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-7ca17391-1a85-4b2c-8bbb-57ad7c6f47d0 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:52.074629 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-7ca17391-1a85-4b2c-8bbb-57ad7c6f47d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:52.083174 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 999/1981] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:52.087521 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca17391-1a85-4b2c-8bbb-57ad7c6f47d0 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:52.097521 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca17391-1a85-4b2c-8bbb-57ad7c6f47d0 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:52.103707 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21a53a-10cf-47bd-aba7-18c1d7c84088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:52.104418 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21a53a-10cf-47bd-aba7-18c1d7c84088 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:52.105181 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21a53a-10cf-47bd-aba7-18c1d7c84088 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:52.105461 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21a53a-10cf-47bd-aba7-18c1d7c84088 admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:52.106681 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21a53a-10cf-47bd-aba7-18c1d7c84088 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:02:52.106814 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21a53a-10cf-47bd-aba7-18c1d7c84088 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:52.108467 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21a53a-10cf-47bd-aba7-18c1d7c84088 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:52.124824 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 983/1982] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:51 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:52.126185 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2556ede-6459-4087-8f44-bcda8ff6d29f admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:52.128328 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-e2556ede-6459-4087-8f44-bcda8ff6d29f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:52.128525 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1000/1983] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:02:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:02:52.129674 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21a53a-10cf-47bd-aba7-18c1d7c84088 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:52.141295 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21a53a-10cf-47bd-aba7-18c1d7c84088 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:52.147328 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6370f2-98ca-4933-9a66-57566713248b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:52.148071 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6370f2-98ca-4933-9a66-57566713248b admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:52.148461 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6370f2-98ca-4933-9a66-57566713248b admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:52.148962 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6370f2-98ca-4933-9a66-57566713248b admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:52.149197 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2556ede-6459-4087-8f44-bcda8ff6d29f admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:52.150055 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6370f2-98ca-4933-9a66-57566713248b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:52.152161 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6370f2-98ca-4933-9a66-57566713248b admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:52.160481 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b871ef5-b0ab-4756-8474-d75bc12c8c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:52.161264 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b871ef5-b0ab-4756-8474-d75bc12c8c99 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:52.161615 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b871ef5-b0ab-4756-8474-d75bc12c8c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:52.161963 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b871ef5-b0ab-4756-8474-d75bc12c8c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:52.165397 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b871ef5-b0ab-4756-8474-d75bc12c8c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:52.172543 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b871ef5-b0ab-4756-8474-d75bc12c8c99 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:52.190308 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 984/1984] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:02:52.191821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b871ef5-b0ab-4756-8474-d75bc12c8c99 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:52.205370 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b871ef5-b0ab-4756-8474-d75bc12c8c99 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:52.217561 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88b340-cfc5-4168-9d29-f7e77583a317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:52.217561 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88b340-cfc5-4168-9d29-f7e77583a317 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:52.217561 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88b340-cfc5-4168-9d29-f7e77583a317 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:52.217561 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88b340-cfc5-4168-9d29-f7e77583a317 admin admin] PATH_INFO: `/v3/projects/b1e9fabd1b8841d0ae58aa27b5550a81/users/093f19c1da8444ca9ad7ed4b75e2f260/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:52.244757 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88b340-cfc5-4168-9d29-f7e77583a317 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1e9fabd1b8841d0ae58aa27b5550a81, user_id=093f19c1da8444ca9ad7ed4b75e2f260, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:52.244907 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1001/1985] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:52 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:52.251680 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88b340-cfc5-4168-9d29-f7e77583a317 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:52.251847 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6370f2-98ca-4933-9a66-57566713248b admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:52.326895 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6370f2-98ca-4933-9a66-57566713248b admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:52.332769 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0d30b-eb88-4db3-97e7-6973af7a6fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:52.333503 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0d30b-eb88-4db3-97e7-6973af7a6fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:52.333729 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0d30b-eb88-4db3-97e7-6973af7a6fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:52.334209 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d0d30b-eb88-4db3-97e7-6973af7a6fa2 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:52.334697 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0d30b-eb88-4db3-97e7-6973af7a6fa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:52.336695 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d0d30b-eb88-4db3-97e7-6973af7a6fa2 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:52.340107 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 985/1986] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:52 2022] PUT /identity/v3/projects/b1e9fabd1b8841d0ae58aa27b5550a81/users/093f19c1da8444ca9ad7ed4b75e2f260/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:52.341182 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88b340-cfc5-4168-9d29-f7e77583a317 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:52.409890 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88b340-cfc5-4168-9d29-f7e77583a317 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:52.414850 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fa1ad-15bf-427c-aa98-13b571148b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:52.415559 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fa1ad-15bf-427c-aa98-13b571148b5c admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:52.415837 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fa1ad-15bf-427c-aa98-13b571148b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:52.416105 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5fa1ad-15bf-427c-aa98-13b571148b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:52.416868 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fa1ad-15bf-427c-aa98-13b571148b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:52.419130 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5fa1ad-15bf-427c-aa98-13b571148b5c admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:52.430949 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 986/1987] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:52.435060 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1002/1988] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:52 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:52.435736 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fa1ad-15bf-427c-aa98-13b571148b5c admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:52.439188 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0d30b-eb88-4db3-97e7-6973af7a6fa2 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:52.449198 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5fa1ad-15bf-427c-aa98-13b571148b5c admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:52.449776 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d0d30b-eb88-4db3-97e7-6973af7a6fa2 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:52.455008 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a591d-0ff2-4187-a922-8a18c1057fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:52.455192 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9086ed-0bd6-4654-b708-4c9df7d12b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:52.455575 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a591d-0ff2-4187-a922-8a18c1057fbe admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:52.455912 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a591d-0ff2-4187-a922-8a18c1057fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:52.456021 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9086ed-0bd6-4654-b708-4c9df7d12b35 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:52.456118 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a591d-0ff2-4187-a922-8a18c1057fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:52.456210 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9086ed-0bd6-4654-b708-4c9df7d12b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:52.456584 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9086ed-0bd6-4654-b708-4c9df7d12b35 admin admin] PATH_INFO: `/v3/projects/b1e9fabd1b8841d0ae58aa27b5550a81/users/093f19c1da8444ca9ad7ed4b75e2f260/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:52.456854 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a591d-0ff2-4187-a922-8a18c1057fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:52.458502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a591d-0ff2-4187-a922-8a18c1057fbe admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:52.458611 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9086ed-0bd6-4654-b708-4c9df7d12b35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1e9fabd1b8841d0ae58aa27b5550a81, user_id=093f19c1da8444ca9ad7ed4b75e2f260, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:52.462023 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9086ed-0bd6-4654-b708-4c9df7d12b35 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:52.472704 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1003/1989] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:52.473825 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a591d-0ff2-4187-a922-8a18c1057fbe admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:52.489209 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 987/1990] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:52 2022] PUT /identity/v3/projects/b1e9fabd1b8841d0ae58aa27b5550a81/users/093f19c1da8444ca9ad7ed4b75e2f260/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:52.489466 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a591d-0ff2-4187-a922-8a18c1057fbe admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:52.491823 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da3fdd-3b4d-451a-8fa4-e570c0cd10b3 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:52.492325 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da3fdd-3b4d-451a-8fa4-e570c0cd10b3 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:52.492610 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da3fdd-3b4d-451a-8fa4-e570c0cd10b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:52.521530 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-36da3fdd-3b4d-451a-8fa4-e570c0cd10b3 None None] MFA Rules not processed for user `093f19c1da8444ca9ad7ed4b75e2f260`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:52.524200 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-36da3fdd-3b4d-451a-8fa4-e570c0cd10b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:52.548529 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f734c-8e3f-4db1-850b-dceaccfa3369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:52.549474 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f734c-8e3f-4db1-850b-dceaccfa3369 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:52.549934 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f734c-8e3f-4db1-850b-dceaccfa3369 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:52.550549 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f734c-8e3f-4db1-850b-dceaccfa3369 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:52.551797 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f734c-8e3f-4db1-850b-dceaccfa3369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:52.553690 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f734c-8e3f-4db1-850b-dceaccfa3369 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:52.568126 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1004/1991] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:52.569203 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f734c-8e3f-4db1-850b-dceaccfa3369 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:52.580207 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f734c-8e3f-4db1-850b-dceaccfa3369 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:52.585302 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ec914-da37-4018-9028-f8ec48040051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:52.586154 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ec914-da37-4018-9028-f8ec48040051 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:52.586613 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ec914-da37-4018-9028-f8ec48040051 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:52.586722 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ec914-da37-4018-9028-f8ec48040051 admin admin] PATH_INFO: `/v3/projects/0e5d5a664c1a44f2ac7fc9c3812acd2d/users/924f411197da483e9bc11ac9c97e3a3f/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:52.602514 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ec914-da37-4018-9028-f8ec48040051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e5d5a664c1a44f2ac7fc9c3812acd2d, user_id=924f411197da483e9bc11ac9c97e3a3f, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:52.605930 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ec914-da37-4018-9028-f8ec48040051 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:52.607473 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 988/1992] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:52.615505 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da3fdd-3b4d-451a-8fa4-e570c0cd10b3 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:52.617157 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-36da3fdd-3b4d-451a-8fa4-e570c0cd10b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:52.674345 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da3fdd-3b4d-451a-8fa4-e570c0cd10b3 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:52.677975 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e3502b-89a4-40e3-804a-ec306ad7ac4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:52.678583 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3502b-89a4-40e3-804a-ec306ad7ac4f service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:52.678885 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3502b-89a4-40e3-804a-ec306ad7ac4f service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:52.679165 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e3502b-89a4-40e3-804a-ec306ad7ac4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:52.688305 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3502b-89a4-40e3-804a-ec306ad7ac4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:52.689730 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e3502b-89a4-40e3-804a-ec306ad7ac4f service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:52.700632 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 989/1993] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:02:52.704053 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1005/1994] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:52 2022] PUT /identity/v3/projects/0e5d5a664c1a44f2ac7fc9c3812acd2d/users/924f411197da483e9bc11ac9c97e3a3f/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:52.714467 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f358d91-5b1c-4fe3-977c-62c23e3ddfcc None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:52.714768 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f358d91-5b1c-4fe3-977c-62c23e3ddfcc None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:52.715108 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f358d91-5b1c-4fe3-977c-62c23e3ddfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:52.750148 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-8f358d91-5b1c-4fe3-977c-62c23e3ddfcc None None] MFA Rules not processed for user `924f411197da483e9bc11ac9c97e3a3f`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:52.751137 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-8f358d91-5b1c-4fe3-977c-62c23e3ddfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:52.782178 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ec914-da37-4018-9028-f8ec48040051 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:52.829621 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 990/1995] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:52.833725 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f358d91-5b1c-4fe3-977c-62c23e3ddfcc None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:52.846380 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ec914-da37-4018-9028-f8ec48040051 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:52.852959 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b961c12-882d-4dcf-8368-34a18ff6ae05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:52.853914 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b961c12-882d-4dcf-8368-34a18ff6ae05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:52.854192 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b961c12-882d-4dcf-8368-34a18ff6ae05 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:52.854513 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b961c12-882d-4dcf-8368-34a18ff6ae05 admin admin] PATH_INFO: `/v3/users/b1d580b8e7954c3da72f27cfb2e6786b` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:52.855831 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b961c12-882d-4dcf-8368-34a18ff6ae05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1d580b8e7954c3da72f27cfb2e6786b)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:52.858059 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b961c12-882d-4dcf-8368-34a18ff6ae05 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:52.903876 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f358d91-5b1c-4fe3-977c-62c23e3ddfcc None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:52.908575 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b430c-9809-413a-a558-b2e42c37d996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:52.909226 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b430c-9809-413a-a558-b2e42c37d996 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:52.909504 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b430c-9809-413a-a558-b2e42c37d996 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:52.909816 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b430c-9809-413a-a558-b2e42c37d996 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:52.910575 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b430c-9809-413a-a558-b2e42c37d996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:52.912687 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b430c-9809-413a-a558-b2e42c37d996 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:52.976846 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 991/1996] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:52 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:52.978707 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6b961c12-882d-4dcf-8368-34a18ff6ae05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1d580b8e7954c3da72f27cfb2e6786b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:52.980516 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b430c-9809-413a-a558-b2e42c37d996 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:52.985843 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6b961c12-882d-4dcf-8368-34a18ff6ae05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1d580b8e7954c3da72f27cfb2e6786b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:53.039236 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6b961c12-882d-4dcf-8368-34a18ff6ae05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1d580b8e7954c3da72f27cfb2e6786b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:53.039920 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6b961c12-882d-4dcf-8368-34a18ff6ae05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1d580b8e7954c3da72f27cfb2e6786b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:53.041791 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b430c-9809-413a-a558-b2e42c37d996 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:53.047282 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca32467-050d-414c-965d-e235106f015e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:53.047949 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca32467-050d-414c-965d-e235106f015e admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:53.048231 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca32467-050d-414c-965d-e235106f015e admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:53.048532 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca32467-050d-414c-965d-e235106f015e admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:53.049219 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca32467-050d-414c-965d-e235106f015e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:53.051299 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca32467-050d-414c-965d-e235106f015e admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:53.053252 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6b961c12-882d-4dcf-8368-34a18ff6ae05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1d580b8e7954c3da72f27cfb2e6786b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:53.059945 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1006/1997] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:52 2022] DELETE /identity/v3/users/b1d580b8e7954c3da72f27cfb2e6786b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:53.064302 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b73ce-dbb0-4429-8f5a-91b81e37b80f None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:53.064586 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b73ce-dbb0-4429-8f5a-91b81e37b80f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:53.064860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b73ce-dbb0-4429-8f5a-91b81e37b80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:53.081725 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-9d9b73ce-dbb0-4429-8f5a-91b81e37b80f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:53.083721 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-9d9b73ce-dbb0-4429-8f5a-91b81e37b80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:53.139741 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1007/1998] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:53.149546 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b73ce-dbb0-4429-8f5a-91b81e37b80f None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:53.151068 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-9d9b73ce-dbb0-4429-8f5a-91b81e37b80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:53.172633 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 992/1999] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:52 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:53.184550 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca32467-050d-414c-965d-e235106f015e admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:53.186504 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-0ca32467-050d-414c-965d-e235106f015e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:53.200373 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca32467-050d-414c-965d-e235106f015e admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:53.205046 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea2533-5a02-42ab-af41-37bc700c25f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:53.210339 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea2533-5a02-42ab-af41-37bc700c25f5 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:53.210339 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea2533-5a02-42ab-af41-37bc700c25f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:53.210339 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea2533-5a02-42ab-af41-37bc700c25f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:53.210339 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea2533-5a02-42ab-af41-37bc700c25f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:53.210339 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea2533-5a02-42ab-af41-37bc700c25f5 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:53.210678 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b73ce-dbb0-4429-8f5a-91b81e37b80f None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:53.213266 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352fa27-95b0-4dd5-8f31-13d999954872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:53.213955 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352fa27-95b0-4dd5-8f31-13d999954872 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:53.214236 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352fa27-95b0-4dd5-8f31-13d999954872 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:53.214517 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352fa27-95b0-4dd5-8f31-13d999954872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:53.220174 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 993/2000] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:53.223860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352fa27-95b0-4dd5-8f31-13d999954872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:53.223986 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea2533-5a02-42ab-af41-37bc700c25f5 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:53.225307 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352fa27-95b0-4dd5-8f31-13d999954872 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:53.233942 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea2533-5a02-42ab-af41-37bc700c25f5 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:53.235155 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1008/2001] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:02:53.242416 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd95a56-f807-4504-a0d3-60be04d3ce12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:53.243104 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd95a56-f807-4504-a0d3-60be04d3ce12 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:53.243385 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd95a56-f807-4504-a0d3-60be04d3ce12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:53.243660 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd95a56-f807-4504-a0d3-60be04d3ce12 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:53.244382 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd95a56-f807-4504-a0d3-60be04d3ce12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:53.246502 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd95a56-f807-4504-a0d3-60be04d3ce12 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:53.257684 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 994/2002] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:02:53.262478 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352fa27-95b0-4dd5-8f31-13d999954872 service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:53.272231 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352fa27-95b0-4dd5-8f31-13d999954872 service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:53.277960 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb174a-be58-4152-bdb0-3e882008c68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:53.279103 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb174a-be58-4152-bdb0-3e882008c68c admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:53.279977 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb174a-be58-4152-bdb0-3e882008c68c admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:53.280533 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb174a-be58-4152-bdb0-3e882008c68c admin admin] PATH_INFO: `/v3/projects/bf13bb60be564682a670f599ba39d915/users/d5294796ae2c457cab1442fd4187904a/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:53.304179 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb174a-be58-4152-bdb0-3e882008c68c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf13bb60be564682a670f599ba39d915, user_id=d5294796ae2c457cab1442fd4187904a, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:53.310105 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb174a-be58-4152-bdb0-3e882008c68c admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:53.374250 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1009/2003] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:53 2022] PUT /identity/v3/projects/bf13bb60be564682a670f599ba39d915/users/d5294796ae2c457cab1442fd4187904a/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:53.387796 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bd496-94e5-4660-aa09-216eca9c5f3c None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:53.388803 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bd496-94e5-4660-aa09-216eca9c5f3c None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:53.389653 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3bd496-94e5-4660-aa09-216eca9c5f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:53.447750 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-ce3bd496-94e5-4660-aa09-216eca9c5f3c None None] MFA Rules not processed for user `d5294796ae2c457cab1442fd4187904a`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:53.449139 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ce3bd496-94e5-4660-aa09-216eca9c5f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:53.530908 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 995/2004] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:53.536510 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb174a-be58-4152-bdb0-3e882008c68c admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:53.608963 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb174a-be58-4152-bdb0-3e882008c68c admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:53.614300 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08075e1b-5ab1-48a7-b27a-ca3463ada89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:53.615075 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08075e1b-5ab1-48a7-b27a-ca3463ada89b admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:53.615429 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08075e1b-5ab1-48a7-b27a-ca3463ada89b admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:53.615775 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08075e1b-5ab1-48a7-b27a-ca3463ada89b admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:53.616530 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08075e1b-5ab1-48a7-b27a-ca3463ada89b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:53.618452 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08075e1b-5ab1-48a7-b27a-ca3463ada89b admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:53.713239 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1010/2005] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:53 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:53.716039 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bd496-94e5-4660-aa09-216eca9c5f3c None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:53.727131 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3bd496-94e5-4660-aa09-216eca9c5f3c None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:53.789714 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08075e1b-5ab1-48a7-b27a-ca3463ada89b admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:53.790857 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfed77-7c91-4da1-bd1b-b4d9dcc3c973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:53.791542 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfed77-7c91-4da1-bd1b-b4d9dcc3c973 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:53.791819 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfed77-7c91-4da1-bd1b-b4d9dcc3c973 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:53.791979 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-08075e1b-5ab1-48a7-b27a-ca3463ada89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:53.792117 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfed77-7c91-4da1-bd1b-b4d9dcc3c973 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:53.792831 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfed77-7c91-4da1-bd1b-b4d9dcc3c973 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:53.794777 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfed77-7c91-4da1-bd1b-b4d9dcc3c973 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:53.812973 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08075e1b-5ab1-48a7-b27a-ca3463ada89b admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:53.818078 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b0583-4424-48d3-9a75-23ea0071d6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:53.818977 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b0583-4424-48d3-9a75-23ea0071d6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:53.819260 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b0583-4424-48d3-9a75-23ea0071d6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:53.819533 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b0583-4424-48d3-9a75-23ea0071d6ea admin admin] PATH_INFO: `/v3/projects/5d5e4c2fcb124f1ea73ec8a8a5110941` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:53.820932 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b0583-4424-48d3-9a75-23ea0071d6ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d5e4c2fcb124f1ea73ec8a8a5110941)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:53.822820 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b0583-4424-48d3-9a75-23ea0071d6ea admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:53.866528 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 996/2006] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:53 2022] POST /identity/v3/users => generated 298 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:53.867622 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfed77-7c91-4da1-bd1b-b4d9dcc3c973 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:53.883381 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfed77-7c91-4da1-bd1b-b4d9dcc3c973 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:53.886485 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23c259-ca84-44ab-b797-a4e793fbc5df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:53.887185 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23c259-ca84-44ab-b797-a4e793fbc5df admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:53.887464 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23c259-ca84-44ab-b797-a4e793fbc5df admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:53.887735 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23c259-ca84-44ab-b797-a4e793fbc5df admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:53.888468 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23c259-ca84-44ab-b797-a4e793fbc5df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:53.890056 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23c259-ca84-44ab-b797-a4e793fbc5df admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:53.902865 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 997/2007] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:02:53.904212 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23c259-ca84-44ab-b797-a4e793fbc5df admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:53.913882 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23c259-ca84-44ab-b797-a4e793fbc5df admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:53.919974 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307aba0-c392-4a0d-bc97-60c32733d982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:53.919974 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307aba0-c392-4a0d-bc97-60c32733d982 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:53.919974 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307aba0-c392-4a0d-bc97-60c32733d982 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:53.920273 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6307aba0-c392-4a0d-bc97-60c32733d982 admin admin] PATH_INFO: `/v3/projects/d5a9832efa624730aa8f894fc479b154/users/ea2a581295fd40738e9c9daa13e856fc/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:53.935147 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307aba0-c392-4a0d-bc97-60c32733d982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a9832efa624730aa8f894fc479b154, user_id=ea2a581295fd40738e9c9daa13e856fc, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:53.937830 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6307aba0-c392-4a0d-bc97-60c32733d982 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:54.011479 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 998/2008] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:53 2022] PUT /identity/v3/projects/d5a9832efa624730aa8f894fc479b154/users/ea2a581295fd40738e9c9daa13e856fc/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:54.015440 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307aba0-c392-4a0d-bc97-60c32733d982 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:54.020330 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-f64b0583-4424-48d3-9a75-23ea0071d6ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d5e4c2fcb124f1ea73ec8a8a5110941', 'request_id': 'req-f64b0583-4424-48d3-9a75-23ea0071d6ea'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:54.027384 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-f64b0583-4424-48d3-9a75-23ea0071d6ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d5e4c2fcb124f1ea73ec8a8a5110941', 'request_id': 'req-f64b0583-4424-48d3-9a75-23ea0071d6ea'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:54.078334 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6307aba0-c392-4a0d-bc97-60c32733d982 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:54.096379 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-f64b0583-4424-48d3-9a75-23ea0071d6ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d5e4c2fcb124f1ea73ec8a8a5110941', 'request_id': 'req-f64b0583-4424-48d3-9a75-23ea0071d6ea'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:54.108757 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-f64b0583-4424-48d3-9a75-23ea0071d6ea admin admin] The token cache is being invalidate because project 5d5e4c2fcb124f1ea73ec8a8a5110941 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:54.109144 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-f64b0583-4424-48d3-9a75-23ea0071d6ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:54.110394 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-f64b0583-4424-48d3-9a75-23ea0071d6ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:54.111982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1011/2009] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:53 2022] DELETE /identity/v3/projects/5d5e4c2fcb124f1ea73ec8a8a5110941 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:54.115800 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b0583-4424-48d3-9a75-23ea0071d6ea admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:54.117296 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-f64b0583-4424-48d3-9a75-23ea0071d6ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:54.133063 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16274a7-3134-4564-8960-ae141fd50337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:54.133725 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16274a7-3134-4564-8960-ae141fd50337 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:54.134006 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16274a7-3134-4564-8960-ae141fd50337 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:54.134278 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16274a7-3134-4564-8960-ae141fd50337 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:54.135044 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16274a7-3134-4564-8960-ae141fd50337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:54.137183 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16274a7-3134-4564-8960-ae141fd50337 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:54.147145 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 999/2010] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:02:54.150914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16274a7-3134-4564-8960-ae141fd50337 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:54.153971 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-f16274a7-3134-4564-8960-ae141fd50337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:54.165816 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16274a7-3134-4564-8960-ae141fd50337 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:54.171375 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b055c07-a706-4c4f-ab7f-af2c1e75f829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:54.172373 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b055c07-a706-4c4f-ab7f-af2c1e75f829 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:54.172733 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b055c07-a706-4c4f-ab7f-af2c1e75f829 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:54.172919 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b055c07-a706-4c4f-ab7f-af2c1e75f829 admin admin] PATH_INFO: `/v3/projects/d5a9832efa624730aa8f894fc479b154/users/ea2a581295fd40738e9c9daa13e856fc/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:54.174902 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b055c07-a706-4c4f-ab7f-af2c1e75f829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a9832efa624730aa8f894fc479b154, user_id=ea2a581295fd40738e9c9daa13e856fc, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:54.177535 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b055c07-a706-4c4f-ab7f-af2c1e75f829 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:54.184324 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b0583-4424-48d3-9a75-23ea0071d6ea admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:54.188868 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1000/2011] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:54 2022] PUT /identity/v3/projects/d5a9832efa624730aa8f894fc479b154/users/ea2a581295fd40738e9c9daa13e856fc/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:54.198603 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa3438-80f0-4ebc-8ee0-80645e4e34a1 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:54.198919 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa3438-80f0-4ebc-8ee0-80645e4e34a1 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:54.199197 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfa3438-80f0-4ebc-8ee0-80645e4e34a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:54.227015 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-cbfa3438-80f0-4ebc-8ee0-80645e4e34a1 None None] MFA Rules not processed for user `ea2a581295fd40738e9c9daa13e856fc`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:54.228211 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-cbfa3438-80f0-4ebc-8ee0-80645e4e34a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:54.246244 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54feec71-a48a-440d-bafd-0a1ccf495d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:54.247016 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54feec71-a48a-440d-bafd-0a1ccf495d56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:54.247303 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54feec71-a48a-440d-bafd-0a1ccf495d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:54.247574 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54feec71-a48a-440d-bafd-0a1ccf495d56 admin admin] PATH_INFO: `/v3/users/093f19c1da8444ca9ad7ed4b75e2f260` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:54.248912 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54feec71-a48a-440d-bafd-0a1ccf495d56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=093f19c1da8444ca9ad7ed4b75e2f260)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:54.250879 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54feec71-a48a-440d-bafd-0a1ccf495d56 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:54.299618 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1001/2012] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:54 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:54.311631 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa3438-80f0-4ebc-8ee0-80645e4e34a1 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:54.312982 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-cbfa3438-80f0-4ebc-8ee0-80645e4e34a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:54.368097 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfa3438-80f0-4ebc-8ee0-80645e4e34a1 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:54.372690 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85722e-8c79-4900-97c9-4f18719ebf1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:54.373418 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85722e-8c79-4900-97c9-4f18719ebf1b service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:54.373699 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85722e-8c79-4900-97c9-4f18719ebf1b service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:54.373972 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85722e-8c79-4900-97c9-4f18719ebf1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:54.376180 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-7d85722e-8c79-4900-97c9-4f18719ebf1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:54.438706 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85722e-8c79-4900-97c9-4f18719ebf1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:54.440192 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d85722e-8c79-4900-97c9-4f18719ebf1b service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:54.441735 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-54feec71-a48a-440d-bafd-0a1ccf495d56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093f19c1da8444ca9ad7ed4b75e2f260'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:54.451176 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-54feec71-a48a-440d-bafd-0a1ccf495d56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093f19c1da8444ca9ad7ed4b75e2f260'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:54.453540 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1002/2013] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:02:54.454435 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85722e-8c79-4900-97c9-4f18719ebf1b service cinder] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:54.455838 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-7d85722e-8c79-4900-97c9-4f18719ebf1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:54.473045 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85722e-8c79-4900-97c9-4f18719ebf1b service cinder] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:54.478121 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae57e7-cca3-4349-a49e-88637b9f19ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:54.479142 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae57e7-cca3-4349-a49e-88637b9f19ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:54.480164 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae57e7-cca3-4349-a49e-88637b9f19ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:54.480478 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae57e7-cca3-4349-a49e-88637b9f19ce admin admin] PATH_INFO: `/v3/users/cc2c179ab0e24fb09d97385cf0894428` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:54.482002 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae57e7-cca3-4349-a49e-88637b9f19ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc2c179ab0e24fb09d97385cf0894428)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:54.484144 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae57e7-cca3-4349-a49e-88637b9f19ce admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:54.514027 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-54feec71-a48a-440d-bafd-0a1ccf495d56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093f19c1da8444ca9ad7ed4b75e2f260'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:54.514669 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-54feec71-a48a-440d-bafd-0a1ccf495d56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093f19c1da8444ca9ad7ed4b75e2f260'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:54.528049 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-54feec71-a48a-440d-bafd-0a1ccf495d56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093f19c1da8444ca9ad7ed4b75e2f260'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:54.534941 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1012/2014] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:54 2022] DELETE /identity/v3/users/093f19c1da8444ca9ad7ed4b75e2f260 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:54.655278 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-7fae57e7-cca3-4349-a49e-88637b9f19ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc2c179ab0e24fb09d97385cf0894428'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:54.748030 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-7fae57e7-cca3-4349-a49e-88637b9f19ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc2c179ab0e24fb09d97385cf0894428'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:54.749090 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-7fae57e7-cca3-4349-a49e-88637b9f19ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc2c179ab0e24fb09d97385cf0894428'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:54.762581 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-7fae57e7-cca3-4349-a49e-88637b9f19ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc2c179ab0e24fb09d97385cf0894428'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:54.790335 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-7fae57e7-cca3-4349-a49e-88637b9f19ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc2c179ab0e24fb09d97385cf0894428'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:54.801946 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1003/2015] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:54 2022] DELETE /identity/v3/users/cc2c179ab0e24fb09d97385cf0894428 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:55.155921 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54feec71-a48a-440d-bafd-0a1ccf495d56 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:55.158379 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-54feec71-a48a-440d-bafd-0a1ccf495d56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:55.191913 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae57e7-cca3-4349-a49e-88637b9f19ce admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:55.193423 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-7fae57e7-cca3-4349-a49e-88637b9f19ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:55.255202 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54feec71-a48a-440d-bafd-0a1ccf495d56 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:55.260570 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5074e27-0f7d-46aa-b8cd-261567e49119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:55.262016 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5074e27-0f7d-46aa-b8cd-261567e49119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:55.262299 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5074e27-0f7d-46aa-b8cd-261567e49119 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:55.262567 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5074e27-0f7d-46aa-b8cd-261567e49119 admin admin] PATH_INFO: `/v3/projects/b1e9fabd1b8841d0ae58aa27b5550a81` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:55.263785 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5074e27-0f7d-46aa-b8cd-261567e49119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1e9fabd1b8841d0ae58aa27b5550a81)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:55.265707 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5074e27-0f7d-46aa-b8cd-261567e49119 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:55.266366 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae57e7-cca3-4349-a49e-88637b9f19ce admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:55.271085 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3268d-d3fc-4a00-9c8e-ef1a386cb18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:55.271975 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3268d-d3fc-4a00-9c8e-ef1a386cb18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:55.272259 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3268d-d3fc-4a00-9c8e-ef1a386cb18c admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:55.272534 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3268d-d3fc-4a00-9c8e-ef1a386cb18c admin admin] PATH_INFO: `/v3/projects/d37d376de665470ab663729e12178191` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:55.273725 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3268d-d3fc-4a00-9c8e-ef1a386cb18c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d37d376de665470ab663729e12178191)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:55.275693 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3268d-d3fc-4a00-9c8e-ef1a386cb18c admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:55.399142 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-fca3268d-d3fc-4a00-9c8e-ef1a386cb18c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd37d376de665470ab663729e12178191', 'request_id': 'req-fca3268d-d3fc-4a00-9c8e-ef1a386cb18c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:55.400211 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-f5074e27-0f7d-46aa-b8cd-261567e49119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1e9fabd1b8841d0ae58aa27b5550a81', 'request_id': 'req-f5074e27-0f7d-46aa-b8cd-261567e49119'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:55.405613 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-f5074e27-0f7d-46aa-b8cd-261567e49119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1e9fabd1b8841d0ae58aa27b5550a81', 'request_id': 'req-f5074e27-0f7d-46aa-b8cd-261567e49119'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:55.450426 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-fca3268d-d3fc-4a00-9c8e-ef1a386cb18c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd37d376de665470ab663729e12178191', 'request_id': 'req-fca3268d-d3fc-4a00-9c8e-ef1a386cb18c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:55.456000 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-fca3268d-d3fc-4a00-9c8e-ef1a386cb18c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd37d376de665470ab663729e12178191', 'request_id': 'req-fca3268d-d3fc-4a00-9c8e-ef1a386cb18c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:55.466754 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-fca3268d-d3fc-4a00-9c8e-ef1a386cb18c admin admin] The token cache is being invalidate because project d37d376de665470ab663729e12178191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:55.467065 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-fca3268d-d3fc-4a00-9c8e-ef1a386cb18c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:55.467693 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-fca3268d-d3fc-4a00-9c8e-ef1a386cb18c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:55.469230 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1004/2016] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:55 2022] DELETE /identity/v3/projects/d37d376de665470ab663729e12178191 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:55.474232 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37dd17-b3cd-4f7a-9342-9b7656ca9c51 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:55.474521 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37dd17-b3cd-4f7a-9342-9b7656ca9c51 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:55.474801 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37dd17-b3cd-4f7a-9342-9b7656ca9c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:55.490655 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-f5074e27-0f7d-46aa-b8cd-261567e49119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1e9fabd1b8841d0ae58aa27b5550a81', 'request_id': 'req-f5074e27-0f7d-46aa-b8cd-261567e49119'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:55.492912 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-ba37dd17-b3cd-4f7a-9342-9b7656ca9c51 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:55.494127 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ba37dd17-b3cd-4f7a-9342-9b7656ca9c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:55.502384 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-f5074e27-0f7d-46aa-b8cd-261567e49119 admin admin] The token cache is being invalidate because project b1e9fabd1b8841d0ae58aa27b5550a81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:55.502669 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-f5074e27-0f7d-46aa-b8cd-261567e49119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:55.503551 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-f5074e27-0f7d-46aa-b8cd-261567e49119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:55.505097 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1013/2017] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:55 2022] DELETE /identity/v3/projects/b1e9fabd1b8841d0ae58aa27b5550a81 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:55.513201 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e907c2d-a774-4241-a3d3-13075102b182 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:55.513537 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e907c2d-a774-4241-a3d3-13075102b182 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:55.519316 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e907c2d-a774-4241-a3d3-13075102b182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:55.531986 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-3e907c2d-a774-4241-a3d3-13075102b182 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:55.533168 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-3e907c2d-a774-4241-a3d3-13075102b182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:55.556492 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1005/2018] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:55.564500 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae7fcc-d18d-4bbb-aadd-0a79665abee7 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:55.565501 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae7fcc-d18d-4bbb-aadd-0a79665abee7 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:55.565501 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae7fcc-d18d-4bbb-aadd-0a79665abee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:55.582821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-4eae7fcc-d18d-4bbb-aadd-0a79665abee7 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:55.584044 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-4eae7fcc-d18d-4bbb-aadd-0a79665abee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:55.590666 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1014/2019] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:55.592372 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1006/2020] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:55.596557 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e907c2d-a774-4241-a3d3-13075102b182 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:55.598418 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77868d5b-c454-4f32-93d4-26cebb046be5 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:55.598703 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77868d5b-c454-4f32-93d4-26cebb046be5 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:55.599042 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77868d5b-c454-4f32-93d4-26cebb046be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:55.606353 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e907c2d-a774-4241-a3d3-13075102b182 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:55.610930 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76a8d2-f673-4e87-b546-dc7043a20426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:55.611578 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76a8d2-f673-4e87-b546-dc7043a20426 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:55.611858 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76a8d2-f673-4e87-b546-dc7043a20426 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:55.612128 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec76a8d2-f673-4e87-b546-dc7043a20426 admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:55.612873 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76a8d2-f673-4e87-b546-dc7043a20426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:02:55.613173 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76a8d2-f673-4e87-b546-dc7043a20426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:55.614764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec76a8d2-f673-4e87-b546-dc7043a20426 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:55.617106 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-77868d5b-c454-4f32-93d4-26cebb046be5 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:55.618297 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-77868d5b-c454-4f32-93d4-26cebb046be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:55.627065 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1015/2021] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:02:55.627234 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1007/2022] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:55.637038 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76a8d2-f673-4e87-b546-dc7043a20426 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:55.637251 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77868d5b-c454-4f32-93d4-26cebb046be5 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:55.646186 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77868d5b-c454-4f32-93d4-26cebb046be5 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:55.646802 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec76a8d2-f673-4e87-b546-dc7043a20426 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:55.650928 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57ef4b-f44a-463f-b2a8-9571dab0d5ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:55.651467 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8a9d9-f3c2-4b11-8a0e-6a49df273d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:55.651592 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57ef4b-f44a-463f-b2a8-9571dab0d5ba admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:55.656238 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57ef4b-f44a-463f-b2a8-9571dab0d5ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:55.656343 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8a9d9-f3c2-4b11-8a0e-6a49df273d2c admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:55.656428 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a57ef4b-f44a-463f-b2a8-9571dab0d5ba admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:55.656508 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8a9d9-f3c2-4b11-8a0e-6a49df273d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:55.656508 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f8a9d9-f3c2-4b11-8a0e-6a49df273d2c admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:55.656643 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57ef4b-f44a-463f-b2a8-9571dab0d5ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:02:55.656643 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57ef4b-f44a-463f-b2a8-9571dab0d5ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:55.656790 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8a9d9-f3c2-4b11-8a0e-6a49df273d2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:55.656869 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a57ef4b-f44a-463f-b2a8-9571dab0d5ba admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:55.656941 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f8a9d9-f3c2-4b11-8a0e-6a49df273d2c admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:55.666140 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1008/2023] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:02:55.670890 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57ef4b-f44a-463f-b2a8-9571dab0d5ba admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:55.680243 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a57ef4b-f44a-463f-b2a8-9571dab0d5ba admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:55.685337 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f464c-6392-44d6-a931-e68e8e63e45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:55.685958 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f464c-6392-44d6-a931-e68e8e63e45a admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:55.686235 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f464c-6392-44d6-a931-e68e8e63e45a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:55.686510 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f464c-6392-44d6-a931-e68e8e63e45a admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:55.687228 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f464c-6392-44d6-a931-e68e8e63e45a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:55.689080 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f464c-6392-44d6-a931-e68e8e63e45a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:55.743489 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1016/2024] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:55 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:55.748122 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8a9d9-f3c2-4b11-8a0e-6a49df273d2c admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:55.786858 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1009/2025] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:55 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:55.787873 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f464c-6392-44d6-a931-e68e8e63e45a admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:55.807093 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f8a9d9-f3c2-4b11-8a0e-6a49df273d2c admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:55.848256 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f464c-6392-44d6-a931-e68e8e63e45a admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:55.853357 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fccd59-5a57-4a7a-be38-c7cd1ebf16b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:55.854025 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fccd59-5a57-4a7a-be38-c7cd1ebf16b3 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:55.854303 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fccd59-5a57-4a7a-be38-c7cd1ebf16b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:55.855149 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fccd59-5a57-4a7a-be38-c7cd1ebf16b3 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:55.855835 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fccd59-5a57-4a7a-be38-c7cd1ebf16b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:55.858061 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fccd59-5a57-4a7a-be38-c7cd1ebf16b3 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:55.862828 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f41269-0876-4b99-b550-5b17c80d0285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:55.863649 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f41269-0876-4b99-b550-5b17c80d0285 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:55.863933 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f41269-0876-4b99-b550-5b17c80d0285 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:55.864204 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f41269-0876-4b99-b550-5b17c80d0285 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:55.864893 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f41269-0876-4b99-b550-5b17c80d0285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:55.866778 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f41269-0876-4b99-b550-5b17c80d0285 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:55.941686 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1010/2026] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:55 2022] POST /identity/v3/users => generated 295 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:55.943341 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fccd59-5a57-4a7a-be38-c7cd1ebf16b3 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:55.957155 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1017/2027] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:55 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:55.959675 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fccd59-5a57-4a7a-be38-c7cd1ebf16b3 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:55.963857 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f41269-0876-4b99-b550-5b17c80d0285 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:55.967798 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662b648-1ca6-40a0-93e0-490cd83cfed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:55.968516 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662b648-1ca6-40a0-93e0-490cd83cfed6 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:55.968803 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662b648-1ca6-40a0-93e0-490cd83cfed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:55.969172 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3662b648-1ca6-40a0-93e0-490cd83cfed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:55.969913 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662b648-1ca6-40a0-93e0-490cd83cfed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:55.971757 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3662b648-1ca6-40a0-93e0-490cd83cfed6 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:55.975648 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f41269-0876-4b99-b550-5b17c80d0285 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:55.982632 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa9e56-5d28-4cea-903a-e42ae3269ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:55.983459 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa9e56-5d28-4cea-903a-e42ae3269ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:55.983821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1011/2028] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:55.983941 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa9e56-5d28-4cea-903a-e42ae3269ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:55.984353 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afa9e56-5d28-4cea-903a-e42ae3269ed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:55.985169 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa9e56-5d28-4cea-903a-e42ae3269ed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:55.986886 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afa9e56-5d28-4cea-903a-e42ae3269ed5 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:55.987797 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662b648-1ca6-40a0-93e0-490cd83cfed6 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:55.999990 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3662b648-1ca6-40a0-93e0-490cd83cfed6 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:56.000969 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1018/2029] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:56.005074 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce409f48-7435-491d-9946-ae3ed0884b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:56.005421 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa9e56-5d28-4cea-903a-e42ae3269ed5 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:56.006053 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce409f48-7435-491d-9946-ae3ed0884b0d admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:56.006681 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce409f48-7435-491d-9946-ae3ed0884b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:56.007049 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce409f48-7435-491d-9946-ae3ed0884b0d admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:56.007964 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce409f48-7435-491d-9946-ae3ed0884b0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:56.009639 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce409f48-7435-491d-9946-ae3ed0884b0d admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:56.017155 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afa9e56-5d28-4cea-903a-e42ae3269ed5 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:56.021392 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1012/2030] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:02:56.025564 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce409f48-7435-491d-9946-ae3ed0884b0d admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:56.029993 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005f5f4-4372-4605-b05c-3edb87816748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:56.030726 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005f5f4-4372-4605-b05c-3edb87816748 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:56.031050 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005f5f4-4372-4605-b05c-3edb87816748 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:56.031324 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005f5f4-4372-4605-b05c-3edb87816748 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:56.032063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005f5f4-4372-4605-b05c-3edb87816748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:56.033657 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005f5f4-4372-4605-b05c-3edb87816748 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:56.037543 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce409f48-7435-491d-9946-ae3ed0884b0d admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:56.047638 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1019/2031] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:56.054196 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6405f40-852f-4505-8b79-40b46c29b6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:56.054716 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005f5f4-4372-4605-b05c-3edb87816748 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:56.055533 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6405f40-852f-4505-8b79-40b46c29b6d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:56.055981 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6405f40-852f-4505-8b79-40b46c29b6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:56.056289 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6405f40-852f-4505-8b79-40b46c29b6d2 admin admin] PATH_INFO: `/v3/projects/d720866d463a4a6a9a7a0f4855045947/users/f696936a59cc43fda8df1bad3b3fc3d2/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:56.068763 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005f5f4-4372-4605-b05c-3edb87816748 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:56.075895 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6405f40-852f-4505-8b79-40b46c29b6d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d720866d463a4a6a9a7a0f4855045947, user_id=f696936a59cc43fda8df1bad3b3fc3d2, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:56.076278 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651984c-cd08-4845-8593-d07d50acfcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:56.077798 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651984c-cd08-4845-8593-d07d50acfcd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:56.078095 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651984c-cd08-4845-8593-d07d50acfcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:56.078370 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651984c-cd08-4845-8593-d07d50acfcd0 admin admin] PATH_INFO: `/v3/projects/4b203e9b982749909f75aa48edbd937e/users/fac87b9f893a49e782a6cfc004224d92/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:56.078668 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6405f40-852f-4505-8b79-40b46c29b6d2 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:56.095428 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651984c-cd08-4845-8593-d07d50acfcd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b203e9b982749909f75aa48edbd937e, user_id=fac87b9f893a49e782a6cfc004224d92, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:56.098052 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651984c-cd08-4845-8593-d07d50acfcd0 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:56.159700 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1013/2032] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:56 2022] PUT /identity/v3/projects/d720866d463a4a6a9a7a0f4855045947/users/f696936a59cc43fda8df1bad3b3fc3d2/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:56.172208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6548294-eb1b-4247-a7bd-b028c7ddd54d None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:56.173039 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6548294-eb1b-4247-a7bd-b028c7ddd54d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:56.173039 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6548294-eb1b-4247-a7bd-b028c7ddd54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:56.193200 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1020/2033] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:56 2022] PUT /identity/v3/projects/4b203e9b982749909f75aa48edbd937e/users/fac87b9f893a49e782a6cfc004224d92/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:02:56.194719 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bf4a6-5c78-4db8-98e7-d77403312493 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:56.195028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bf4a6-5c78-4db8-98e7-d77403312493 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:56.195304 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383bf4a6-5c78-4db8-98e7-d77403312493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:56.220116 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-b6548294-eb1b-4247-a7bd-b028c7ddd54d None None] MFA Rules not processed for user `f696936a59cc43fda8df1bad3b3fc3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:56.222262 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-b6548294-eb1b-4247-a7bd-b028c7ddd54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:56.223419 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-383bf4a6-5c78-4db8-98e7-d77403312493 None None] MFA Rules not processed for user `fac87b9f893a49e782a6cfc004224d92`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:56.224767 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-383bf4a6-5c78-4db8-98e7-d77403312493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:56.298692 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1021/2034] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:56.310479 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1014/2035] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:56.310705 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bf4a6-5c78-4db8-98e7-d77403312493 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:56.312137 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-383bf4a6-5c78-4db8-98e7-d77403312493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:56.314523 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6548294-eb1b-4247-a7bd-b028c7ddd54d None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:56.379287 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6548294-eb1b-4247-a7bd-b028c7ddd54d None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:56.383946 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d295043-2205-40ac-81bf-cd5567ce00ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:56.384589 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d295043-2205-40ac-81bf-cd5567ce00ae admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:56.385059 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d295043-2205-40ac-81bf-cd5567ce00ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:56.385337 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d295043-2205-40ac-81bf-cd5567ce00ae admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:56.386043 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d295043-2205-40ac-81bf-cd5567ce00ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:56.388132 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d295043-2205-40ac-81bf-cd5567ce00ae admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:56.389730 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383bf4a6-5c78-4db8-98e7-d77403312493 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:56.395879 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbb27f-6d28-452c-a5e0-a96451253064 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:56.396531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbb27f-6d28-452c-a5e0-a96451253064 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:56.396802 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbb27f-6d28-452c-a5e0-a96451253064 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:56.397081 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbb27f-6d28-452c-a5e0-a96451253064 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:56.405486 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbb27f-6d28-452c-a5e0-a96451253064 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:56.407094 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbb27f-6d28-452c-a5e0-a96451253064 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:56.415863 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1022/2036] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:02:56.464821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1015/2037] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:56 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:02:56.468541 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbb27f-6d28-452c-a5e0-a96451253064 service nova] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:56.478865 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbb27f-6d28-452c-a5e0-a96451253064 service nova] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:56.549292 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10428550-edfc-4cd7-b6f1-d636d99bae41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:56.549972 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10428550-edfc-4cd7-b6f1-d636d99bae41 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:56.550306 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10428550-edfc-4cd7-b6f1-d636d99bae41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:56.550589 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10428550-edfc-4cd7-b6f1-d636d99bae41 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:56.551360 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10428550-edfc-4cd7-b6f1-d636d99bae41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:56.553349 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10428550-edfc-4cd7-b6f1-d636d99bae41 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:56.650122 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1023/2038] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:56 2022] POST /identity/v3/users => generated 300 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:56.652051 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d295043-2205-40ac-81bf-cd5567ce00ae admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:56.663574 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d295043-2205-40ac-81bf-cd5567ce00ae admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:56.668685 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbda7fb-4ee9-4cc4-8c84-7556a5300aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:56.669373 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbda7fb-4ee9-4cc4-8c84-7556a5300aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:56.669652 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbda7fb-4ee9-4cc4-8c84-7556a5300aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:56.669925 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbda7fb-4ee9-4cc4-8c84-7556a5300aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:56.670664 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbda7fb-4ee9-4cc4-8c84-7556a5300aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:56.672364 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbda7fb-4ee9-4cc4-8c84-7556a5300aa4 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:56.687275 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1016/2039] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:56.688635 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10428550-edfc-4cd7-b6f1-d636d99bae41 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:56.699981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10428550-edfc-4cd7-b6f1-d636d99bae41 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:56.705273 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06619690-e715-4890-8e07-70f1fc2d9f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:56.706341 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06619690-e715-4890-8e07-70f1fc2d9f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:56.707041 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06619690-e715-4890-8e07-70f1fc2d9f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:56.707041 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06619690-e715-4890-8e07-70f1fc2d9f3e admin admin] PATH_INFO: `/v3/projects/56cbeede5cc44507b185bfd804591635/users/c88b3d79bf224c74b68bc9314de68e0f/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:56.723124 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06619690-e715-4890-8e07-70f1fc2d9f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=56cbeede5cc44507b185bfd804591635, user_id=c88b3d79bf224c74b68bc9314de68e0f, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:56.725873 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06619690-e715-4890-8e07-70f1fc2d9f3e admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:56.788763 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1024/2040] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:56 2022] PUT /identity/v3/projects/56cbeede5cc44507b185bfd804591635/users/c88b3d79bf224c74b68bc9314de68e0f/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:56.792804 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbda7fb-4ee9-4cc4-8c84-7556a5300aa4 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:56.802698 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbda7fb-4ee9-4cc4-8c84-7556a5300aa4 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:56.861092 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3789326-9070-4d00-ab7a-4735f2376c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:56.862963 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3789326-9070-4d00-ab7a-4735f2376c92 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:56.863249 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3789326-9070-4d00-ab7a-4735f2376c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:56.863525 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3789326-9070-4d00-ab7a-4735f2376c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:56.864262 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3789326-9070-4d00-ab7a-4735f2376c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:56.865868 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3789326-9070-4d00-ab7a-4735f2376c92 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:56.876852 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1017/2041] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:56.880817 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06619690-e715-4890-8e07-70f1fc2d9f3e admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:56.892027 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06619690-e715-4890-8e07-70f1fc2d9f3e admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:56.897931 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecb1b6-1123-4fa8-adc0-a17cf87c2414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:56.898970 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecb1b6-1123-4fa8-adc0-a17cf87c2414 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:56.899353 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecb1b6-1123-4fa8-adc0-a17cf87c2414 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:56.899725 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecb1b6-1123-4fa8-adc0-a17cf87c2414 admin admin] PATH_INFO: `/v3/projects/56cbeede5cc44507b185bfd804591635/users/c88b3d79bf224c74b68bc9314de68e0f/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:56.901866 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ecb1b6-1123-4fa8-adc0-a17cf87c2414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56cbeede5cc44507b185bfd804591635, user_id=c88b3d79bf224c74b68bc9314de68e0f, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:56.904757 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ecb1b6-1123-4fa8-adc0-a17cf87c2414 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:56.927807 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1025/2042] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:56 2022] PUT /identity/v3/projects/56cbeede5cc44507b185bfd804591635/users/c88b3d79bf224c74b68bc9314de68e0f/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:56.927998 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a9002-adb7-4bbb-92c2-adbc3e238333 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:56.933258 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a9002-adb7-4bbb-92c2-adbc3e238333 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:56.933258 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a9002-adb7-4bbb-92c2-adbc3e238333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:56.962110 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-316a9002-adb7-4bbb-92c2-adbc3e238333 None None] MFA Rules not processed for user `c88b3d79bf224c74b68bc9314de68e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:56.963484 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-316a9002-adb7-4bbb-92c2-adbc3e238333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:57.036726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1018/2043] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:02:57.044903 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecb1b6-1123-4fa8-adc0-a17cf87c2414 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:57.046598 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-97ecb1b6-1123-4fa8-adc0-a17cf87c2414 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:57.106391 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecb1b6-1123-4fa8-adc0-a17cf87c2414 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:57.110119 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14309a2e-8eaa-4bf1-8ef8-57016dc845bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:57.110795 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14309a2e-8eaa-4bf1-8ef8-57016dc845bd service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:57.111154 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14309a2e-8eaa-4bf1-8ef8-57016dc845bd service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:57.111812 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14309a2e-8eaa-4bf1-8ef8-57016dc845bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:57.121182 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14309a2e-8eaa-4bf1-8ef8-57016dc845bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:57.122676 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14309a2e-8eaa-4bf1-8ef8-57016dc845bd service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:57.139840 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1026/2044] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:02:57.322193 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a9002-adb7-4bbb-92c2-adbc3e238333 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:57.389688 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a9002-adb7-4bbb-92c2-adbc3e238333 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:57.394278 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67466fd9-135f-4838-9545-ddfda8c559b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:57.395166 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67466fd9-135f-4838-9545-ddfda8c559b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:57.395445 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67466fd9-135f-4838-9545-ddfda8c559b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:57.395712 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67466fd9-135f-4838-9545-ddfda8c559b5 admin admin] PATH_INFO: `/v3/users/f696936a59cc43fda8df1bad3b3fc3d2` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:57.396871 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67466fd9-135f-4838-9545-ddfda8c559b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f696936a59cc43fda8df1bad3b3fc3d2)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:57.398766 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67466fd9-135f-4838-9545-ddfda8c559b5 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:57.543764 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-67466fd9-135f-4838-9545-ddfda8c559b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f696936a59cc43fda8df1bad3b3fc3d2'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:57.587410 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-67466fd9-135f-4838-9545-ddfda8c559b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f696936a59cc43fda8df1bad3b3fc3d2'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:57.588022 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-67466fd9-135f-4838-9545-ddfda8c559b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f696936a59cc43fda8df1bad3b3fc3d2'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:57.595700 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-67466fd9-135f-4838-9545-ddfda8c559b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f696936a59cc43fda8df1bad3b3fc3d2'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:57.608155 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-67466fd9-135f-4838-9545-ddfda8c559b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f696936a59cc43fda8df1bad3b3fc3d2'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:57.614020 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1019/2045] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:57 2022] DELETE /identity/v3/users/f696936a59cc43fda8df1bad3b3fc3d2 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:57.618525 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c318a4-adb4-4f58-bbfa-f57150906112 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:57.619032 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c318a4-adb4-4f58-bbfa-f57150906112 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:57.619140 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c318a4-adb4-4f58-bbfa-f57150906112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:57.636215 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-58c318a4-adb4-4f58-bbfa-f57150906112 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:57.637406 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-58c318a4-adb4-4f58-bbfa-f57150906112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:57.693879 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1027/2046] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:57.703495 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67466fd9-135f-4838-9545-ddfda8c559b5 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:57.704873 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-67466fd9-135f-4838-9545-ddfda8c559b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:57.761258 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67466fd9-135f-4838-9545-ddfda8c559b5 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:57.764971 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b67c4-f6fd-465a-99e5-0f3697a5e047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:57.765621 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b67c4-f6fd-465a-99e5-0f3697a5e047 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:57.765899 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b67c4-f6fd-465a-99e5-0f3697a5e047 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:57.766172 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b67c4-f6fd-465a-99e5-0f3697a5e047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:57.776139 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b67c4-f6fd-465a-99e5-0f3697a5e047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:57.778050 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b67c4-f6fd-465a-99e5-0f3697a5e047 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:57.787365 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1020/2047] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:02:58.155976 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c318a4-adb4-4f58-bbfa-f57150906112 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:58.158954 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-58c318a4-adb4-4f58-bbfa-f57150906112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:58.169360 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c318a4-adb4-4f58-bbfa-f57150906112 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:58.173979 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2097b-2b57-421a-95b8-5027c2b2cb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:58.174865 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2097b-2b57-421a-95b8-5027c2b2cb12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:58.175146 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2097b-2b57-421a-95b8-5027c2b2cb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:58.175417 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2097b-2b57-421a-95b8-5027c2b2cb12 admin admin] PATH_INFO: `/v3/projects/d720866d463a4a6a9a7a0f4855045947` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:58.176602 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2097b-2b57-421a-95b8-5027c2b2cb12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d720866d463a4a6a9a7a0f4855045947)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:58.178577 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2097b-2b57-421a-95b8-5027c2b2cb12 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:58.263035 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ccd2097b-2b57-421a-95b8-5027c2b2cb12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd720866d463a4a6a9a7a0f4855045947', 'request_id': 'req-ccd2097b-2b57-421a-95b8-5027c2b2cb12'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:58.268562 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ccd2097b-2b57-421a-95b8-5027c2b2cb12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd720866d463a4a6a9a7a0f4855045947', 'request_id': 'req-ccd2097b-2b57-421a-95b8-5027c2b2cb12'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:58.330222 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ccd2097b-2b57-421a-95b8-5027c2b2cb12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd720866d463a4a6a9a7a0f4855045947', 'request_id': 'req-ccd2097b-2b57-421a-95b8-5027c2b2cb12'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:58.341331 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ccd2097b-2b57-421a-95b8-5027c2b2cb12 admin admin] The token cache is being invalidate because project d720866d463a4a6a9a7a0f4855045947 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:58.341612 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ccd2097b-2b57-421a-95b8-5027c2b2cb12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:58.342261 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ccd2097b-2b57-421a-95b8-5027c2b2cb12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:58.343838 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1028/2048] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:58 2022] DELETE /identity/v3/projects/d720866d463a4a6a9a7a0f4855045947 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:58.347831 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b67c4-f6fd-465a-99e5-0f3697a5e047 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:58.358119 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b67c4-f6fd-465a-99e5-0f3697a5e047 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:58.413614 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254c742c-27b9-4e3b-b013-95e60e000354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:58.414397 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c742c-27b9-4e3b-b013-95e60e000354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:58.414683 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c742c-27b9-4e3b-b013-95e60e000354 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:58.414990 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254c742c-27b9-4e3b-b013-95e60e000354 admin admin] PATH_INFO: `/v3/users/c88b3d79bf224c74b68bc9314de68e0f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:58.416172 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c742c-27b9-4e3b-b013-95e60e000354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c88b3d79bf224c74b68bc9314de68e0f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:58.418218 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254c742c-27b9-4e3b-b013-95e60e000354 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:58.635111 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-254c742c-27b9-4e3b-b013-95e60e000354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c88b3d79bf224c74b68bc9314de68e0f'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:58.685053 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-254c742c-27b9-4e3b-b013-95e60e000354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c88b3d79bf224c74b68bc9314de68e0f'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:58.685607 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-254c742c-27b9-4e3b-b013-95e60e000354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c88b3d79bf224c74b68bc9314de68e0f'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:58.693037 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-254c742c-27b9-4e3b-b013-95e60e000354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c88b3d79bf224c74b68bc9314de68e0f'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:58.704898 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-254c742c-27b9-4e3b-b013-95e60e000354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c88b3d79bf224c74b68bc9314de68e0f'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:58.710817 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1021/2049] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:02:58 2022] DELETE /identity/v3/users/c88b3d79bf224c74b68bc9314de68e0f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:59.092698 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2097b-2b57-421a-95b8-5027c2b2cb12 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:59.094148 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-ccd2097b-2b57-421a-95b8-5027c2b2cb12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:59.108469 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2097b-2b57-421a-95b8-5027c2b2cb12 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:59.163507 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50590c-7159-4ab8-968a-6e8f02a3eb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:59.164390 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50590c-7159-4ab8-968a-6e8f02a3eb27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:59.164715 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50590c-7159-4ab8-968a-6e8f02a3eb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:59.164980 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50590c-7159-4ab8-968a-6e8f02a3eb27 admin admin] PATH_INFO: `/v3/projects/56cbeede5cc44507b185bfd804591635` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:59.166196 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50590c-7159-4ab8-968a-6e8f02a3eb27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56cbeede5cc44507b185bfd804591635)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:59.168732 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f50590c-7159-4ab8-968a-6e8f02a3eb27 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:59.269284 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-7f50590c-7159-4ab8-968a-6e8f02a3eb27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56cbeede5cc44507b185bfd804591635', 'request_id': 'req-7f50590c-7159-4ab8-968a-6e8f02a3eb27'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:59.274972 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-7f50590c-7159-4ab8-968a-6e8f02a3eb27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56cbeede5cc44507b185bfd804591635', 'request_id': 'req-7f50590c-7159-4ab8-968a-6e8f02a3eb27'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:59.370390 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-7f50590c-7159-4ab8-968a-6e8f02a3eb27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56cbeede5cc44507b185bfd804591635', 'request_id': 'req-7f50590c-7159-4ab8-968a-6e8f02a3eb27'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:59.382318 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-7f50590c-7159-4ab8-968a-6e8f02a3eb27 admin admin] The token cache is being invalidate because project 56cbeede5cc44507b185bfd804591635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:02:59.382769 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-7f50590c-7159-4ab8-968a-6e8f02a3eb27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:59.383496 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-7f50590c-7159-4ab8-968a-6e8f02a3eb27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:02:59.385192 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1029/2050] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:02:59 2022] DELETE /identity/v3/projects/56cbeede5cc44507b185bfd804591635 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:02:59.390520 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14df84-e790-4a03-a2a6-90f482e734e1 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:59.395772 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14df84-e790-4a03-a2a6-90f482e734e1 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:59.395772 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14df84-e790-4a03-a2a6-90f482e734e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:59.411046 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-9e14df84-e790-4a03-a2a6-90f482e734e1 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:59.412231 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-9e14df84-e790-4a03-a2a6-90f482e734e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:59.470999 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1022/2051] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:59.479923 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856099e4-e0a1-4d5a-8b5e-888447b9a554 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:59.480212 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856099e4-e0a1-4d5a-8b5e-888447b9a554 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:59.480485 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856099e4-e0a1-4d5a-8b5e-888447b9a554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:59.498619 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-856099e4-e0a1-4d5a-8b5e-888447b9a554 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:02:59.499934 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-856099e4-e0a1-4d5a-8b5e-888447b9a554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:59.508120 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1030/2052] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:02:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:02:59.516629 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14df84-e790-4a03-a2a6-90f482e734e1 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:59.526930 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14df84-e790-4a03-a2a6-90f482e734e1 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:59.538729 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad9219-8de9-4858-849e-834cb669ac9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:59.539586 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad9219-8de9-4858-849e-834cb669ac9e admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:59.539977 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad9219-8de9-4858-849e-834cb669ac9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:59.540339 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad9219-8de9-4858-849e-834cb669ac9e admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:59.541204 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad9219-8de9-4858-849e-834cb669ac9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:02:59.541644 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad9219-8de9-4858-849e-834cb669ac9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:59.543373 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ad9219-8de9-4858-849e-834cb669ac9e admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:59.556565 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1023/2053] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:02:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:02:59.560584 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856099e4-e0a1-4d5a-8b5e-888447b9a554 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:59.571710 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856099e4-e0a1-4d5a-8b5e-888447b9a554 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:59.577229 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368185b7-92a6-4d35-bffe-5875619acd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:59.578053 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368185b7-92a6-4d35-bffe-5875619acd1c admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:59.578394 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368185b7-92a6-4d35-bffe-5875619acd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:59.578741 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368185b7-92a6-4d35-bffe-5875619acd1c admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:59.589487 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368185b7-92a6-4d35-bffe-5875619acd1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:59.589487 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368185b7-92a6-4d35-bffe-5875619acd1c admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:59.615319 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad9219-8de9-4858-849e-834cb669ac9e admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:59.617061 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-43ad9219-8de9-4858-849e-834cb669ac9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:59.694202 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1031/2054] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:02:59 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:59.695393 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368185b7-92a6-4d35-bffe-5875619acd1c admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:59.699201 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad9219-8de9-4858-849e-834cb669ac9e admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:59.751305 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913a4c0-f7ab-4337-bbb5-40f1583a8cfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:59.751878 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913a4c0-f7ab-4337-bbb5-40f1583a8cfb service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:59.752169 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913a4c0-f7ab-4337-bbb5-40f1583a8cfb service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:59.752430 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913a4c0-f7ab-4337-bbb5-40f1583a8cfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:59.754294 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-3913a4c0-f7ab-4337-bbb5-40f1583a8cfb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:02:59.778877 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368185b7-92a6-4d35-bffe-5875619acd1c admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:59.784106 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5d1ba-d94d-4279-a5f4-89f4d571ecdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:59.784809 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5d1ba-d94d-4279-a5f4-89f4d571ecdb admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:59.785188 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5d1ba-d94d-4279-a5f4-89f4d571ecdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:59.785535 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5d1ba-d94d-4279-a5f4-89f4d571ecdb admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:59.786303 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5d1ba-d94d-4279-a5f4-89f4d571ecdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:59.788724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5d1ba-d94d-4279-a5f4-89f4d571ecdb admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:59.818690 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913a4c0-f7ab-4337-bbb5-40f1583a8cfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:59.820159 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3913a4c0-f7ab-4337-bbb5-40f1583a8cfb service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:59.834205 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1024/2055] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:02:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:02:59.876193 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1032/2056] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:02:59 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:02:59.880531 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913a4c0-f7ab-4337-bbb5-40f1583a8cfb service cinder] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:59.892685 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3913a4c0-f7ab-4337-bbb5-40f1583a8cfb service cinder] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:59.898533 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e7f69-daec-41fd-be81-f04c69073e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:59.899549 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e7f69-daec-41fd-be81-f04c69073e1f admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:59.900092 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e7f69-daec-41fd-be81-f04c69073e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:59.900374 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e7f69-daec-41fd-be81-f04c69073e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:59.901128 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e7f69-daec-41fd-be81-f04c69073e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:59.902755 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e7f69-daec-41fd-be81-f04c69073e1f admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:59.917410 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1025/2057] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:59.923135 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5d1ba-d94d-4279-a5f4-89f4d571ecdb admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:59.929378 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5d1ba-d94d-4279-a5f4-89f4d571ecdb admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:59.938800 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a051c64-58d9-4767-a64d-d0c558df88b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:59.939551 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a051c64-58d9-4767-a64d-d0c558df88b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:59.939897 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a051c64-58d9-4767-a64d-d0c558df88b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:59.940235 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a051c64-58d9-4767-a64d-d0c558df88b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:59.941126 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a051c64-58d9-4767-a64d-d0c558df88b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:59.943216 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a051c64-58d9-4767-a64d-d0c558df88b7 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:02:59.954271 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1033/2058] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:02:59.958431 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e7f69-daec-41fd-be81-f04c69073e1f admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:02:59.968400 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e7f69-daec-41fd-be81-f04c69073e1f admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:02:59.972996 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fab9e-575a-4ac6-9957-d92653f0612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:02:59.973878 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fab9e-575a-4ac6-9957-d92653f0612b admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:02:59.974155 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fab9e-575a-4ac6-9957-d92653f0612b admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:02:59.974422 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fab9e-575a-4ac6-9957-d92653f0612b admin admin] PATH_INFO: `/v3/projects/2995794a7a5240ecaa2077861d3985ba/users/e1bb6fe541114361801debd74e521907/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:02:59.989415 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fab9e-575a-4ac6-9957-d92653f0612b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2995794a7a5240ecaa2077861d3985ba, user_id=e1bb6fe541114361801debd74e521907, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:02:59.992282 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fab9e-575a-4ac6-9957-d92653f0612b admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:00.090731 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1026/2059] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:02:59 2022] PUT /identity/v3/projects/2995794a7a5240ecaa2077861d3985ba/users/e1bb6fe541114361801debd74e521907/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:00.100786 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66139ab4-a931-4e09-9ade-9d69738aebee None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:00.101290 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66139ab4-a931-4e09-9ade-9d69738aebee None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:00.101417 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66139ab4-a931-4e09-9ade-9d69738aebee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:00.128275 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-66139ab4-a931-4e09-9ade-9d69738aebee None None] MFA Rules not processed for user `e1bb6fe541114361801debd74e521907`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:00.129511 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-66139ab4-a931-4e09-9ade-9d69738aebee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:00.193119 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1034/2060] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:00.197766 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fab9e-575a-4ac6-9957-d92653f0612b admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:00.267318 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fab9e-575a-4ac6-9957-d92653f0612b admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:00.272104 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d9854-1724-44ed-8ee6-608e3e196444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:00.272749 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d9854-1724-44ed-8ee6-608e3e196444 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:00.274537 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d9854-1724-44ed-8ee6-608e3e196444 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:00.274537 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d9854-1724-44ed-8ee6-608e3e196444 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:00.274537 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d9854-1724-44ed-8ee6-608e3e196444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:00.276201 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6d9854-1724-44ed-8ee6-608e3e196444 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:00.344890 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1027/2061] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:03:00 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:00.348446 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66139ab4-a931-4e09-9ade-9d69738aebee None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:00.363322 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66139ab4-a931-4e09-9ade-9d69738aebee None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:00.422662 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4b0d6-d2fd-4c4a-91c0-2c3d56e5c51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:00.423372 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4b0d6-d2fd-4c4a-91c0-2c3d56e5c51e admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:00.423653 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4b0d6-d2fd-4c4a-91c0-2c3d56e5c51e admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:00.423926 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4b0d6-d2fd-4c4a-91c0-2c3d56e5c51e admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:00.424618 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4b0d6-d2fd-4c4a-91c0-2c3d56e5c51e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:00.426580 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d4b0d6-d2fd-4c4a-91c0-2c3d56e5c51e admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:00.486787 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1035/2062] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:03:00 2022] POST /identity/v3/users => generated 298 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:00.504314 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d9854-1724-44ed-8ee6-608e3e196444 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:00.516515 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6d9854-1724-44ed-8ee6-608e3e196444 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:00.522527 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa67db7-8636-4268-9324-9b0d5714fb30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:00.523140 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa67db7-8636-4268-9324-9b0d5714fb30 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:00.523511 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa67db7-8636-4268-9324-9b0d5714fb30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:00.523789 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa67db7-8636-4268-9324-9b0d5714fb30 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:00.524519 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa67db7-8636-4268-9324-9b0d5714fb30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:00.526107 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa67db7-8636-4268-9324-9b0d5714fb30 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:00.537803 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1028/2063] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:00.542701 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4b0d6-d2fd-4c4a-91c0-2c3d56e5c51e admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:00.555449 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4b0d6-d2fd-4c4a-91c0-2c3d56e5c51e admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:00.564693 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6213ae7-b11c-496c-b73a-e0e1120e7541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:00.565581 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6213ae7-b11c-496c-b73a-e0e1120e7541 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:00.565863 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6213ae7-b11c-496c-b73a-e0e1120e7541 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:00.566136 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6213ae7-b11c-496c-b73a-e0e1120e7541 admin admin] PATH_INFO: `/v3/projects/991ecc7a9bd446ae90c68225235517b6/users/24c2f909e04e40398b1db9a04bb3474e/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:00.585174 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6213ae7-b11c-496c-b73a-e0e1120e7541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=991ecc7a9bd446ae90c68225235517b6, user_id=24c2f909e04e40398b1db9a04bb3474e, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:00.588102 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6213ae7-b11c-496c-b73a-e0e1120e7541 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:00.661873 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1036/2064] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:00 2022] PUT /identity/v3/projects/991ecc7a9bd446ae90c68225235517b6/users/24c2f909e04e40398b1db9a04bb3474e/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:00.665727 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa67db7-8636-4268-9324-9b0d5714fb30 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:00.676143 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa67db7-8636-4268-9324-9b0d5714fb30 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:00.732030 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e5a28-0a53-410f-bdaf-f6ee566a55cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:00.732769 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e5a28-0a53-410f-bdaf-f6ee566a55cb admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:00.733033 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e5a28-0a53-410f-bdaf-f6ee566a55cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:00.733306 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e5a28-0a53-410f-bdaf-f6ee566a55cb admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:00.734091 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e5a28-0a53-410f-bdaf-f6ee566a55cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:00.735810 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e5a28-0a53-410f-bdaf-f6ee566a55cb admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:00.746994 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1029/2065] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:00 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:00.750745 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6213ae7-b11c-496c-b73a-e0e1120e7541 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:00.766624 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6213ae7-b11c-496c-b73a-e0e1120e7541 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:00.771668 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd94e8b-c1e8-498f-b08b-4594cafe7c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:00.772770 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd94e8b-c1e8-498f-b08b-4594cafe7c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:00.773099 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd94e8b-c1e8-498f-b08b-4594cafe7c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:00.773373 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd94e8b-c1e8-498f-b08b-4594cafe7c62 admin admin] PATH_INFO: `/v3/projects/991ecc7a9bd446ae90c68225235517b6/users/24c2f909e04e40398b1db9a04bb3474e/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:00.775602 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd94e8b-c1e8-498f-b08b-4594cafe7c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=991ecc7a9bd446ae90c68225235517b6, user_id=24c2f909e04e40398b1db9a04bb3474e, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:00.778815 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd94e8b-c1e8-498f-b08b-4594cafe7c62 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:00.790220 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1037/2066] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:00 2022] PUT /identity/v3/projects/991ecc7a9bd446ae90c68225235517b6/users/24c2f909e04e40398b1db9a04bb3474e/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:03:00.800771 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ffea1-fa4a-419c-846b-d2db1fd4b549 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:00.801115 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ffea1-fa4a-419c-846b-d2db1fd4b549 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:00.801395 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8ffea1-fa4a-419c-846b-d2db1fd4b549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:00.827209 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-5a8ffea1-fa4a-419c-846b-d2db1fd4b549 None None] MFA Rules not processed for user `24c2f909e04e40398b1db9a04bb3474e`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:00.828407 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-5a8ffea1-fa4a-419c-846b-d2db1fd4b549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:00.902877 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1030/2067] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:03:00.934788 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd94e8b-c1e8-498f-b08b-4594cafe7c62 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:00.936615 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-4fd94e8b-c1e8-498f-b08b-4594cafe7c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:00.991107 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd94e8b-c1e8-498f-b08b-4594cafe7c62 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:00.994608 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b0ac3-1bed-4b9b-bbf8-f0b4bce72a39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:00.995321 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b0ac3-1bed-4b9b-bbf8-f0b4bce72a39 service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:00.995594 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b0ac3-1bed-4b9b-bbf8-f0b4bce72a39 service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:00.995860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b0ac3-1bed-4b9b-bbf8-f0b4bce72a39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:01.048214 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b0ac3-1bed-4b9b-bbf8-f0b4bce72a39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:01.049567 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b0ac3-1bed-4b9b-bbf8-f0b4bce72a39 service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:01.058114 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1038/2068] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:03:01.980736 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ffea1-fa4a-419c-846b-d2db1fd4b549 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:01.990733 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8ffea1-fa4a-419c-846b-d2db1fd4b549 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:01.997914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ffb6f-539a-4cd6-84aa-d17e3eff473e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:01.997914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ffb6f-539a-4cd6-84aa-d17e3eff473e service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:01.997914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ffb6f-539a-4cd6-84aa-d17e3eff473e service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:01.997914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ffb6f-539a-4cd6-84aa-d17e3eff473e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:01.999815 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-a58ffb6f-539a-4cd6-84aa-d17e3eff473e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:02.074730 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ffb6f-539a-4cd6-84aa-d17e3eff473e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:02.076264 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ffb6f-539a-4cd6-84aa-d17e3eff473e service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:02.085907 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1031/2069] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:03:05.287939 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b0ac3-1bed-4b9b-bbf8-f0b4bce72a39 service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:05.289436 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-409b0ac3-1bed-4b9b-bbf8-f0b4bce72a39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:05.355838 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b0ac3-1bed-4b9b-bbf8-f0b4bce72a39 service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:05.363671 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01750b20-b407-4bf6-9e61-c1cb4b0c4d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:05.363671 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01750b20-b407-4bf6-9e61-c1cb4b0c4d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:05.363671 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01750b20-b407-4bf6-9e61-c1cb4b0c4d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:05.363671 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01750b20-b407-4bf6-9e61-c1cb4b0c4d10 admin admin] PATH_INFO: `/v3/users/1633eb313c7c4af6a10a824c53894bb7` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:05.364025 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01750b20-b407-4bf6-9e61-c1cb4b0c4d10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1633eb313c7c4af6a10a824c53894bb7)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:05.365204 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01750b20-b407-4bf6-9e61-c1cb4b0c4d10 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:05.509507 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-01750b20-b407-4bf6-9e61-c1cb4b0c4d10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1633eb313c7c4af6a10a824c53894bb7'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:05.517947 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-01750b20-b407-4bf6-9e61-c1cb4b0c4d10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1633eb313c7c4af6a10a824c53894bb7'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:05.588399 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-01750b20-b407-4bf6-9e61-c1cb4b0c4d10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1633eb313c7c4af6a10a824c53894bb7'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:05.589687 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-01750b20-b407-4bf6-9e61-c1cb4b0c4d10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1633eb313c7c4af6a10a824c53894bb7'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:05.603709 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-01750b20-b407-4bf6-9e61-c1cb4b0c4d10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1633eb313c7c4af6a10a824c53894bb7'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:05.611038 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1039/2070] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:03:05 2022] DELETE /identity/v3/users/1633eb313c7c4af6a10a824c53894bb7 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:03:05.615305 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcee70-2659-4976-8628-2c785b264912 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:05.616213 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcee70-2659-4976-8628-2c785b264912 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:05.616522 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bcee70-2659-4976-8628-2c785b264912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:05.639780 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-b7bcee70-2659-4976-8628-2c785b264912 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:05.640983 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-b7bcee70-2659-4976-8628-2c785b264912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:05.705083 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1032/2071] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:03:05.715341 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01750b20-b407-4bf6-9e61-c1cb4b0c4d10 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:05.716805 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-01750b20-b407-4bf6-9e61-c1cb4b0c4d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:05.778940 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01750b20-b407-4bf6-9e61-c1cb4b0c4d10 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:05.782779 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff41dfb-1c1b-4b9b-81e5-52d92edde53f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:05.783518 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff41dfb-1c1b-4b9b-81e5-52d92edde53f service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:05.783870 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff41dfb-1c1b-4b9b-81e5-52d92edde53f service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:05.784254 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff41dfb-1c1b-4b9b-81e5-52d92edde53f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:05.793549 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff41dfb-1c1b-4b9b-81e5-52d92edde53f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:05.795009 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff41dfb-1c1b-4b9b-81e5-52d92edde53f service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:05.804363 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1040/2072] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:03:06.228455 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcee70-2659-4976-8628-2c785b264912 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:06.231501 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-b7bcee70-2659-4976-8628-2c785b264912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:06.255070 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bcee70-2659-4976-8628-2c785b264912 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:06.261005 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e56e7-31e5-43e6-8218-d44de39792cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:06.262419 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e56e7-31e5-43e6-8218-d44de39792cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:06.262875 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e56e7-31e5-43e6-8218-d44de39792cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:06.263685 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042e56e7-31e5-43e6-8218-d44de39792cd admin admin] PATH_INFO: `/v3/projects/5664aa6340ac43e6bedeb293f6fa9bc6` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:06.266087 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e56e7-31e5-43e6-8218-d44de39792cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5664aa6340ac43e6bedeb293f6fa9bc6)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:06.273321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042e56e7-31e5-43e6-8218-d44de39792cd admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:06.370024 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-042e56e7-31e5-43e6-8218-d44de39792cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5664aa6340ac43e6bedeb293f6fa9bc6', 'request_id': 'req-042e56e7-31e5-43e6-8218-d44de39792cd'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:06.436359 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff41dfb-1c1b-4b9b-81e5-52d92edde53f service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:06.437818 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-6ff41dfb-1c1b-4b9b-81e5-52d92edde53f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:06.450693 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff41dfb-1c1b-4b9b-81e5-52d92edde53f service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:06.491279 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-042e56e7-31e5-43e6-8218-d44de39792cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5664aa6340ac43e6bedeb293f6fa9bc6', 'request_id': 'req-042e56e7-31e5-43e6-8218-d44de39792cd'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:06.498964 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-042e56e7-31e5-43e6-8218-d44de39792cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5664aa6340ac43e6bedeb293f6fa9bc6', 'request_id': 'req-042e56e7-31e5-43e6-8218-d44de39792cd'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:06.511441 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-042e56e7-31e5-43e6-8218-d44de39792cd admin admin] The token cache is being invalidate because project 5664aa6340ac43e6bedeb293f6fa9bc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:06.511843 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-042e56e7-31e5-43e6-8218-d44de39792cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:06.512851 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-042e56e7-31e5-43e6-8218-d44de39792cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:06.514023 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582f535-6f18-4d65-9bbd-a4e136029545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:06.514911 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582f535-6f18-4d65-9bbd-a4e136029545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:06.515218 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582f535-6f18-4d65-9bbd-a4e136029545 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:06.515487 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582f535-6f18-4d65-9bbd-a4e136029545 admin admin] PATH_INFO: `/v3/users/fac87b9f893a49e782a6cfc004224d92` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:06.516193 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1033/2073] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:06 2022] DELETE /identity/v3/projects/5664aa6340ac43e6bedeb293f6fa9bc6 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:06.516667 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582f535-6f18-4d65-9bbd-a4e136029545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fac87b9f893a49e782a6cfc004224d92)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:06.518569 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582f535-6f18-4d65-9bbd-a4e136029545 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:06.523665 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e56e7-31e5-43e6-8218-d44de39792cd admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:06.525215 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-042e56e7-31e5-43e6-8218-d44de39792cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:06.539596 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042e56e7-31e5-43e6-8218-d44de39792cd admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:06.545188 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cb753-6105-4b32-88b7-7c17425d95d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:06.546077 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cb753-6105-4b32-88b7-7c17425d95d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:06.546355 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cb753-6105-4b32-88b7-7c17425d95d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:06.546685 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cb753-6105-4b32-88b7-7c17425d95d9 admin admin] PATH_INFO: `/v3/users/af5f5eff81a04d1185dec86a1ea41610` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:06.547947 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cb753-6105-4b32-88b7-7c17425d95d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af5f5eff81a04d1185dec86a1ea41610)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:06.550181 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cb753-6105-4b32-88b7-7c17425d95d9 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:06.660124 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-8582f535-6f18-4d65-9bbd-a4e136029545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fac87b9f893a49e782a6cfc004224d92'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:06.669663 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-8582f535-6f18-4d65-9bbd-a4e136029545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fac87b9f893a49e782a6cfc004224d92'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:06.710231 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-907cb753-6105-4b32-88b7-7c17425d95d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af5f5eff81a04d1185dec86a1ea41610'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:06.759178 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-8582f535-6f18-4d65-9bbd-a4e136029545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fac87b9f893a49e782a6cfc004224d92'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:06.759958 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-8582f535-6f18-4d65-9bbd-a4e136029545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fac87b9f893a49e782a6cfc004224d92'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:06.772872 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-8582f535-6f18-4d65-9bbd-a4e136029545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fac87b9f893a49e782a6cfc004224d92'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:06.779314 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1041/2074] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:03:06 2022] DELETE /identity/v3/users/fac87b9f893a49e782a6cfc004224d92 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:03:06.783700 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1415b-6673-4bc0-b120-dd4a30fe0b03 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:06.783992 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1415b-6673-4bc0-b120-dd4a30fe0b03 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:06.784268 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1415b-6673-4bc0-b120-dd4a30fe0b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:06.802191 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-d7f1415b-6673-4bc0-b120-dd4a30fe0b03 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:06.803649 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d7f1415b-6673-4bc0-b120-dd4a30fe0b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:06.860516 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1042/2075] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:03:06.870189 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1415b-6673-4bc0-b120-dd4a30fe0b03 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:06.871527 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d7f1415b-6673-4bc0-b120-dd4a30fe0b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:06.895572 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-907cb753-6105-4b32-88b7-7c17425d95d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af5f5eff81a04d1185dec86a1ea41610'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:06.896289 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-907cb753-6105-4b32-88b7-7c17425d95d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af5f5eff81a04d1185dec86a1ea41610'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:06.904805 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-907cb753-6105-4b32-88b7-7c17425d95d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af5f5eff81a04d1185dec86a1ea41610'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:06.917027 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-907cb753-6105-4b32-88b7-7c17425d95d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af5f5eff81a04d1185dec86a1ea41610'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:06.923318 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1034/2076] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:03:06 2022] DELETE /identity/v3/users/af5f5eff81a04d1185dec86a1ea41610 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:03:06.928531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1415b-6673-4bc0-b120-dd4a30fe0b03 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:06.991035 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5890f1-36fc-4b3b-afd8-e1dc6d3efc8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:06.992278 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5890f1-36fc-4b3b-afd8-e1dc6d3efc8d service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:06.992460 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5890f1-36fc-4b3b-afd8-e1dc6d3efc8d service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:06.992745 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5890f1-36fc-4b3b-afd8-e1dc6d3efc8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:06.996110 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-6d5890f1-36fc-4b3b-afd8-e1dc6d3efc8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:07.077518 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5890f1-36fc-4b3b-afd8-e1dc6d3efc8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:07.079879 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5890f1-36fc-4b3b-afd8-e1dc6d3efc8d service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:07.090847 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1043/2077] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:03:07.381437 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cb753-6105-4b32-88b7-7c17425d95d9 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:07.383127 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-907cb753-6105-4b32-88b7-7c17425d95d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:07.397895 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5890f1-36fc-4b3b-afd8-e1dc6d3efc8d service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:07.403051 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-6d5890f1-36fc-4b3b-afd8-e1dc6d3efc8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:07.403458 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cb753-6105-4b32-88b7-7c17425d95d9 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:07.408867 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d01b73-34ab-49e1-a760-10afd03c676c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:07.409793 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d01b73-34ab-49e1-a760-10afd03c676c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:07.410077 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d01b73-34ab-49e1-a760-10afd03c676c admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:07.410349 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d01b73-34ab-49e1-a760-10afd03c676c admin admin] PATH_INFO: `/v3/projects/64a1909c146b4a2ca9e2a27c87ca5999` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:07.411597 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d01b73-34ab-49e1-a760-10afd03c676c admin admin] RBAC: Authorizing `identity:delete_project(project_id=64a1909c146b4a2ca9e2a27c87ca5999)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:07.414868 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d01b73-34ab-49e1-a760-10afd03c676c admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:07.475584 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5890f1-36fc-4b3b-afd8-e1dc6d3efc8d service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:07.479970 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d6b85-107c-4262-b77f-cf1fdd175d9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:07.480628 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d6b85-107c-4262-b77f-cf1fdd175d9e service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:07.480910 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d6b85-107c-4262-b77f-cf1fdd175d9e service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:07.481184 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d6b85-107c-4262-b77f-cf1fdd175d9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:07.483582 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-402d6b85-107c-4262-b77f-cf1fdd175d9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:07.547692 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d6b85-107c-4262-b77f-cf1fdd175d9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:07.549116 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402d6b85-107c-4262-b77f-cf1fdd175d9e service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:07.559456 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1044/2078] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:03:07.560270 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d6b85-107c-4262-b77f-cf1fdd175d9e service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:07.561682 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-402d6b85-107c-4262-b77f-cf1fdd175d9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:07.576114 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402d6b85-107c-4262-b77f-cf1fdd175d9e service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:07.581236 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c91c9b-8413-4754-8444-ae2cabf5d9af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:07.581931 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c91c9b-8413-4754-8444-ae2cabf5d9af admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:07.582209 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c91c9b-8413-4754-8444-ae2cabf5d9af admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:07.582570 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c91c9b-8413-4754-8444-ae2cabf5d9af admin admin] PATH_INFO: `/v3/projects/4b203e9b982749909f75aa48edbd937e` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:07.591468 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c91c9b-8413-4754-8444-ae2cabf5d9af admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b203e9b982749909f75aa48edbd937e)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:07.591468 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c91c9b-8413-4754-8444-ae2cabf5d9af admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:07.612626 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b0d01b73-34ab-49e1-a760-10afd03c676c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64a1909c146b4a2ca9e2a27c87ca5999', 'request_id': 'req-b0d01b73-34ab-49e1-a760-10afd03c676c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:07.713081 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-d8c91c9b-8413-4754-8444-ae2cabf5d9af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b203e9b982749909f75aa48edbd937e', 'request_id': 'req-d8c91c9b-8413-4754-8444-ae2cabf5d9af'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:07.718528 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-d8c91c9b-8413-4754-8444-ae2cabf5d9af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b203e9b982749909f75aa48edbd937e', 'request_id': 'req-d8c91c9b-8413-4754-8444-ae2cabf5d9af'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:07.748038 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b0d01b73-34ab-49e1-a760-10afd03c676c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64a1909c146b4a2ca9e2a27c87ca5999', 'request_id': 'req-b0d01b73-34ab-49e1-a760-10afd03c676c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:07.754445 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b0d01b73-34ab-49e1-a760-10afd03c676c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64a1909c146b4a2ca9e2a27c87ca5999', 'request_id': 'req-b0d01b73-34ab-49e1-a760-10afd03c676c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:07.765613 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b0d01b73-34ab-49e1-a760-10afd03c676c admin admin] The token cache is being invalidate because project 64a1909c146b4a2ca9e2a27c87ca5999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:07.765918 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b0d01b73-34ab-49e1-a760-10afd03c676c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:07.766582 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b0d01b73-34ab-49e1-a760-10afd03c676c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:07.768136 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1035/2079] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:07 2022] DELETE /identity/v3/projects/64a1909c146b4a2ca9e2a27c87ca5999 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:07.774499 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542b05f-d772-4519-84c9-5e9824df5c36 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:07.774784 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542b05f-d772-4519-84c9-5e9824df5c36 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:07.775095 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542b05f-d772-4519-84c9-5e9824df5c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:07.793217 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-a542b05f-d772-4519-84c9-5e9824df5c36 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:07.798008 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-a542b05f-d772-4519-84c9-5e9824df5c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:07.844428 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-d8c91c9b-8413-4754-8444-ae2cabf5d9af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b203e9b982749909f75aa48edbd937e', 'request_id': 'req-d8c91c9b-8413-4754-8444-ae2cabf5d9af'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:07.857081 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-d8c91c9b-8413-4754-8444-ae2cabf5d9af admin admin] The token cache is being invalidate because project 4b203e9b982749909f75aa48edbd937e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:07.857371 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-d8c91c9b-8413-4754-8444-ae2cabf5d9af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:07.858252 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-d8c91c9b-8413-4754-8444-ae2cabf5d9af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:07.859011 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1036/2080] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:03:07.860000 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1045/2081] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:07 2022] DELETE /identity/v3/projects/4b203e9b982749909f75aa48edbd937e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:07.860457 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd666f8-1d13-4c25-8887-b91a372fb3c0 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:07.860749 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd666f8-1d13-4c25-8887-b91a372fb3c0 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:07.861023 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd666f8-1d13-4c25-8887-b91a372fb3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:07.864638 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf19941-450f-4e9c-8041-84ea1674e1dc None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:07.864928 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf19941-450f-4e9c-8041-84ea1674e1dc None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:07.865209 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf19941-450f-4e9c-8041-84ea1674e1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:07.879799 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-6dd666f8-1d13-4c25-8887-b91a372fb3c0 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:07.881057 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-6dd666f8-1d13-4c25-8887-b91a372fb3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:07.884076 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-cdf19941-450f-4e9c-8041-84ea1674e1dc None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:07.885309 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-cdf19941-450f-4e9c-8041-84ea1674e1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:07.889800 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1037/2082] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:07.893907 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd666f8-1d13-4c25-8887-b91a372fb3c0 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:07.903766 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1046/2083] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:03:07.903945 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd666f8-1d13-4c25-8887-b91a372fb3c0 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:07.912124 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613d90f-befa-47c7-a820-24128ab0eef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:07.912124 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613d90f-befa-47c7-a820-24128ab0eef7 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:07.912124 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613d90f-befa-47c7-a820-24128ab0eef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:07.912124 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613d90f-befa-47c7-a820-24128ab0eef7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:07.912461 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613d90f-befa-47c7-a820-24128ab0eef7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:03:07.912461 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613d90f-befa-47c7-a820-24128ab0eef7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:07.912461 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613d90f-befa-47c7-a820-24128ab0eef7 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:07.913449 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba8d0b-daf4-477f-be3f-b47ee38cfea2 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:07.913733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba8d0b-daf4-477f-be3f-b47ee38cfea2 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:07.914007 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba8d0b-daf4-477f-be3f-b47ee38cfea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:07.927181 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1038/2084] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:03:07.928096 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613d90f-befa-47c7-a820-24128ab0eef7 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:07.932060 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-11ba8d0b-daf4-477f-be3f-b47ee38cfea2 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:07.933223 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-11ba8d0b-daf4-477f-be3f-b47ee38cfea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:07.937636 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613d90f-befa-47c7-a820-24128ab0eef7 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:07.942316 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1047/2085] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:03:07.942421 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d81877-2b33-4756-bc9d-9ca911e0f56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:07.942821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d81877-2b33-4756-bc9d-9ca911e0f56d admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:07.943132 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d81877-2b33-4756-bc9d-9ca911e0f56d admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:07.943407 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d81877-2b33-4756-bc9d-9ca911e0f56d admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:07.944094 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d81877-2b33-4756-bc9d-9ca911e0f56d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:07.945340 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba8d0b-daf4-477f-be3f-b47ee38cfea2 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:07.945969 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d81877-2b33-4756-bc9d-9ca911e0f56d admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:07.954993 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba8d0b-daf4-477f-be3f-b47ee38cfea2 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:07.959716 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf43b81-f990-4dbe-a56e-7cbaf3f2a208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:07.960406 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf43b81-f990-4dbe-a56e-7cbaf3f2a208 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:07.960664 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf43b81-f990-4dbe-a56e-7cbaf3f2a208 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:07.960930 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf43b81-f990-4dbe-a56e-7cbaf3f2a208 admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:07.961654 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf43b81-f990-4dbe-a56e-7cbaf3f2a208 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:03:07.961951 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf43b81-f990-4dbe-a56e-7cbaf3f2a208 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:07.979098 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf43b81-f990-4dbe-a56e-7cbaf3f2a208 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:07.979098 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1048/2086] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:03:07.982384 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf43b81-f990-4dbe-a56e-7cbaf3f2a208 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:07.992035 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf43b81-f990-4dbe-a56e-7cbaf3f2a208 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:07.996794 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4aa07-786e-4ce1-9aac-b341f7a2cc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:07.997586 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4aa07-786e-4ce1-9aac-b341f7a2cc58 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:07.997874 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4aa07-786e-4ce1-9aac-b341f7a2cc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:07.998147 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d4aa07-786e-4ce1-9aac-b341f7a2cc58 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:07.998828 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4aa07-786e-4ce1-9aac-b341f7a2cc58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:08.000752 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d4aa07-786e-4ce1-9aac-b341f7a2cc58 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:08.036780 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1039/2087] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:03:07 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:03:08.043058 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d81877-2b33-4756-bc9d-9ca911e0f56d admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:08.103328 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d81877-2b33-4756-bc9d-9ca911e0f56d admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:08.108239 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22154564-55a5-463e-ba99-de6e2c4610b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:08.108903 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22154564-55a5-463e-ba99-de6e2c4610b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:08.109178 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22154564-55a5-463e-ba99-de6e2c4610b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:08.109446 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22154564-55a5-463e-ba99-de6e2c4610b8 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:08.110131 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22154564-55a5-463e-ba99-de6e2c4610b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:08.112087 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22154564-55a5-463e-ba99-de6e2c4610b8 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:08.116982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1049/2088] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:03:07 2022] POST /identity/v3/projects => generated 365 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:03:08.116982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4aa07-786e-4ce1-9aac-b341f7a2cc58 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:08.117704 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-16d4aa07-786e-4ce1-9aac-b341f7a2cc58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:08.179216 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d4aa07-786e-4ce1-9aac-b341f7a2cc58 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:08.184452 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9856d5-6d7d-4861-bdf9-cbc196c3d789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:08.185311 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9856d5-6d7d-4861-bdf9-cbc196c3d789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:08.185587 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9856d5-6d7d-4861-bdf9-cbc196c3d789 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:08.185959 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9856d5-6d7d-4861-bdf9-cbc196c3d789 admin admin] PATH_INFO: `/v3/users/924f411197da483e9bc11ac9c97e3a3f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:08.187163 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9856d5-6d7d-4861-bdf9-cbc196c3d789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=924f411197da483e9bc11ac9c97e3a3f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:08.189081 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9856d5-6d7d-4861-bdf9-cbc196c3d789 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:08.222538 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1040/2089] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:03:08 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:08.223746 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22154564-55a5-463e-ba99-de6e2c4610b8 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:08.244972 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22154564-55a5-463e-ba99-de6e2c4610b8 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:08.250791 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a974d4-603d-47c0-bbe1-3e550f524031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:08.251600 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a974d4-603d-47c0-bbe1-3e550f524031 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:08.251943 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a974d4-603d-47c0-bbe1-3e550f524031 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:08.252299 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a974d4-603d-47c0-bbe1-3e550f524031 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:08.253066 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a974d4-603d-47c0-bbe1-3e550f524031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:08.259435 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a974d4-603d-47c0-bbe1-3e550f524031 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:08.342744 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1041/2090] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:03:08 2022] POST /identity/v3/users => generated 283 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:08.346928 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a974d4-603d-47c0-bbe1-3e550f524031 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:08.353028 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a974d4-603d-47c0-bbe1-3e550f524031 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:08.358209 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b7d84-f549-45b0-8320-49066e9f5ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:08.358820 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b7d84-f549-45b0-8320-49066e9f5ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:08.359151 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b7d84-f549-45b0-8320-49066e9f5ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:08.359414 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b7d84-f549-45b0-8320-49066e9f5ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:08.360145 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b7d84-f549-45b0-8320-49066e9f5ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:08.361764 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b7d84-f549-45b0-8320-49066e9f5ac3 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:08.372401 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1042/2091] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:08.375551 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b7d84-f549-45b0-8320-49066e9f5ac3 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:08.383056 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b7d84-f549-45b0-8320-49066e9f5ac3 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:08.388258 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d441ce-fe0e-4a97-b91b-766b6e6e0def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:08.388894 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d441ce-fe0e-4a97-b91b-766b6e6e0def admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:08.389177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d441ce-fe0e-4a97-b91b-766b6e6e0def admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:08.389454 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d441ce-fe0e-4a97-b91b-766b6e6e0def admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:08.390178 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d441ce-fe0e-4a97-b91b-766b6e6e0def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:08.391795 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d441ce-fe0e-4a97-b91b-766b6e6e0def admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:08.405457 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1043/2092] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:08.405457 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d441ce-fe0e-4a97-b91b-766b6e6e0def admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:08.409754 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-fd9856d5-6d7d-4861-bdf9-cbc196c3d789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924f411197da483e9bc11ac9c97e3a3f'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:08.415337 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d441ce-fe0e-4a97-b91b-766b6e6e0def admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:08.417207 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-fd9856d5-6d7d-4861-bdf9-cbc196c3d789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924f411197da483e9bc11ac9c97e3a3f'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:08.420769 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ac392-014b-41f4-80a3-adbbb4b0779c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:08.421415 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ac392-014b-41f4-80a3-adbbb4b0779c admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:08.421692 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ac392-014b-41f4-80a3-adbbb4b0779c admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:08.421989 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ac392-014b-41f4-80a3-adbbb4b0779c admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:08.422713 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ac392-014b-41f4-80a3-adbbb4b0779c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:08.424324 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ac392-014b-41f4-80a3-adbbb4b0779c admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:08.434655 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1044/2093] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:08.435533 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ac392-014b-41f4-80a3-adbbb4b0779c admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:08.445008 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ac392-014b-41f4-80a3-adbbb4b0779c admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:08.449661 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a4f3e-7ea2-4944-925f-16cca94e021f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:08.450284 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a4f3e-7ea2-4944-925f-16cca94e021f admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:08.450566 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a4f3e-7ea2-4944-925f-16cca94e021f admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:08.450862 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a4f3e-7ea2-4944-925f-16cca94e021f admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:08.451567 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a4f3e-7ea2-4944-925f-16cca94e021f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:08.453086 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a4f3e-7ea2-4944-925f-16cca94e021f admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:08.462473 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1045/2094] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:08.463293 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a4f3e-7ea2-4944-925f-16cca94e021f admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:08.472359 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a4f3e-7ea2-4944-925f-16cca94e021f admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:08.477909 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3efb4-753e-4154-ae5e-aa5d114e6c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:08.478756 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3efb4-753e-4154-ae5e-aa5d114e6c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:08.479062 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3efb4-753e-4154-ae5e-aa5d114e6c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:08.479392 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3efb4-753e-4154-ae5e-aa5d114e6c08 admin admin] PATH_INFO: `/v3/projects/4936cb18cc8f4cca824f6aefbb386bc7/users/cdc3bcd74cf242feb3beeca65131467b/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:08.496742 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3efb4-753e-4154-ae5e-aa5d114e6c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4936cb18cc8f4cca824f6aefbb386bc7, user_id=cdc3bcd74cf242feb3beeca65131467b, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:08.499671 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3efb4-753e-4154-ae5e-aa5d114e6c08 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:08.502225 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-fd9856d5-6d7d-4861-bdf9-cbc196c3d789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924f411197da483e9bc11ac9c97e3a3f'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:08.503154 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-fd9856d5-6d7d-4861-bdf9-cbc196c3d789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924f411197da483e9bc11ac9c97e3a3f'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:08.515571 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-fd9856d5-6d7d-4861-bdf9-cbc196c3d789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924f411197da483e9bc11ac9c97e3a3f'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:08.521491 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1050/2095] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:03:08 2022] DELETE /identity/v3/users/924f411197da483e9bc11ac9c97e3a3f => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:08.522396 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9856d5-6d7d-4861-bdf9-cbc196c3d789 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:08.523833 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-fd9856d5-6d7d-4861-bdf9-cbc196c3d789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:08.584653 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9856d5-6d7d-4861-bdf9-cbc196c3d789 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:08.589315 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab612ae5-2d9e-4302-adfb-f2a6dd332173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:08.590229 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab612ae5-2d9e-4302-adfb-f2a6dd332173 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:08.590511 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab612ae5-2d9e-4302-adfb-f2a6dd332173 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:08.590785 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab612ae5-2d9e-4302-adfb-f2a6dd332173 admin admin] PATH_INFO: `/v3/projects/5c8dc0748f7f4aa3b25cda71fca17510/users/1eff5ab8e552446ca4b9a7fe5b44c22b/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:08.593881 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1046/2096] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:08 2022] PUT /identity/v3/projects/4936cb18cc8f4cca824f6aefbb386bc7/users/cdc3bcd74cf242feb3beeca65131467b/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:08.602974 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c92a60-8931-4940-b854-d1154ee3ff9d None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:08.602974 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c92a60-8931-4940-b854-d1154ee3ff9d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:08.602974 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c92a60-8931-4940-b854-d1154ee3ff9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:08.611548 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab612ae5-2d9e-4302-adfb-f2a6dd332173 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c8dc0748f7f4aa3b25cda71fca17510, user_id=1eff5ab8e552446ca4b9a7fe5b44c22b, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:08.614277 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab612ae5-2d9e-4302-adfb-f2a6dd332173 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:08.621477 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-a0c92a60-8931-4940-b854-d1154ee3ff9d None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:08.622685 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-a0c92a60-8931-4940-b854-d1154ee3ff9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:08.685436 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1047/2097] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:08.685436 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341e828-9078-4a8d-962b-d7bb1adbccea None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:08.685436 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341e828-9078-4a8d-962b-d7bb1adbccea None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:08.685436 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341e828-9078-4a8d-962b-d7bb1adbccea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:08.697683 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1051/2098] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:08 2022] PUT /identity/v3/projects/5c8dc0748f7f4aa3b25cda71fca17510/users/1eff5ab8e552446ca4b9a7fe5b44c22b/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:08.699017 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab612ae5-2d9e-4302-adfb-f2a6dd332173 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:08.704345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-ab612ae5-2d9e-4302-adfb-f2a6dd332173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:08.717521 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-e341e828-9078-4a8d-962b-d7bb1adbccea None None] MFA Rules not processed for user `cdc3bcd74cf242feb3beeca65131467b`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:08.718646 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-e341e828-9078-4a8d-962b-d7bb1adbccea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:08.782919 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab612ae5-2d9e-4302-adfb-f2a6dd332173 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:08.787440 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6eed03-9ab7-4c9f-844f-9e66bc7a6d9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:08.788100 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6eed03-9ab7-4c9f-844f-9e66bc7a6d9b service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:08.788382 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6eed03-9ab7-4c9f-844f-9e66bc7a6d9b service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:08.788656 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6eed03-9ab7-4c9f-844f-9e66bc7a6d9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:08.813000 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1048/2099] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:08.813000 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012cd9e-98dd-4cae-a5b1-9e0e2ebb0df0 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:08.813000 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012cd9e-98dd-4cae-a5b1-9e0e2ebb0df0 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:08.815230 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a012cd9e-98dd-4cae-a5b1-9e0e2ebb0df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:08.845726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-a012cd9e-98dd-4cae-a5b1-9e0e2ebb0df0 None None] MFA Rules not processed for user `1eff5ab8e552446ca4b9a7fe5b44c22b`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:08.846982 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-a012cd9e-98dd-4cae-a5b1-9e0e2ebb0df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:08.860556 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6eed03-9ab7-4c9f-844f-9e66bc7a6d9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:08.862048 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6eed03-9ab7-4c9f-844f-9e66bc7a6d9b service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:08.872016 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1052/2100] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:03:08.872823 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6eed03-9ab7-4c9f-844f-9e66bc7a6d9b service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:08.874138 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-4f6eed03-9ab7-4c9f-844f-9e66bc7a6d9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:08.886036 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6eed03-9ab7-4c9f-844f-9e66bc7a6d9b service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:08.891022 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c646c8-1293-4815-87d0-a07259dc2124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:08.891667 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c646c8-1293-4815-87d0-a07259dc2124 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:08.891948 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c646c8-1293-4815-87d0-a07259dc2124 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:08.892219 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c646c8-1293-4815-87d0-a07259dc2124 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:08.892937 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c646c8-1293-4815-87d0-a07259dc2124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:08.894893 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c646c8-1293-4815-87d0-a07259dc2124 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:08.918432 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1049/2101] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:08.922927 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012cd9e-98dd-4cae-a5b1-9e0e2ebb0df0 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:08.933335 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a012cd9e-98dd-4cae-a5b1-9e0e2ebb0df0 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:08.938336 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf5591-cd37-464e-b167-c0d393e9df20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:08.939019 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf5591-cd37-464e-b167-c0d393e9df20 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:08.939297 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf5591-cd37-464e-b167-c0d393e9df20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:08.939565 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf5591-cd37-464e-b167-c0d393e9df20 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:08.940261 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf5591-cd37-464e-b167-c0d393e9df20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:08.942139 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf5591-cd37-464e-b167-c0d393e9df20 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:08.995109 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1053/2102] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:03:08 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:08.999351 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c646c8-1293-4815-87d0-a07259dc2124 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:09.023409 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1050/2103] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:03:08 2022] POST /identity/v3/projects => generated 355 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:09.027657 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf5591-cd37-464e-b167-c0d393e9df20 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:09.068155 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c646c8-1293-4815-87d0-a07259dc2124 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:09.102143 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf5591-cd37-464e-b167-c0d393e9df20 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:09.107877 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d6db5-6b0d-4d99-a17d-70fb90221c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:09.108541 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d6db5-6b0d-4d99-a17d-70fb90221c8b admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:09.108853 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d6db5-6b0d-4d99-a17d-70fb90221c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:09.109084 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d6db5-6b0d-4d99-a17d-70fb90221c8b admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:09.109773 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d6db5-6b0d-4d99-a17d-70fb90221c8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:09.111799 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d6db5-6b0d-4d99-a17d-70fb90221c8b admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:09.127121 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8df837-a571-4a82-8442-7eb88c6dc943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:09.127806 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8df837-a571-4a82-8442-7eb88c6dc943 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:09.128161 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8df837-a571-4a82-8442-7eb88c6dc943 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:09.128430 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8df837-a571-4a82-8442-7eb88c6dc943 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:09.129124 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8df837-a571-4a82-8442-7eb88c6dc943 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:09.131035 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8df837-a571-4a82-8442-7eb88c6dc943 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:09.215167 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1051/2104] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:03:09 2022] POST /identity/v3/users => generated 284 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:03:09.218157 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d6db5-6b0d-4d99-a17d-70fb90221c8b admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:09.228139 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d6db5-6b0d-4d99-a17d-70fb90221c8b admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:09.233251 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142391e-e05f-4778-93a6-8df0bd0d4871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:09.233895 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142391e-e05f-4778-93a6-8df0bd0d4871 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:09.234162 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142391e-e05f-4778-93a6-8df0bd0d4871 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:09.234433 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142391e-e05f-4778-93a6-8df0bd0d4871 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:09.235421 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142391e-e05f-4778-93a6-8df0bd0d4871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:09.236762 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c142391e-e05f-4778-93a6-8df0bd0d4871 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:09.241418 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1054/2105] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:03:08 2022] POST /identity/v3/users => generated 290 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:09.245249 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8df837-a571-4a82-8442-7eb88c6dc943 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:09.247230 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1052/2106] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:03:09.251090 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142391e-e05f-4778-93a6-8df0bd0d4871 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:09.258622 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8df837-a571-4a82-8442-7eb88c6dc943 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:09.261004 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142391e-e05f-4778-93a6-8df0bd0d4871 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:09.264532 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df614bc-2733-4392-b34b-6c7a7f9595c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:09.265269 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df614bc-2733-4392-b34b-6c7a7f9595c5 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:09.265629 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df614bc-2733-4392-b34b-6c7a7f9595c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:09.266036 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df614bc-2733-4392-b34b-6c7a7f9595c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:09.266783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df614bc-2733-4392-b34b-6c7a7f9595c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:09.267724 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64c9c8-6b21-4062-8ce2-5c95af69d2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:09.268591 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64c9c8-6b21-4062-8ce2-5c95af69d2fa admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:09.271322 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df614bc-2733-4392-b34b-6c7a7f9595c5 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:09.271429 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64c9c8-6b21-4062-8ce2-5c95af69d2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:09.271429 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64c9c8-6b21-4062-8ce2-5c95af69d2fa admin admin] PATH_INFO: `/v3/projects/ddf8b7647565427597927a2eb7459dcb/users/877e906e3fbc48919820079f358b2930/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:09.280974 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1055/2107] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:03:09.284893 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df614bc-2733-4392-b34b-6c7a7f9595c5 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:09.287401 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64c9c8-6b21-4062-8ce2-5c95af69d2fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf8b7647565427597927a2eb7459dcb, user_id=877e906e3fbc48919820079f358b2930, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:09.299962 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df614bc-2733-4392-b34b-6c7a7f9595c5 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:09.305824 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd64c9c8-6b21-4062-8ce2-5c95af69d2fa admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:09.318946 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960d867-0497-4204-9587-14ef74ef0677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:09.319863 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960d867-0497-4204-9587-14ef74ef0677 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:09.320140 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960d867-0497-4204-9587-14ef74ef0677 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:09.320413 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e960d867-0497-4204-9587-14ef74ef0677 admin admin] PATH_INFO: `/v3/projects/96cad96113fa4be48d6b00057437d683/users/12ef5aac038843e38402a44d4e4694e0/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:09.352157 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960d867-0497-4204-9587-14ef74ef0677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96cad96113fa4be48d6b00057437d683, user_id=12ef5aac038843e38402a44d4e4694e0, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:09.354988 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e960d867-0497-4204-9587-14ef74ef0677 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:09.402752 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1053/2108] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:09 2022] PUT /identity/v3/projects/ddf8b7647565427597927a2eb7459dcb/users/877e906e3fbc48919820079f358b2930/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:03:09.408331 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64c9c8-6b21-4062-8ce2-5c95af69d2fa admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:09.503305 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64c9c8-6b21-4062-8ce2-5c95af69d2fa admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:09.503400 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1056/2109] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:09 2022] PUT /identity/v3/projects/96cad96113fa4be48d6b00057437d683/users/12ef5aac038843e38402a44d4e4694e0/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:03:09.503400 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960d867-0497-4204-9587-14ef74ef0677 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:09.503400 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-e960d867-0497-4204-9587-14ef74ef0677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:09.575276 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e960d867-0497-4204-9587-14ef74ef0677 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:09.577265 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28ef7d-ca1c-4c20-b6d4-f3cb014e2c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:09.577933 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28ef7d-ca1c-4c20-b6d4-f3cb014e2c8f admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:09.578215 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28ef7d-ca1c-4c20-b6d4-f3cb014e2c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:09.578493 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a28ef7d-ca1c-4c20-b6d4-f3cb014e2c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:09.579270 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28ef7d-ca1c-4c20-b6d4-f3cb014e2c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:09.580029 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18697ad7-44cb-4589-acbd-f3ca662393ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:09.580892 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a28ef7d-ca1c-4c20-b6d4-f3cb014e2c8f admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:09.581011 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18697ad7-44cb-4589-acbd-f3ca662393ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:09.581176 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18697ad7-44cb-4589-acbd-f3ca662393ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:09.581458 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18697ad7-44cb-4589-acbd-f3ca662393ba admin admin] PATH_INFO: `/v3/projects/0e5d5a664c1a44f2ac7fc9c3812acd2d` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:09.582636 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18697ad7-44cb-4589-acbd-f3ca662393ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e5d5a664c1a44f2ac7fc9c3812acd2d)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:09.584533 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18697ad7-44cb-4589-acbd-f3ca662393ba admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:09.593842 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1054/2110] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:03:09.593842 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28ef7d-ca1c-4c20-b6d4-f3cb014e2c8f admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:09.601335 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a28ef7d-ca1c-4c20-b6d4-f3cb014e2c8f admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:09.607077 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224de8a-8cce-4b9b-8304-7797484f5cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:09.607820 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224de8a-8cce-4b9b-8304-7797484f5cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:09.608269 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224de8a-8cce-4b9b-8304-7797484f5cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:09.608516 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224de8a-8cce-4b9b-8304-7797484f5cd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:09.609241 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224de8a-8cce-4b9b-8304-7797484f5cd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:09.610919 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224de8a-8cce-4b9b-8304-7797484f5cd2 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:09.621448 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1055/2111] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:09.622225 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224de8a-8cce-4b9b-8304-7797484f5cd2 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:09.631553 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224de8a-8cce-4b9b-8304-7797484f5cd2 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:09.639558 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72494431-9c1f-4356-bb1d-6765f5a0cc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:09.639558 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72494431-9c1f-4356-bb1d-6765f5a0cc39 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:09.639558 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72494431-9c1f-4356-bb1d-6765f5a0cc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:09.639558 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72494431-9c1f-4356-bb1d-6765f5a0cc39 admin admin] PATH_INFO: `/v3/projects/ddf8b7647565427597927a2eb7459dcb/users/877e906e3fbc48919820079f358b2930/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:09.640281 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72494431-9c1f-4356-bb1d-6765f5a0cc39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf8b7647565427597927a2eb7459dcb, user_id=877e906e3fbc48919820079f358b2930, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:09.643018 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72494431-9c1f-4356-bb1d-6765f5a0cc39 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:09.654220 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1056/2112] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:09 2022] PUT /identity/v3/projects/ddf8b7647565427597927a2eb7459dcb/users/877e906e3fbc48919820079f358b2930/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:09.655018 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72494431-9c1f-4356-bb1d-6765f5a0cc39 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:09.717177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72494431-9c1f-4356-bb1d-6765f5a0cc39 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:09.723012 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d1384-b719-4a95-a3b5-a61c057dde2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:09.723281 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d1384-b719-4a95-a3b5-a61c057dde2f admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:09.723551 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d1384-b719-4a95-a3b5-a61c057dde2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:09.723814 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d1384-b719-4a95-a3b5-a61c057dde2f admin admin] PATH_INFO: `/v3/projects/96cad96113fa4be48d6b00057437d683/users/12ef5aac038843e38402a44d4e4694e0/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:09.725818 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d1384-b719-4a95-a3b5-a61c057dde2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=96cad96113fa4be48d6b00057437d683, user_id=12ef5aac038843e38402a44d4e4694e0, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:09.728586 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d1384-b719-4a95-a3b5-a61c057dde2f admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:09.740935 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1057/2113] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:09 2022] PUT /identity/v3/projects/96cad96113fa4be48d6b00057437d683/users/12ef5aac038843e38402a44d4e4694e0/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:09.741321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33f740-e7af-4296-a57f-da25dc2aff6e None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:09.741608 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33f740-e7af-4296-a57f-da25dc2aff6e None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:09.741883 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33f740-e7af-4296-a57f-da25dc2aff6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:09.768722 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-18697ad7-44cb-4589-acbd-f3ca662393ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e5d5a664c1a44f2ac7fc9c3812acd2d', 'request_id': 'req-18697ad7-44cb-4589-acbd-f3ca662393ba'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:09.774159 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-18697ad7-44cb-4589-acbd-f3ca662393ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e5d5a664c1a44f2ac7fc9c3812acd2d', 'request_id': 'req-18697ad7-44cb-4589-acbd-f3ca662393ba'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:09.779239 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-6f33f740-e7af-4296-a57f-da25dc2aff6e None None] MFA Rules not processed for user `877e906e3fbc48919820079f358b2930`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:09.780462 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-6f33f740-e7af-4296-a57f-da25dc2aff6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:09.859973 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1058/2114] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:09 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:09.861262 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753519c6-0dba-4f93-9537-7191a57682ed None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:09.862258 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753519c6-0dba-4f93-9537-7191a57682ed None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:09.862572 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753519c6-0dba-4f93-9537-7191a57682ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:09.890811 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-753519c6-0dba-4f93-9537-7191a57682ed None None] MFA Rules not processed for user `12ef5aac038843e38402a44d4e4694e0`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:09.892062 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-753519c6-0dba-4f93-9537-7191a57682ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:09.896130 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-18697ad7-44cb-4589-acbd-f3ca662393ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e5d5a664c1a44f2ac7fc9c3812acd2d', 'request_id': 'req-18697ad7-44cb-4589-acbd-f3ca662393ba'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:09.910335 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-18697ad7-44cb-4589-acbd-f3ca662393ba admin admin] The token cache is being invalidate because project 0e5d5a664c1a44f2ac7fc9c3812acd2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:09.910688 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-18697ad7-44cb-4589-acbd-f3ca662393ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:09.911350 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-18697ad7-44cb-4589-acbd-f3ca662393ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:09.915988 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1057/2115] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:09 2022] DELETE /identity/v3/projects/0e5d5a664c1a44f2ac7fc9c3812acd2d => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:09.915988 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18697ad7-44cb-4589-acbd-f3ca662393ba admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:09.915988 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-18697ad7-44cb-4589-acbd-f3ca662393ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:09.977815 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1059/2116] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:09.979140 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753519c6-0dba-4f93-9537-7191a57682ed None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:09.980875 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-753519c6-0dba-4f93-9537-7191a57682ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:10.017535 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18697ad7-44cb-4589-acbd-f3ca662393ba admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:10.017535 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d04673-eefa-4429-b3bd-e45ad4a99aef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:10.017535 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d04673-eefa-4429-b3bd-e45ad4a99aef service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:10.017535 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d04673-eefa-4429-b3bd-e45ad4a99aef service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:10.017915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d04673-eefa-4429-b3bd-e45ad4a99aef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:10.017915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-15d04673-eefa-4429-b3bd-e45ad4a99aef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:10.030213 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d04673-eefa-4429-b3bd-e45ad4a99aef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:10.031643 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d04673-eefa-4429-b3bd-e45ad4a99aef service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:10.041567 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1058/2117] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:09 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:03:10.042525 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d04673-eefa-4429-b3bd-e45ad4a99aef service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:10.043820 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-15d04673-eefa-4429-b3bd-e45ad4a99aef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:10.055246 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d04673-eefa-4429-b3bd-e45ad4a99aef service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:10.055707 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753519c6-0dba-4f93-9537-7191a57682ed None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:10.061142 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229269a-9edc-43b3-9842-0a265ee5ba1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:10.061309 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c3557-f218-4cd1-a661-1dc43c7402cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:10.061418 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229269a-9edc-43b3-9842-0a265ee5ba1a service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:10.061505 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c3557-f218-4cd1-a661-1dc43c7402cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:10.061798 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229269a-9edc-43b3-9842-0a265ee5ba1a service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:10.061931 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c3557-f218-4cd1-a661-1dc43c7402cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:10.062082 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229269a-9edc-43b3-9842-0a265ee5ba1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:10.062175 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c3557-f218-4cd1-a661-1dc43c7402cb admin admin] PATH_INFO: `/v3/users/d5294796ae2c457cab1442fd4187904a` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:10.063387 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c3557-f218-4cd1-a661-1dc43c7402cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5294796ae2c457cab1442fd4187904a)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:10.065292 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c3557-f218-4cd1-a661-1dc43c7402cb admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:10.071787 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229269a-9edc-43b3-9842-0a265ee5ba1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:10.073269 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229269a-9edc-43b3-9842-0a265ee5ba1a service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:10.083678 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1059/2118] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:10 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:03:10.292203 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ac1c3557-f218-4cd1-a661-1dc43c7402cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5294796ae2c457cab1442fd4187904a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:10.332557 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229269a-9edc-43b3-9842-0a265ee5ba1a service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:10.339380 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229269a-9edc-43b3-9842-0a265ee5ba1a service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:10.343106 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bf9ee-8ffa-4177-b769-bb0e213308cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:10.343741 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bf9ee-8ffa-4177-b769-bb0e213308cf service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:10.344017 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bf9ee-8ffa-4177-b769-bb0e213308cf service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:10.344290 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248bf9ee-8ffa-4177-b769-bb0e213308cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:10.346187 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-248bf9ee-8ffa-4177-b769-bb0e213308cf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:10.393103 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ac1c3557-f218-4cd1-a661-1dc43c7402cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5294796ae2c457cab1442fd4187904a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:10.393745 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ac1c3557-f218-4cd1-a661-1dc43c7402cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5294796ae2c457cab1442fd4187904a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:10.401200 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ac1c3557-f218-4cd1-a661-1dc43c7402cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5294796ae2c457cab1442fd4187904a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:10.403769 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bf9ee-8ffa-4177-b769-bb0e213308cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:10.405294 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248bf9ee-8ffa-4177-b769-bb0e213308cf service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:10.415985 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1060/2119] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:03:10.416469 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ac1c3557-f218-4cd1-a661-1dc43c7402cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5294796ae2c457cab1442fd4187904a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:10.416734 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bf9ee-8ffa-4177-b769-bb0e213308cf service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:10.422773 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1060/2120] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:03:09 2022] DELETE /identity/v3/users/d5294796ae2c457cab1442fd4187904a => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:10.428467 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248bf9ee-8ffa-4177-b769-bb0e213308cf service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:10.484658 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd824d10-7a8d-49c7-ae97-2732572eb772 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:10.485361 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd824d10-7a8d-49c7-ae97-2732572eb772 service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:10.485627 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd824d10-7a8d-49c7-ae97-2732572eb772 service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:10.485934 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd824d10-7a8d-49c7-ae97-2732572eb772 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:10.487824 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-bd824d10-7a8d-49c7-ae97-2732572eb772 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:10.557054 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd824d10-7a8d-49c7-ae97-2732572eb772 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:10.559019 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd824d10-7a8d-49c7-ae97-2732572eb772 service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:10.568502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1061/2121] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:03:10.847257 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c3557-f218-4cd1-a661-1dc43c7402cb admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:10.849640 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ac1c3557-f218-4cd1-a661-1dc43c7402cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:10.930786 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c3557-f218-4cd1-a661-1dc43c7402cb admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:10.936136 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3806f74-6f2d-4136-9304-0c2c978a3809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:10.936987 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3806f74-6f2d-4136-9304-0c2c978a3809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:10.937266 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3806f74-6f2d-4136-9304-0c2c978a3809 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:10.937539 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3806f74-6f2d-4136-9304-0c2c978a3809 admin admin] PATH_INFO: `/v3/projects/bf13bb60be564682a670f599ba39d915` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:10.938723 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3806f74-6f2d-4136-9304-0c2c978a3809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf13bb60be564682a670f599ba39d915)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:10.940638 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3806f74-6f2d-4136-9304-0c2c978a3809 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:11.054755 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b3806f74-6f2d-4136-9304-0c2c978a3809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf13bb60be564682a670f599ba39d915', 'request_id': 'req-b3806f74-6f2d-4136-9304-0c2c978a3809'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:11.134213 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b3806f74-6f2d-4136-9304-0c2c978a3809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf13bb60be564682a670f599ba39d915', 'request_id': 'req-b3806f74-6f2d-4136-9304-0c2c978a3809'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:11.141453 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b3806f74-6f2d-4136-9304-0c2c978a3809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf13bb60be564682a670f599ba39d915', 'request_id': 'req-b3806f74-6f2d-4136-9304-0c2c978a3809'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:11.153725 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b3806f74-6f2d-4136-9304-0c2c978a3809 admin admin] The token cache is being invalidate because project bf13bb60be564682a670f599ba39d915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:11.154013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b3806f74-6f2d-4136-9304-0c2c978a3809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:11.154656 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b3806f74-6f2d-4136-9304-0c2c978a3809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:11.156480 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1061/2122] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:10 2022] DELETE /identity/v3/projects/bf13bb60be564682a670f599ba39d915 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:11.160311 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd824d10-7a8d-49c7-ae97-2732572eb772 service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:11.172125 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd824d10-7a8d-49c7-ae97-2732572eb772 service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:11.236495 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1bca9-aed4-429c-af50-eff2185bf3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:11.237445 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1bca9-aed4-429c-af50-eff2185bf3b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:11.237730 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1bca9-aed4-429c-af50-eff2185bf3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:11.238009 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1bca9-aed4-429c-af50-eff2185bf3b2 admin admin] PATH_INFO: `/v3/users/ea2a581295fd40738e9c9daa13e856fc` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:11.239264 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1bca9-aed4-429c-af50-eff2185bf3b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea2a581295fd40738e9c9daa13e856fc)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:11.241198 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1bca9-aed4-429c-af50-eff2185bf3b2 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:11.423567 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-59d1bca9-aed4-429c-af50-eff2185bf3b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea2a581295fd40738e9c9daa13e856fc'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:11.433420 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-59d1bca9-aed4-429c-af50-eff2185bf3b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea2a581295fd40738e9c9daa13e856fc'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:11.484292 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-59d1bca9-aed4-429c-af50-eff2185bf3b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea2a581295fd40738e9c9daa13e856fc'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:11.485103 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-59d1bca9-aed4-429c-af50-eff2185bf3b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea2a581295fd40738e9c9daa13e856fc'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:11.497247 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-59d1bca9-aed4-429c-af50-eff2185bf3b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea2a581295fd40738e9c9daa13e856fc'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:11.503073 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1062/2123] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:03:11 2022] DELETE /identity/v3/users/ea2a581295fd40738e9c9daa13e856fc => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:11.640257 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b601be2-d483-4f68-bcf6-ab6c0f95fb48 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:11.640616 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b601be2-d483-4f68-bcf6-ab6c0f95fb48 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:11.640959 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b601be2-d483-4f68-bcf6-ab6c0f95fb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:11.659021 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-8b601be2-d483-4f68-bcf6-ab6c0f95fb48 None None] MFA Rules not processed for user `8c69ae8ba4a344fa8158584fce641c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:11.660217 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-8b601be2-d483-4f68-bcf6-ab6c0f95fb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:11.717467 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1062/2124] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:12.278670 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1bca9-aed4-429c-af50-eff2185bf3b2 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:12.278670 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-59d1bca9-aed4-429c-af50-eff2185bf3b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:12.376918 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1bca9-aed4-429c-af50-eff2185bf3b2 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:12.384653 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ffba5-391b-4331-a02c-fa9e9d77b145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:12.385523 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ffba5-391b-4331-a02c-fa9e9d77b145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:12.385803 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ffba5-391b-4331-a02c-fa9e9d77b145 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:12.386079 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ffba5-391b-4331-a02c-fa9e9d77b145 admin admin] PATH_INFO: `/v3/projects/d5a9832efa624730aa8f894fc479b154` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:12.387329 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ffba5-391b-4331-a02c-fa9e9d77b145 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5a9832efa624730aa8f894fc479b154)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:12.395673 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ffba5-391b-4331-a02c-fa9e9d77b145 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:12.541531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-b99ffba5-391b-4331-a02c-fa9e9d77b145 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5a9832efa624730aa8f894fc479b154', 'request_id': 'req-b99ffba5-391b-4331-a02c-fa9e9d77b145'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:12.547377 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-b99ffba5-391b-4331-a02c-fa9e9d77b145 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5a9832efa624730aa8f894fc479b154', 'request_id': 'req-b99ffba5-391b-4331-a02c-fa9e9d77b145'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:12.667344 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-b99ffba5-391b-4331-a02c-fa9e9d77b145 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5a9832efa624730aa8f894fc479b154', 'request_id': 'req-b99ffba5-391b-4331-a02c-fa9e9d77b145'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:12.679484 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-b99ffba5-391b-4331-a02c-fa9e9d77b145 admin admin] The token cache is being invalidate because project d5a9832efa624730aa8f894fc479b154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:12.683654 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-b99ffba5-391b-4331-a02c-fa9e9d77b145 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:12.683654 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-b99ffba5-391b-4331-a02c-fa9e9d77b145 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:12.683654 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1063/2125] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:12 2022] DELETE /identity/v3/projects/d5a9832efa624730aa8f894fc479b154 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:13.855170 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b601be2-d483-4f68-bcf6-ab6c0f95fb48 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:13.856173 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-8b601be2-d483-4f68-bcf6-ab6c0f95fb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:13.869976 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b601be2-d483-4f68-bcf6-ab6c0f95fb48 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:13.926886 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e68a4f-8dc1-4654-915c-9bfa52da6df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:13.927766 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e68a4f-8dc1-4654-915c-9bfa52da6df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:13.928052 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e68a4f-8dc1-4654-915c-9bfa52da6df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:13.928323 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e68a4f-8dc1-4654-915c-9bfa52da6df4 admin admin] PATH_INFO: `/v3/users/e1bb6fe541114361801debd74e521907` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:13.929553 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e68a4f-8dc1-4654-915c-9bfa52da6df4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1bb6fe541114361801debd74e521907)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:13.931679 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e68a4f-8dc1-4654-915c-9bfa52da6df4 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:14.201415 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-a0e68a4f-8dc1-4654-915c-9bfa52da6df4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1bb6fe541114361801debd74e521907'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:14.296214 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-a0e68a4f-8dc1-4654-915c-9bfa52da6df4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1bb6fe541114361801debd74e521907'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:14.296853 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-a0e68a4f-8dc1-4654-915c-9bfa52da6df4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1bb6fe541114361801debd74e521907'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:14.304154 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-a0e68a4f-8dc1-4654-915c-9bfa52da6df4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1bb6fe541114361801debd74e521907'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:14.316807 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-a0e68a4f-8dc1-4654-915c-9bfa52da6df4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1bb6fe541114361801debd74e521907'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:14.322687 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1063/2126] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:03:13 2022] DELETE /identity/v3/users/e1bb6fe541114361801debd74e521907 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:14.327845 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a675d5-6157-4496-bd02-ba73ec854972 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:14.328370 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a675d5-6157-4496-bd02-ba73ec854972 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:14.328491 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a675d5-6157-4496-bd02-ba73ec854972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:14.356028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-68a675d5-6157-4496-bd02-ba73ec854972 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:14.358749 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-68a675d5-6157-4496-bd02-ba73ec854972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:14.430956 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1064/2127] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:14.440490 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e68a4f-8dc1-4654-915c-9bfa52da6df4 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:14.441932 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-a0e68a4f-8dc1-4654-915c-9bfa52da6df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:14.506661 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e68a4f-8dc1-4654-915c-9bfa52da6df4 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:14.510274 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d144b4-83fe-42f0-9262-0e45c9b842f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:14.510939 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d144b4-83fe-42f0-9262-0e45c9b842f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:14.511269 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d144b4-83fe-42f0-9262-0e45c9b842f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:14.511542 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d144b4-83fe-42f0-9262-0e45c9b842f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:14.520833 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d144b4-83fe-42f0-9262-0e45c9b842f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:14.522260 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d144b4-83fe-42f0-9262-0e45c9b842f8 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:14.531847 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1064/2128] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:03:15.192606 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a675d5-6157-4496-bd02-ba73ec854972 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:15.194248 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-68a675d5-6157-4496-bd02-ba73ec854972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:15.209228 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a675d5-6157-4496-bd02-ba73ec854972 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:15.235569 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69e23e-2e23-48e8-8f6c-a123e390cde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:15.236613 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69e23e-2e23-48e8-8f6c-a123e390cde0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:15.236897 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69e23e-2e23-48e8-8f6c-a123e390cde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:15.237167 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69e23e-2e23-48e8-8f6c-a123e390cde0 admin admin] PATH_INFO: `/v3/projects/2995794a7a5240ecaa2077861d3985ba` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:15.244534 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69e23e-2e23-48e8-8f6c-a123e390cde0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2995794a7a5240ecaa2077861d3985ba)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:15.248161 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca69e23e-2e23-48e8-8f6c-a123e390cde0 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:15.332762 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ca69e23e-2e23-48e8-8f6c-a123e390cde0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2995794a7a5240ecaa2077861d3985ba', 'request_id': 'req-ca69e23e-2e23-48e8-8f6c-a123e390cde0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:15.344019 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ca69e23e-2e23-48e8-8f6c-a123e390cde0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2995794a7a5240ecaa2077861d3985ba', 'request_id': 'req-ca69e23e-2e23-48e8-8f6c-a123e390cde0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:15.416412 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ca69e23e-2e23-48e8-8f6c-a123e390cde0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2995794a7a5240ecaa2077861d3985ba', 'request_id': 'req-ca69e23e-2e23-48e8-8f6c-a123e390cde0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:15.430887 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ca69e23e-2e23-48e8-8f6c-a123e390cde0 admin admin] The token cache is being invalidate because project 2995794a7a5240ecaa2077861d3985ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:15.431183 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ca69e23e-2e23-48e8-8f6c-a123e390cde0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:15.431904 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ca69e23e-2e23-48e8-8f6c-a123e390cde0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:15.433486 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1065/2129] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:15 2022] DELETE /identity/v3/projects/2995794a7a5240ecaa2077861d3985ba => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:15.437652 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d144b4-83fe-42f0-9262-0e45c9b842f8 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:15.449199 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d144b4-83fe-42f0-9262-0e45c9b842f8 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:15.506931 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e3121b-4bf1-4980-8e6d-9ec10bb04bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:15.508005 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3121b-4bf1-4980-8e6d-9ec10bb04bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:15.508289 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3121b-4bf1-4980-8e6d-9ec10bb04bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:15.508564 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e3121b-4bf1-4980-8e6d-9ec10bb04bcb admin admin] PATH_INFO: `/v3/users/24c2f909e04e40398b1db9a04bb3474e` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:15.509770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3121b-4bf1-4980-8e6d-9ec10bb04bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c2f909e04e40398b1db9a04bb3474e)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:15.512323 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e3121b-4bf1-4980-8e6d-9ec10bb04bcb admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:15.680088 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-72e3121b-4bf1-4980-8e6d-9ec10bb04bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c2f909e04e40398b1db9a04bb3474e'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:15.753668 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-72e3121b-4bf1-4980-8e6d-9ec10bb04bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c2f909e04e40398b1db9a04bb3474e'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:15.754889 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-72e3121b-4bf1-4980-8e6d-9ec10bb04bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c2f909e04e40398b1db9a04bb3474e'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:15.763647 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-72e3121b-4bf1-4980-8e6d-9ec10bb04bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c2f909e04e40398b1db9a04bb3474e'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:15.775915 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-72e3121b-4bf1-4980-8e6d-9ec10bb04bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c2f909e04e40398b1db9a04bb3474e'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:15.782086 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1065/2130] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:03:15 2022] DELETE /identity/v3/users/24c2f909e04e40398b1db9a04bb3474e => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:03:16.182796 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69e23e-2e23-48e8-8f6c-a123e390cde0 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:16.184841 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-ca69e23e-2e23-48e8-8f6c-a123e390cde0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:16.198500 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca69e23e-2e23-48e8-8f6c-a123e390cde0 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:16.253828 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f65837d-5ddb-480f-9865-6124789cb3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:16.254662 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65837d-5ddb-480f-9865-6124789cb3df admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:16.255078 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65837d-5ddb-480f-9865-6124789cb3df admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:16.255234 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f65837d-5ddb-480f-9865-6124789cb3df admin admin] PATH_INFO: `/v3/projects/991ecc7a9bd446ae90c68225235517b6` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:16.256468 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65837d-5ddb-480f-9865-6124789cb3df admin admin] RBAC: Authorizing `identity:delete_project(project_id=991ecc7a9bd446ae90c68225235517b6)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:16.258314 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f65837d-5ddb-480f-9865-6124789cb3df admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:16.383018 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6f65837d-5ddb-480f-9865-6124789cb3df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '991ecc7a9bd446ae90c68225235517b6', 'request_id': 'req-6f65837d-5ddb-480f-9865-6124789cb3df'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:16.388883 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6f65837d-5ddb-480f-9865-6124789cb3df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '991ecc7a9bd446ae90c68225235517b6', 'request_id': 'req-6f65837d-5ddb-480f-9865-6124789cb3df'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:16.455883 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6f65837d-5ddb-480f-9865-6124789cb3df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '991ecc7a9bd446ae90c68225235517b6', 'request_id': 'req-6f65837d-5ddb-480f-9865-6124789cb3df'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:16.466917 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6f65837d-5ddb-480f-9865-6124789cb3df admin admin] The token cache is being invalidate because project 991ecc7a9bd446ae90c68225235517b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:16.467204 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6f65837d-5ddb-480f-9865-6124789cb3df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:16.467851 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6f65837d-5ddb-480f-9865-6124789cb3df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:16.469388 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1066/2131] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:16 2022] DELETE /identity/v3/projects/991ecc7a9bd446ae90c68225235517b6 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:16.475568 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce549fb-fcfd-4a37-999c-c46f7353d0f2 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:16.476017 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce549fb-fcfd-4a37-999c-c46f7353d0f2 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:16.476129 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce549fb-fcfd-4a37-999c-c46f7353d0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:16.493636 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-dce549fb-fcfd-4a37-999c-c46f7353d0f2 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:16.494907 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-dce549fb-fcfd-4a37-999c-c46f7353d0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:16.551615 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1066/2132] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:16.561467 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2230e3-a722-4ff6-b258-c3fbd1a885bc None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:16.561776 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2230e3-a722-4ff6-b258-c3fbd1a885bc None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:16.562053 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2230e3-a722-4ff6-b258-c3fbd1a885bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:16.580822 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-db2230e3-a722-4ff6-b258-c3fbd1a885bc None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:16.585078 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-db2230e3-a722-4ff6-b258-c3fbd1a885bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:16.589789 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1067/2133] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:16.593831 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce549fb-fcfd-4a37-999c-c46f7353d0f2 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:16.603182 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce549fb-fcfd-4a37-999c-c46f7353d0f2 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:16.607924 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1d964-566d-4761-a9a7-ff9508386f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:16.608557 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1d964-566d-4761-a9a7-ff9508386f8b admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:16.608833 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1d964-566d-4761-a9a7-ff9508386f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:16.609105 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1d964-566d-4761-a9a7-ff9508386f8b admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:16.609821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e1d964-566d-4761-a9a7-ff9508386f8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:03:16.610127 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e1d964-566d-4761-a9a7-ff9508386f8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:16.611736 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e1d964-566d-4761-a9a7-ff9508386f8b admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:16.623443 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1067/2134] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:03:16.627652 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2230e3-a722-4ff6-b258-c3fbd1a885bc None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:16.637214 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2230e3-a722-4ff6-b258-c3fbd1a885bc None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:16.641728 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6845a60-770e-4595-8dee-4e6e47780560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:16.642360 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6845a60-770e-4595-8dee-4e6e47780560 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:16.642637 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6845a60-770e-4595-8dee-4e6e47780560 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:16.642939 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6845a60-770e-4595-8dee-4e6e47780560 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:16.643618 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6845a60-770e-4595-8dee-4e6e47780560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:16.645488 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6845a60-770e-4595-8dee-4e6e47780560 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:16.725237 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1068/2135] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:03:16 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:03:16.729275 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1d964-566d-4761-a9a7-ff9508386f8b admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:16.739682 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1d964-566d-4761-a9a7-ff9508386f8b admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:16.792827 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6de53-4b95-48c7-8f5f-2e3664f86a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:16.793493 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6de53-4b95-48c7-8f5f-2e3664f86a5a admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:16.793769 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6de53-4b95-48c7-8f5f-2e3664f86a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:16.794037 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da6de53-4b95-48c7-8f5f-2e3664f86a5a admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:16.794711 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6de53-4b95-48c7-8f5f-2e3664f86a5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:16.796629 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da6de53-4b95-48c7-8f5f-2e3664f86a5a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:16.866744 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1068/2136] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:03:16 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:16.871470 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6845a60-770e-4595-8dee-4e6e47780560 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:16.881618 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6845a60-770e-4595-8dee-4e6e47780560 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:16.886243 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d883683-3955-41fd-94ec-d4ad8c20fbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:16.886920 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d883683-3955-41fd-94ec-d4ad8c20fbe9 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:16.887201 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d883683-3955-41fd-94ec-d4ad8c20fbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:16.887471 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d883683-3955-41fd-94ec-d4ad8c20fbe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:16.888195 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d883683-3955-41fd-94ec-d4ad8c20fbe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:16.889763 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d883683-3955-41fd-94ec-d4ad8c20fbe9 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:16.899967 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1069/2137] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:16.903746 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6de53-4b95-48c7-8f5f-2e3664f86a5a admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:16.913636 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da6de53-4b95-48c7-8f5f-2e3664f86a5a admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:16.918743 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bbf63-4c5e-45fd-a56b-f98cfe5a92c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:16.919406 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bbf63-4c5e-45fd-a56b-f98cfe5a92c4 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:16.919684 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bbf63-4c5e-45fd-a56b-f98cfe5a92c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:16.919954 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bbf63-4c5e-45fd-a56b-f98cfe5a92c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:16.920708 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bbf63-4c5e-45fd-a56b-f98cfe5a92c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:16.922271 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bbf63-4c5e-45fd-a56b-f98cfe5a92c4 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:16.931745 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1069/2138] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:16.936106 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d883683-3955-41fd-94ec-d4ad8c20fbe9 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:16.945913 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d883683-3955-41fd-94ec-d4ad8c20fbe9 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:16.950594 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed4ebe-fd69-4aed-b522-431ab8c40d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:16.951489 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed4ebe-fd69-4aed-b522-431ab8c40d26 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:16.951771 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed4ebe-fd69-4aed-b522-431ab8c40d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:16.952073 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed4ebe-fd69-4aed-b522-431ab8c40d26 admin admin] PATH_INFO: `/v3/projects/959a323f1b6b4906bb0eec136f99dd27/users/586468c69860497fa5882b4fc28701f5/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:16.966304 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed4ebe-fd69-4aed-b522-431ab8c40d26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=959a323f1b6b4906bb0eec136f99dd27, user_id=586468c69860497fa5882b4fc28701f5, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:16.968991 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed4ebe-fd69-4aed-b522-431ab8c40d26 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:17.034618 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1070/2139] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:16 2022] PUT /identity/v3/projects/959a323f1b6b4906bb0eec136f99dd27/users/586468c69860497fa5882b4fc28701f5/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:17.046467 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409028b-58d2-4f19-808d-f7225e4ee667 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:17.047092 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409028b-58d2-4f19-808d-f7225e4ee667 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:17.047092 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409028b-58d2-4f19-808d-f7225e4ee667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:17.073923 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-7409028b-58d2-4f19-808d-f7225e4ee667 None None] MFA Rules not processed for user `586468c69860497fa5882b4fc28701f5`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:17.075615 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-7409028b-58d2-4f19-808d-f7225e4ee667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:17.162005 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1070/2140] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:03:17.166454 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed4ebe-fd69-4aed-b522-431ab8c40d26 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:17.225789 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed4ebe-fd69-4aed-b522-431ab8c40d26 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:17.231165 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6180892-1210-4a09-b165-816cae359842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:17.232072 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6180892-1210-4a09-b165-816cae359842 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:17.232356 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6180892-1210-4a09-b165-816cae359842 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:17.232631 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6180892-1210-4a09-b165-816cae359842 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:17.233316 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6180892-1210-4a09-b165-816cae359842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:17.235239 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6180892-1210-4a09-b165-816cae359842 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:17.314721 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1071/2141] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:03:17 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:03:17.317954 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409028b-58d2-4f19-808d-f7225e4ee667 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:17.328607 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409028b-58d2-4f19-808d-f7225e4ee667 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:17.384603 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6d5b3-bac7-4912-8890-7aef9a43787b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:17.385217 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6d5b3-bac7-4912-8890-7aef9a43787b admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:17.385497 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6d5b3-bac7-4912-8890-7aef9a43787b admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:17.385768 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6d5b3-bac7-4912-8890-7aef9a43787b admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:17.387020 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6d5b3-bac7-4912-8890-7aef9a43787b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:17.388928 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6d5b3-bac7-4912-8890-7aef9a43787b admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:17.456198 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1071/2142] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:03:17 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:17.460391 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6180892-1210-4a09-b165-816cae359842 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:17.471239 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6180892-1210-4a09-b165-816cae359842 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:17.475776 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a4bfc-e2dc-4d26-b6db-d2db0eb98038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:17.476426 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a4bfc-e2dc-4d26-b6db-d2db0eb98038 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:17.476703 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a4bfc-e2dc-4d26-b6db-d2db0eb98038 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:17.476976 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a4bfc-e2dc-4d26-b6db-d2db0eb98038 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:17.477724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a4bfc-e2dc-4d26-b6db-d2db0eb98038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:17.479344 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a4bfc-e2dc-4d26-b6db-d2db0eb98038 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:17.489820 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1072/2143] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:17.493839 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6d5b3-bac7-4912-8890-7aef9a43787b admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:17.503757 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6d5b3-bac7-4912-8890-7aef9a43787b admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:17.508306 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b330374-31eb-4bef-9a0e-5ff4f0f9b44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:17.509163 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b330374-31eb-4bef-9a0e-5ff4f0f9b44b admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:17.509440 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b330374-31eb-4bef-9a0e-5ff4f0f9b44b admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:17.510145 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b330374-31eb-4bef-9a0e-5ff4f0f9b44b admin admin] PATH_INFO: `/v3/projects/810d4156ae234220912e50c493510737/users/9de6a87dd1a648f0b0d6ad4740e93a85/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:17.524589 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b330374-31eb-4bef-9a0e-5ff4f0f9b44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=810d4156ae234220912e50c493510737, user_id=9de6a87dd1a648f0b0d6ad4740e93a85, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:17.527888 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b330374-31eb-4bef-9a0e-5ff4f0f9b44b admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:17.597946 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1072/2144] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:17 2022] PUT /identity/v3/projects/810d4156ae234220912e50c493510737/users/9de6a87dd1a648f0b0d6ad4740e93a85/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:03:17.602067 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a4bfc-e2dc-4d26-b6db-d2db0eb98038 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:17.613001 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a4bfc-e2dc-4d26-b6db-d2db0eb98038 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:17.668638 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e87c17-608c-46e7-84a7-efe6c7d8e70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:17.669222 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e87c17-608c-46e7-84a7-efe6c7d8e70e admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:17.669499 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e87c17-608c-46e7-84a7-efe6c7d8e70e admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:17.669767 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e87c17-608c-46e7-84a7-efe6c7d8e70e admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:17.670481 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e87c17-608c-46e7-84a7-efe6c7d8e70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:17.672154 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e87c17-608c-46e7-84a7-efe6c7d8e70e admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:17.681551 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1073/2145] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:17.686207 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b330374-31eb-4bef-9a0e-5ff4f0f9b44b admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:17.696358 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b330374-31eb-4bef-9a0e-5ff4f0f9b44b admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:17.701012 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbb57e-7fdc-4daf-983d-dba38de04fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:17.701872 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbb57e-7fdc-4daf-983d-dba38de04fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:17.702147 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbb57e-7fdc-4daf-983d-dba38de04fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:17.702414 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dbb57e-7fdc-4daf-983d-dba38de04fdb admin admin] PATH_INFO: `/v3/projects/810d4156ae234220912e50c493510737/users/9de6a87dd1a648f0b0d6ad4740e93a85/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:17.704378 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dbb57e-7fdc-4daf-983d-dba38de04fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=810d4156ae234220912e50c493510737, user_id=9de6a87dd1a648f0b0d6ad4740e93a85, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:17.707046 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dbb57e-7fdc-4daf-983d-dba38de04fdb admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:17.717752 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1073/2146] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:17 2022] PUT /identity/v3/projects/810d4156ae234220912e50c493510737/users/9de6a87dd1a648f0b0d6ad4740e93a85/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:17.733056 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7c8dd-be97-4fbe-b37a-8462c64bbd07 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:17.733409 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7c8dd-be97-4fbe-b37a-8462c64bbd07 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:17.733689 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7c8dd-be97-4fbe-b37a-8462c64bbd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:17.762008 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-1db7c8dd-be97-4fbe-b37a-8462c64bbd07 None None] MFA Rules not processed for user `9de6a87dd1a648f0b0d6ad4740e93a85`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:17.763204 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1db7c8dd-be97-4fbe-b37a-8462c64bbd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:17.828201 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1074/2147] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:17.839689 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbb57e-7fdc-4daf-983d-dba38de04fdb admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:17.841464 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-39dbb57e-7fdc-4daf-983d-dba38de04fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:17.898103 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dbb57e-7fdc-4daf-983d-dba38de04fdb admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:17.902678 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704402f-7b3a-4932-8552-bb76adee5d5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:17.905417 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704402f-7b3a-4932-8552-bb76adee5d5d service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:17.905417 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704402f-7b3a-4932-8552-bb76adee5d5d service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:17.905417 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704402f-7b3a-4932-8552-bb76adee5d5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:17.959480 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704402f-7b3a-4932-8552-bb76adee5d5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:17.960916 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704402f-7b3a-4932-8552-bb76adee5d5d service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:17.970744 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1074/2148] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:03:19.488299 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7c8dd-be97-4fbe-b37a-8462c64bbd07 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:19.490549 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1db7c8dd-be97-4fbe-b37a-8462c64bbd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:19.609552 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7c8dd-be97-4fbe-b37a-8462c64bbd07 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:19.614925 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b8849-7515-417e-9bdf-562461a9c6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:19.616063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b8849-7515-417e-9bdf-562461a9c6ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:19.616447 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b8849-7515-417e-9bdf-562461a9c6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:19.616783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5b8849-7515-417e-9bdf-562461a9c6ce admin admin] PATH_INFO: `/v3/users/cdc3bcd74cf242feb3beeca65131467b` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:19.620158 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b8849-7515-417e-9bdf-562461a9c6ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdc3bcd74cf242feb3beeca65131467b)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:19.622375 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5b8849-7515-417e-9bdf-562461a9c6ce admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:19.829967 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ab5b8849-7515-417e-9bdf-562461a9c6ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdc3bcd74cf242feb3beeca65131467b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:19.837856 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ab5b8849-7515-417e-9bdf-562461a9c6ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdc3bcd74cf242feb3beeca65131467b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:19.930490 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ab5b8849-7515-417e-9bdf-562461a9c6ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdc3bcd74cf242feb3beeca65131467b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:19.931159 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ab5b8849-7515-417e-9bdf-562461a9c6ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdc3bcd74cf242feb3beeca65131467b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:19.943695 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ab5b8849-7515-417e-9bdf-562461a9c6ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdc3bcd74cf242feb3beeca65131467b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:19.950151 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1075/2149] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:03:19 2022] DELETE /identity/v3/users/cdc3bcd74cf242feb3beeca65131467b => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:19.954821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f4225-846b-4810-95b2-48ea02ff4acd None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:19.955314 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f4225-846b-4810-95b2-48ea02ff4acd None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:19.955408 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f4225-846b-4810-95b2-48ea02ff4acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:19.972758 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-794f4225-846b-4810-95b2-48ea02ff4acd None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:19.973961 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-794f4225-846b-4810-95b2-48ea02ff4acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:20.043099 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1075/2150] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:20.052863 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b8849-7515-417e-9bdf-562461a9c6ce admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:20.054675 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-ab5b8849-7515-417e-9bdf-562461a9c6ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:20.127857 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5b8849-7515-417e-9bdf-562461a9c6ce admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:20.131578 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b7887-6781-463e-ad6b-30cac1e2199e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:20.132223 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b7887-6781-463e-ad6b-30cac1e2199e service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:20.132504 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b7887-6781-463e-ad6b-30cac1e2199e service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:20.132780 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b7887-6781-463e-ad6b-30cac1e2199e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:20.142462 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b7887-6781-463e-ad6b-30cac1e2199e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:20.144147 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17b7887-6781-463e-ad6b-30cac1e2199e service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:20.153771 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1076/2151] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:03:20.600807 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f4225-846b-4810-95b2-48ea02ff4acd None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:20.602286 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-794f4225-846b-4810-95b2-48ea02ff4acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:20.622013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f4225-846b-4810-95b2-48ea02ff4acd None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:20.624321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e7bfe-6f14-4cc6-969b-8cdd1888891d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:20.625231 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e7bfe-6f14-4cc6-969b-8cdd1888891d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:20.625512 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e7bfe-6f14-4cc6-969b-8cdd1888891d admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:20.625849 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e7bfe-6f14-4cc6-969b-8cdd1888891d admin admin] PATH_INFO: `/v3/projects/4936cb18cc8f4cca824f6aefbb386bc7` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:20.627036 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e7bfe-6f14-4cc6-969b-8cdd1888891d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4936cb18cc8f4cca824f6aefbb386bc7)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:20.628961 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e7bfe-6f14-4cc6-969b-8cdd1888891d admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:20.795339 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-5e8e7bfe-6f14-4cc6-969b-8cdd1888891d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4936cb18cc8f4cca824f6aefbb386bc7', 'request_id': 'req-5e8e7bfe-6f14-4cc6-969b-8cdd1888891d'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:20.873355 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-5e8e7bfe-6f14-4cc6-969b-8cdd1888891d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4936cb18cc8f4cca824f6aefbb386bc7', 'request_id': 'req-5e8e7bfe-6f14-4cc6-969b-8cdd1888891d'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:20.879441 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-5e8e7bfe-6f14-4cc6-969b-8cdd1888891d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4936cb18cc8f4cca824f6aefbb386bc7', 'request_id': 'req-5e8e7bfe-6f14-4cc6-969b-8cdd1888891d'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:20.890657 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-5e8e7bfe-6f14-4cc6-969b-8cdd1888891d admin admin] The token cache is being invalidate because project 4936cb18cc8f4cca824f6aefbb386bc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:20.890975 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-5e8e7bfe-6f14-4cc6-969b-8cdd1888891d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:20.891627 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-5e8e7bfe-6f14-4cc6-969b-8cdd1888891d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:20.893690 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1076/2152] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:20 2022] DELETE /identity/v3/projects/4936cb18cc8f4cca824f6aefbb386bc7 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:20.897519 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b7887-6781-463e-ad6b-30cac1e2199e service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:20.908186 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17b7887-6781-463e-ad6b-30cac1e2199e service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:20.966084 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3c77e-6bdd-4d02-906d-458c9e7aa6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:20.966992 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3c77e-6bdd-4d02-906d-458c9e7aa6e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:20.967276 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3c77e-6bdd-4d02-906d-458c9e7aa6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:20.967551 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3c77e-6bdd-4d02-906d-458c9e7aa6e8 admin admin] PATH_INFO: `/v3/users/12ef5aac038843e38402a44d4e4694e0` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:20.968765 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3c77e-6bdd-4d02-906d-458c9e7aa6e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12ef5aac038843e38402a44d4e4694e0)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:20.970641 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3c77e-6bdd-4d02-906d-458c9e7aa6e8 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:21.140735 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e7bfe-6f14-4cc6-969b-8cdd1888891d admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:21.142207 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-5e8e7bfe-6f14-4cc6-969b-8cdd1888891d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:21.148076 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-3cc3c77e-6bdd-4d02-906d-458c9e7aa6e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ef5aac038843e38402a44d4e4694e0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:21.156593 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-3cc3c77e-6bdd-4d02-906d-458c9e7aa6e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ef5aac038843e38402a44d4e4694e0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:21.161802 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e7bfe-6f14-4cc6-969b-8cdd1888891d admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:21.165120 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a88fe8-9cfa-485e-a35d-94387d2604be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:21.166162 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a88fe8-9cfa-485e-a35d-94387d2604be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:21.166599 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a88fe8-9cfa-485e-a35d-94387d2604be admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:21.166895 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a88fe8-9cfa-485e-a35d-94387d2604be admin admin] PATH_INFO: `/v3/users/586468c69860497fa5882b4fc28701f5` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:21.168158 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a88fe8-9cfa-485e-a35d-94387d2604be admin admin] RBAC: Authorizing `identity:delete_user(user_id=586468c69860497fa5882b4fc28701f5)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:21.170343 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a88fe8-9cfa-485e-a35d-94387d2604be admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:21.268338 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-3cc3c77e-6bdd-4d02-906d-458c9e7aa6e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ef5aac038843e38402a44d4e4694e0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:21.269139 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-3cc3c77e-6bdd-4d02-906d-458c9e7aa6e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ef5aac038843e38402a44d4e4694e0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:21.283236 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-3cc3c77e-6bdd-4d02-906d-458c9e7aa6e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ef5aac038843e38402a44d4e4694e0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:21.290664 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1077/2153] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:03:20 2022] DELETE /identity/v3/users/12ef5aac038843e38402a44d4e4694e0 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:21.453015 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d2a88fe8-9cfa-485e-a35d-94387d2604be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '586468c69860497fa5882b4fc28701f5'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:21.541894 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d2a88fe8-9cfa-485e-a35d-94387d2604be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '586468c69860497fa5882b4fc28701f5'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:21.542555 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d2a88fe8-9cfa-485e-a35d-94387d2604be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '586468c69860497fa5882b4fc28701f5'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:21.550306 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d2a88fe8-9cfa-485e-a35d-94387d2604be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '586468c69860497fa5882b4fc28701f5'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:21.563076 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d2a88fe8-9cfa-485e-a35d-94387d2604be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '586468c69860497fa5882b4fc28701f5'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:21.569012 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1077/2154] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:03:21 2022] DELETE /identity/v3/users/586468c69860497fa5882b4fc28701f5 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:21.573513 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3746d4c-c78f-4214-b6d7-7af9f77b1664 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:21.574415 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3746d4c-c78f-4214-b6d7-7af9f77b1664 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:21.574668 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3746d4c-c78f-4214-b6d7-7af9f77b1664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:21.595477 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-d3746d4c-c78f-4214-b6d7-7af9f77b1664 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:21.596688 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d3746d4c-c78f-4214-b6d7-7af9f77b1664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:21.656047 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1078/2155] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:21.665528 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a88fe8-9cfa-485e-a35d-94387d2604be admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:21.667381 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d2a88fe8-9cfa-485e-a35d-94387d2604be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:21.725545 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a88fe8-9cfa-485e-a35d-94387d2604be admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:21.729341 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fcf5d3-7127-4b90-aea6-69225afd31df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:21.730018 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcf5d3-7127-4b90-aea6-69225afd31df service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:21.730528 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcf5d3-7127-4b90-aea6-69225afd31df service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:21.730643 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fcf5d3-7127-4b90-aea6-69225afd31df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:21.740948 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcf5d3-7127-4b90-aea6-69225afd31df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:21.742420 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fcf5d3-7127-4b90-aea6-69225afd31df service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:21.755152 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1078/2156] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:03:21.844840 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3746d4c-c78f-4214-b6d7-7af9f77b1664 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:21.844840 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d3746d4c-c78f-4214-b6d7-7af9f77b1664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:21.864078 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3746d4c-c78f-4214-b6d7-7af9f77b1664 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:21.871157 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed343620-51fb-46e4-84e5-efc99d1f49d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:21.873521 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed343620-51fb-46e4-84e5-efc99d1f49d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:21.873521 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed343620-51fb-46e4-84e5-efc99d1f49d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:21.873521 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed343620-51fb-46e4-84e5-efc99d1f49d2 admin admin] PATH_INFO: `/v3/projects/96cad96113fa4be48d6b00057437d683` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:21.874343 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed343620-51fb-46e4-84e5-efc99d1f49d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96cad96113fa4be48d6b00057437d683)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:21.876317 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed343620-51fb-46e4-84e5-efc99d1f49d2 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:22.005305 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ed343620-51fb-46e4-84e5-efc99d1f49d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96cad96113fa4be48d6b00057437d683', 'request_id': 'req-ed343620-51fb-46e4-84e5-efc99d1f49d2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:22.010804 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ed343620-51fb-46e4-84e5-efc99d1f49d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96cad96113fa4be48d6b00057437d683', 'request_id': 'req-ed343620-51fb-46e4-84e5-efc99d1f49d2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:22.078787 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ed343620-51fb-46e4-84e5-efc99d1f49d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96cad96113fa4be48d6b00057437d683', 'request_id': 'req-ed343620-51fb-46e4-84e5-efc99d1f49d2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:22.091353 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ed343620-51fb-46e4-84e5-efc99d1f49d2 admin admin] The token cache is being invalidate because project 96cad96113fa4be48d6b00057437d683 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:22.091827 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ed343620-51fb-46e4-84e5-efc99d1f49d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:22.092567 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ed343620-51fb-46e4-84e5-efc99d1f49d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:22.094151 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1079/2157] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:21 2022] DELETE /identity/v3/projects/96cad96113fa4be48d6b00057437d683 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:22.099841 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0398af-1288-4666-a623-02ec38e4470e None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:22.100129 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0398af-1288-4666-a623-02ec38e4470e None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:22.100403 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0398af-1288-4666-a623-02ec38e4470e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:22.119292 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-db0398af-1288-4666-a623-02ec38e4470e None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:22.120536 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-db0398af-1288-4666-a623-02ec38e4470e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:22.198617 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1079/2158] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:22.206390 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f980b4a-c1d4-46c3-9f2b-4014ae0f06e3 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:22.206675 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f980b4a-c1d4-46c3-9f2b-4014ae0f06e3 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:22.206996 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f980b4a-c1d4-46c3-9f2b-4014ae0f06e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:22.224979 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-4f980b4a-c1d4-46c3-9f2b-4014ae0f06e3 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:22.230562 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-4f980b4a-c1d4-46c3-9f2b-4014ae0f06e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:22.234845 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1080/2159] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:22.239081 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0398af-1288-4666-a623-02ec38e4470e None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:22.249179 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0398af-1288-4666-a623-02ec38e4470e None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:22.253729 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff055ec1-423e-45df-9d17-1da6c3c68a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:22.254372 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff055ec1-423e-45df-9d17-1da6c3c68a79 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:22.254655 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff055ec1-423e-45df-9d17-1da6c3c68a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:22.254957 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff055ec1-423e-45df-9d17-1da6c3c68a79 admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:22.259265 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff055ec1-423e-45df-9d17-1da6c3c68a79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:03:22.259265 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff055ec1-423e-45df-9d17-1da6c3c68a79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:22.259265 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff055ec1-423e-45df-9d17-1da6c3c68a79 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:22.268876 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1080/2160] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:03:22.273303 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f980b4a-c1d4-46c3-9f2b-4014ae0f06e3 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:22.282939 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f980b4a-c1d4-46c3-9f2b-4014ae0f06e3 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:22.287624 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba37cd-7255-47de-aeaa-a335a82087cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:22.288264 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba37cd-7255-47de-aeaa-a335a82087cc admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:22.288545 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba37cd-7255-47de-aeaa-a335a82087cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:22.288822 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba37cd-7255-47de-aeaa-a335a82087cc admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:22.289533 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba37cd-7255-47de-aeaa-a335a82087cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:22.291754 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba37cd-7255-47de-aeaa-a335a82087cc admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:22.297852 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff055ec1-423e-45df-9d17-1da6c3c68a79 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:22.299907 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ff055ec1-423e-45df-9d17-1da6c3c68a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:22.328807 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff055ec1-423e-45df-9d17-1da6c3c68a79 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:22.328807 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35570ee-d811-424f-927d-3789072d0f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:22.329293 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35570ee-d811-424f-927d-3789072d0f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:22.329572 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35570ee-d811-424f-927d-3789072d0f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:22.329844 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35570ee-d811-424f-927d-3789072d0f7a admin admin] PATH_INFO: `/v3/projects/959a323f1b6b4906bb0eec136f99dd27` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:22.331055 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35570ee-d811-424f-927d-3789072d0f7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=959a323f1b6b4906bb0eec136f99dd27)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:22.332941 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35570ee-d811-424f-927d-3789072d0f7a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:22.387149 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1081/2161] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:03:22 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:22.388510 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba37cd-7255-47de-aeaa-a335a82087cc admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:22.448881 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba37cd-7255-47de-aeaa-a335a82087cc admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:22.453924 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b848e-8db9-433c-9abf-aad27a03bd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:22.454681 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b848e-8db9-433c-9abf-aad27a03bd8d admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:22.455018 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b848e-8db9-433c-9abf-aad27a03bd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:22.455411 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b848e-8db9-433c-9abf-aad27a03bd8d admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:22.456103 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b848e-8db9-433c-9abf-aad27a03bd8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:22.458061 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b848e-8db9-433c-9abf-aad27a03bd8d admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:22.473715 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b35570ee-d811-424f-927d-3789072d0f7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '959a323f1b6b4906bb0eec136f99dd27', 'request_id': 'req-b35570ee-d811-424f-927d-3789072d0f7a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:22.539338 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1082/2162] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:03:22 2022] POST /identity/v3/users => generated 292 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:03:22.540611 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b848e-8db9-433c-9abf-aad27a03bd8d admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:22.541507 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b35570ee-d811-424f-927d-3789072d0f7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '959a323f1b6b4906bb0eec136f99dd27', 'request_id': 'req-b35570ee-d811-424f-927d-3789072d0f7a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:22.548177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b35570ee-d811-424f-927d-3789072d0f7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '959a323f1b6b4906bb0eec136f99dd27', 'request_id': 'req-b35570ee-d811-424f-927d-3789072d0f7a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:22.551990 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b848e-8db9-433c-9abf-aad27a03bd8d admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:22.561182 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b35570ee-d811-424f-927d-3789072d0f7a admin admin] The token cache is being invalidate because project 959a323f1b6b4906bb0eec136f99dd27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:22.561583 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b35570ee-d811-424f-927d-3789072d0f7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:22.562736 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b35570ee-d811-424f-927d-3789072d0f7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:22.575078 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1081/2163] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:22 2022] DELETE /identity/v3/projects/959a323f1b6b4906bb0eec136f99dd27 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:22.578501 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35570ee-d811-424f-927d-3789072d0f7a admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:22.580643 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-b35570ee-d811-424f-927d-3789072d0f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:22.618930 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42775f1-525b-46be-829c-2ceb3c7e5a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:22.619834 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42775f1-525b-46be-829c-2ceb3c7e5a15 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:22.620259 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42775f1-525b-46be-829c-2ceb3c7e5a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:22.620572 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42775f1-525b-46be-829c-2ceb3c7e5a15 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:22.621443 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42775f1-525b-46be-829c-2ceb3c7e5a15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:22.623101 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42775f1-525b-46be-829c-2ceb3c7e5a15 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:22.637824 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1083/2164] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:22.639257 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42775f1-525b-46be-829c-2ceb3c7e5a15 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:22.640963 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-e42775f1-525b-46be-829c-2ceb3c7e5a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:22.654104 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42775f1-525b-46be-829c-2ceb3c7e5a15 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:22.658978 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4da97e-a99f-49c2-8055-44a33f3e2d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:22.668275 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4da97e-a99f-49c2-8055-44a33f3e2d45 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:22.668275 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4da97e-a99f-49c2-8055-44a33f3e2d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:22.668275 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4da97e-a99f-49c2-8055-44a33f3e2d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:22.668275 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4da97e-a99f-49c2-8055-44a33f3e2d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:22.668275 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4da97e-a99f-49c2-8055-44a33f3e2d45 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:22.669056 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35570ee-d811-424f-927d-3789072d0f7a admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:22.673384 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1084/2165] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:22.676816 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96d088-7e6e-4f57-9266-e1d9d6bfad1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:22.677316 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4da97e-a99f-49c2-8055-44a33f3e2d45 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:22.677688 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96d088-7e6e-4f57-9266-e1d9d6bfad1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:22.677968 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96d088-7e6e-4f57-9266-e1d9d6bfad1f admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:22.678240 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96d088-7e6e-4f57-9266-e1d9d6bfad1f admin admin] PATH_INFO: `/v3/users/9de6a87dd1a648f0b0d6ad4740e93a85` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:22.679515 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96d088-7e6e-4f57-9266-e1d9d6bfad1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9de6a87dd1a648f0b0d6ad4740e93a85)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:22.681430 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96d088-7e6e-4f57-9266-e1d9d6bfad1f admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:22.687102 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4da97e-a99f-49c2-8055-44a33f3e2d45 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:22.691741 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3a603-076f-4ddf-b1d5-8b4a0d54963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:22.692607 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3a603-076f-4ddf-b1d5-8b4a0d54963a admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:22.692890 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3a603-076f-4ddf-b1d5-8b4a0d54963a admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:22.693167 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3a603-076f-4ddf-b1d5-8b4a0d54963a admin admin] PATH_INFO: `/v3/projects/51b30738671f4f7789edbe829e6cb0f8/users/cd2c154a2560475bb90d5c7474a44432/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:22.708289 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3a603-076f-4ddf-b1d5-8b4a0d54963a admin admin] RBAC: Authorizing `identity:create_grant(project_id=51b30738671f4f7789edbe829e6cb0f8, user_id=cd2c154a2560475bb90d5c7474a44432, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:22.710931 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3a603-076f-4ddf-b1d5-8b4a0d54963a admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:22.805130 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1085/2166] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:22 2022] PUT /identity/v3/projects/51b30738671f4f7789edbe829e6cb0f8/users/cd2c154a2560475bb90d5c7474a44432/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:03:22.815464 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c6cee-387a-4895-9b70-b926fe6f5c34 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:22.815788 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c6cee-387a-4895-9b70-b926fe6f5c34 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:22.816102 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c6cee-387a-4895-9b70-b926fe6f5c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:22.842352 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-9e0c6cee-387a-4895-9b70-b926fe6f5c34 None None] MFA Rules not processed for user `cd2c154a2560475bb90d5c7474a44432`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:22.843654 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-9e0c6cee-387a-4895-9b70-b926fe6f5c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:22.887832 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-da96d088-7e6e-4f57-9266-e1d9d6bfad1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9de6a87dd1a648f0b0d6ad4740e93a85'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:22.912314 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1086/2167] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:03:22.913090 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c6cee-387a-4895-9b70-b926fe6f5c34 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:22.914334 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-9e0c6cee-387a-4895-9b70-b926fe6f5c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:22.965014 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-da96d088-7e6e-4f57-9266-e1d9d6bfad1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9de6a87dd1a648f0b0d6ad4740e93a85'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:22.965763 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-da96d088-7e6e-4f57-9266-e1d9d6bfad1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9de6a87dd1a648f0b0d6ad4740e93a85'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:22.972981 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-da96d088-7e6e-4f57-9266-e1d9d6bfad1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9de6a87dd1a648f0b0d6ad4740e93a85'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:22.975211 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c6cee-387a-4895-9b70-b926fe6f5c34 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:22.983020 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5735f93-4037-4827-9ec6-fdf0bfa5bbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:22.983020 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5735f93-4037-4827-9ec6-fdf0bfa5bbac admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:22.983020 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5735f93-4037-4827-9ec6-fdf0bfa5bbac admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:22.983020 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5735f93-4037-4827-9ec6-fdf0bfa5bbac admin admin] PATH_INFO: `/v3/users/1eff5ab8e552446ca4b9a7fe5b44c22b` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:22.983379 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5735f93-4037-4827-9ec6-fdf0bfa5bbac admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eff5ab8e552446ca4b9a7fe5b44c22b)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:22.984786 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5735f93-4037-4827-9ec6-fdf0bfa5bbac admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:22.987604 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-da96d088-7e6e-4f57-9266-e1d9d6bfad1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9de6a87dd1a648f0b0d6ad4740e93a85'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:22.993593 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1082/2168] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:03:22 2022] DELETE /identity/v3/users/9de6a87dd1a648f0b0d6ad4740e93a85 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:22.997866 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96d088-7e6e-4f57-9266-e1d9d6bfad1f admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:22.999634 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-da96d088-7e6e-4f57-9266-e1d9d6bfad1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:23.068629 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96d088-7e6e-4f57-9266-e1d9d6bfad1f admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:23.072674 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d40f2-7b08-4680-8c4d-05a4b5023602 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:23.073403 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d40f2-7b08-4680-8c4d-05a4b5023602 service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:23.074406 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d40f2-7b08-4680-8c4d-05a4b5023602 service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:23.074777 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d40f2-7b08-4680-8c4d-05a4b5023602 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:23.076712 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-cb7d40f2-7b08-4680-8c4d-05a4b5023602 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:23.137844 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d40f2-7b08-4680-8c4d-05a4b5023602 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:23.139361 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7d40f2-7b08-4680-8c4d-05a4b5023602 service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:23.148305 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1083/2169] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:03:23.167345 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d40f2-7b08-4680-8c4d-05a4b5023602 service cinder] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:23.168679 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-cb7d40f2-7b08-4680-8c4d-05a4b5023602 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:23.190084 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-b5735f93-4037-4827-9ec6-fdf0bfa5bbac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eff5ab8e552446ca4b9a7fe5b44c22b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:23.198047 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-b5735f93-4037-4827-9ec6-fdf0bfa5bbac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eff5ab8e552446ca4b9a7fe5b44c22b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:23.238138 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7d40f2-7b08-4680-8c4d-05a4b5023602 service cinder] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:23.246299 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789528aa-80a8-4aa2-bc45-3c9b26441e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:23.247227 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789528aa-80a8-4aa2-bc45-3c9b26441e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:23.247510 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789528aa-80a8-4aa2-bc45-3c9b26441e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:23.247853 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789528aa-80a8-4aa2-bc45-3c9b26441e81 admin admin] PATH_INFO: `/v3/users/cd2c154a2560475bb90d5c7474a44432` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:23.249225 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789528aa-80a8-4aa2-bc45-3c9b26441e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd2c154a2560475bb90d5c7474a44432)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:23.251611 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789528aa-80a8-4aa2-bc45-3c9b26441e81 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:23.273601 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-b5735f93-4037-4827-9ec6-fdf0bfa5bbac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eff5ab8e552446ca4b9a7fe5b44c22b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:23.275993 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-b5735f93-4037-4827-9ec6-fdf0bfa5bbac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eff5ab8e552446ca4b9a7fe5b44c22b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:23.291349 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-b5735f93-4037-4827-9ec6-fdf0bfa5bbac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eff5ab8e552446ca4b9a7fe5b44c22b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:23.298085 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1087/2170] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:03:22 2022] DELETE /identity/v3/users/1eff5ab8e552446ca4b9a7fe5b44c22b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:23.302900 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619bbf1-bab5-4528-afdc-ce374fcbb0b0 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:23.303406 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619bbf1-bab5-4528-afdc-ce374fcbb0b0 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:23.303935 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619bbf1-bab5-4528-afdc-ce374fcbb0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:23.324466 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-b619bbf1-bab5-4528-afdc-ce374fcbb0b0 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:23.325895 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-b619bbf1-bab5-4528-afdc-ce374fcbb0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:23.390381 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1088/2171] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:03:23.391521 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-789528aa-80a8-4aa2-bc45-3c9b26441e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd2c154a2560475bb90d5c7474a44432'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:23.400805 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619bbf1-bab5-4528-afdc-ce374fcbb0b0 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:23.404178 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-b619bbf1-bab5-4528-afdc-ce374fcbb0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:23.460378 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619bbf1-bab5-4528-afdc-ce374fcbb0b0 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:23.461737 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-789528aa-80a8-4aa2-bc45-3c9b26441e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd2c154a2560475bb90d5c7474a44432'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:23.464576 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-789528aa-80a8-4aa2-bc45-3c9b26441e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd2c154a2560475bb90d5c7474a44432'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:23.466087 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ae76e-ef64-4646-9f7d-c4ac2d25143e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:23.466735 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ae76e-ef64-4646-9f7d-c4ac2d25143e service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:23.467040 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ae76e-ef64-4646-9f7d-c4ac2d25143e service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:23.467896 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ae76e-ef64-4646-9f7d-c4ac2d25143e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:23.469281 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-ce7ae76e-ef64-4646-9f7d-c4ac2d25143e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:23.474036 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-789528aa-80a8-4aa2-bc45-3c9b26441e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd2c154a2560475bb90d5c7474a44432'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:23.482865 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ae76e-ef64-4646-9f7d-c4ac2d25143e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:23.484400 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ae76e-ef64-4646-9f7d-c4ac2d25143e service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:23.488157 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-789528aa-80a8-4aa2-bc45-3c9b26441e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd2c154a2560475bb90d5c7474a44432'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:23.494175 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1084/2172] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:03:23 2022] DELETE /identity/v3/users/cd2c154a2560475bb90d5c7474a44432 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:03:23.495062 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789528aa-80a8-4aa2-bc45-3c9b26441e81 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:23.500330 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1089/2173] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:03:23.500443 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-789528aa-80a8-4aa2-bc45-3c9b26441e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:23.500540 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4ea3d-6f2f-4a3c-80b6-f59e28299680 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:23.500540 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4ea3d-6f2f-4a3c-80b6-f59e28299680 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:23.500540 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4ea3d-6f2f-4a3c-80b6-f59e28299680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:23.522076 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-aad4ea3d-6f2f-4a3c-80b6-f59e28299680 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:23.523556 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-aad4ea3d-6f2f-4a3c-80b6-f59e28299680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:23.588882 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789528aa-80a8-4aa2-bc45-3c9b26441e81 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:23.608277 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb27a0-ce38-44c7-993b-24a7c9f6b3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:23.611796 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1090/2174] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:03:23.612100 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb27a0-ce38-44c7-993b-24a7c9f6b3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:23.612100 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb27a0-ce38-44c7-993b-24a7c9f6b3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:23.612100 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb27a0-ce38-44c7-993b-24a7c9f6b3b0 admin admin] PATH_INFO: `/v3/projects/810d4156ae234220912e50c493510737` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:23.616277 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb27a0-ce38-44c7-993b-24a7c9f6b3b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=810d4156ae234220912e50c493510737)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:23.618223 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4ea3d-6f2f-4a3c-80b6-f59e28299680 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:23.618687 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb27a0-ce38-44c7-993b-24a7c9f6b3b0 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:23.619953 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-aad4ea3d-6f2f-4a3c-80b6-f59e28299680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:23.681467 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4ea3d-6f2f-4a3c-80b6-f59e28299680 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:23.686394 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a242eb5-90e0-488b-b820-87fac6eb2f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:23.687098 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a242eb5-90e0-488b-b820-87fac6eb2f1d service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:23.687383 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a242eb5-90e0-488b-b820-87fac6eb2f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:23.687660 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a242eb5-90e0-488b-b820-87fac6eb2f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:23.699360 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a242eb5-90e0-488b-b820-87fac6eb2f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:23.701015 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a242eb5-90e0-488b-b820-87fac6eb2f1d service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:23.710981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1091/2175] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:03:23.750638 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-cceb27a0-ce38-44c7-993b-24a7c9f6b3b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '810d4156ae234220912e50c493510737', 'request_id': 'req-cceb27a0-ce38-44c7-993b-24a7c9f6b3b0'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:23.833285 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-cceb27a0-ce38-44c7-993b-24a7c9f6b3b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '810d4156ae234220912e50c493510737', 'request_id': 'req-cceb27a0-ce38-44c7-993b-24a7c9f6b3b0'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:23.840189 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-cceb27a0-ce38-44c7-993b-24a7c9f6b3b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '810d4156ae234220912e50c493510737', 'request_id': 'req-cceb27a0-ce38-44c7-993b-24a7c9f6b3b0'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:23.851374 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-cceb27a0-ce38-44c7-993b-24a7c9f6b3b0 admin admin] The token cache is being invalidate because project 810d4156ae234220912e50c493510737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:23.851766 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-cceb27a0-ce38-44c7-993b-24a7c9f6b3b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:23.852494 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-cceb27a0-ce38-44c7-993b-24a7c9f6b3b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:23.854137 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1085/2176] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:23 2022] DELETE /identity/v3/projects/810d4156ae234220912e50c493510737 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:23.860021 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481733ae-0973-4e87-8e99-aa6526bc9a59 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:23.860367 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481733ae-0973-4e87-8e99-aa6526bc9a59 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:23.860707 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481733ae-0973-4e87-8e99-aa6526bc9a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:23.878945 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-481733ae-0973-4e87-8e99-aa6526bc9a59 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:23.880143 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-481733ae-0973-4e87-8e99-aa6526bc9a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:24.030929 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1092/2177] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:24.038708 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771afc71-636a-4e59-b56d-11c2998c6d36 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:24.039101 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771afc71-636a-4e59-b56d-11c2998c6d36 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:24.039386 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771afc71-636a-4e59-b56d-11c2998c6d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:24.079303 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-771afc71-636a-4e59-b56d-11c2998c6d36 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:24.080889 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-771afc71-636a-4e59-b56d-11c2998c6d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:24.091166 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481733ae-0973-4e87-8e99-aa6526bc9a59 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:24.093240 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-481733ae-0973-4e87-8e99-aa6526bc9a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:24.100980 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1086/2178] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:24.101908 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771afc71-636a-4e59-b56d-11c2998c6d36 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:24.112150 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771afc71-636a-4e59-b56d-11c2998c6d36 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:24.121918 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e1949-f58d-4876-9a71-96a0bdf76b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:24.122118 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481733ae-0973-4e87-8e99-aa6526bc9a59 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:24.122682 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e1949-f58d-4876-9a71-96a0bdf76b4c admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:24.123175 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e1949-f58d-4876-9a71-96a0bdf76b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:24.123505 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e1949-f58d-4876-9a71-96a0bdf76b4c admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:24.124247 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e1949-f58d-4876-9a71-96a0bdf76b4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:03:24.124551 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e1949-f58d-4876-9a71-96a0bdf76b4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:24.126325 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e1949-f58d-4876-9a71-96a0bdf76b4c admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:24.127400 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06dfb68-c2d2-47d4-a753-5e390a537c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:24.128580 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dfb68-c2d2-47d4-a753-5e390a537c82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:24.128925 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dfb68-c2d2-47d4-a753-5e390a537c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:24.129394 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06dfb68-c2d2-47d4-a753-5e390a537c82 admin admin] PATH_INFO: `/v3/projects/5c8dc0748f7f4aa3b25cda71fca17510` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:24.130828 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06dfb68-c2d2-47d4-a753-5e390a537c82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c8dc0748f7f4aa3b25cda71fca17510)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:24.132844 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06dfb68-c2d2-47d4-a753-5e390a537c82 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:24.142176 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1087/2179] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:03:24.146950 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e1949-f58d-4876-9a71-96a0bdf76b4c admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:24.177668 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e1949-f58d-4876-9a71-96a0bdf76b4c admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:24.184425 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c67326-5e31-44ae-988f-6ec2edfba468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:24.185204 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c67326-5e31-44ae-988f-6ec2edfba468 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:24.185592 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c67326-5e31-44ae-988f-6ec2edfba468 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:24.186348 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c67326-5e31-44ae-988f-6ec2edfba468 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:24.188398 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c67326-5e31-44ae-988f-6ec2edfba468 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:24.190753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c67326-5e31-44ae-988f-6ec2edfba468 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:24.244652 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a06dfb68-c2d2-47d4-a753-5e390a537c82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c8dc0748f7f4aa3b25cda71fca17510', 'request_id': 'req-a06dfb68-c2d2-47d4-a753-5e390a537c82'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:24.258229 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a06dfb68-c2d2-47d4-a753-5e390a537c82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c8dc0748f7f4aa3b25cda71fca17510', 'request_id': 'req-a06dfb68-c2d2-47d4-a753-5e390a537c82'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:24.304786 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1088/2180] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:03:24 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:24.305243 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c67326-5e31-44ae-988f-6ec2edfba468 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:24.307129 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-e7c67326-5e31-44ae-988f-6ec2edfba468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:24.347369 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a06dfb68-c2d2-47d4-a753-5e390a537c82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c8dc0748f7f4aa3b25cda71fca17510', 'request_id': 'req-a06dfb68-c2d2-47d4-a753-5e390a537c82'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:24.359712 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a06dfb68-c2d2-47d4-a753-5e390a537c82 admin admin] The token cache is being invalidate because project 5c8dc0748f7f4aa3b25cda71fca17510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:24.360128 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a06dfb68-c2d2-47d4-a753-5e390a537c82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:24.360935 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a06dfb68-c2d2-47d4-a753-5e390a537c82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:24.362575 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1093/2181] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:24 2022] DELETE /identity/v3/projects/5c8dc0748f7f4aa3b25cda71fca17510 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:24.365569 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06dfb68-c2d2-47d4-a753-5e390a537c82 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:24.367603 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a06dfb68-c2d2-47d4-a753-5e390a537c82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:24.380960 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c67326-5e31-44ae-988f-6ec2edfba468 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:24.386620 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4430a6-6742-4c90-9dc0-0023c6d6e630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:24.389685 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4430a6-6742-4c90-9dc0-0023c6d6e630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:24.389685 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4430a6-6742-4c90-9dc0-0023c6d6e630 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:24.389685 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4430a6-6742-4c90-9dc0-0023c6d6e630 admin admin] PATH_INFO: `/v3/projects/51b30738671f4f7789edbe829e6cb0f8` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:24.389685 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4430a6-6742-4c90-9dc0-0023c6d6e630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51b30738671f4f7789edbe829e6cb0f8)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:24.391602 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4430a6-6742-4c90-9dc0-0023c6d6e630 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:24.440618 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06dfb68-c2d2-47d4-a753-5e390a537c82 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:24.446065 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa887c0-5ee0-449c-8a07-b121bb70bd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:24.446806 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa887c0-5ee0-449c-8a07-b121bb70bd06 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:24.447173 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa887c0-5ee0-449c-8a07-b121bb70bd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:24.447477 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa887c0-5ee0-449c-8a07-b121bb70bd06 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:24.448314 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa887c0-5ee0-449c-8a07-b121bb70bd06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:24.450845 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa887c0-5ee0-449c-8a07-b121bb70bd06 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:24.525121 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1d4430a6-6742-4c90-9dc0-0023c6d6e630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51b30738671f4f7789edbe829e6cb0f8', 'request_id': 'req-1d4430a6-6742-4c90-9dc0-0023c6d6e630'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:24.536127 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1094/2182] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:03:24 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:24.537633 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa887c0-5ee0-449c-8a07-b121bb70bd06 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:24.539840 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-3aa887c0-5ee0-449c-8a07-b121bb70bd06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:24.552690 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa887c0-5ee0-449c-8a07-b121bb70bd06 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:24.604416 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1d4430a6-6742-4c90-9dc0-0023c6d6e630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51b30738671f4f7789edbe829e6cb0f8', 'request_id': 'req-1d4430a6-6742-4c90-9dc0-0023c6d6e630'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:24.609532 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb74a14-f6fd-4517-98ed-eea976ef5538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:24.610465 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb74a14-f6fd-4517-98ed-eea976ef5538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:24.610791 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb74a14-f6fd-4517-98ed-eea976ef5538 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:24.611301 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb74a14-f6fd-4517-98ed-eea976ef5538 admin admin] PATH_INFO: `/v3/users/877e906e3fbc48919820079f358b2930` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:24.612440 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb74a14-f6fd-4517-98ed-eea976ef5538 admin admin] RBAC: Authorizing `identity:delete_user(user_id=877e906e3fbc48919820079f358b2930)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:24.613389 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1d4430a6-6742-4c90-9dc0-0023c6d6e630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51b30738671f4f7789edbe829e6cb0f8', 'request_id': 'req-1d4430a6-6742-4c90-9dc0-0023c6d6e630'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:24.614764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb74a14-f6fd-4517-98ed-eea976ef5538 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:24.626266 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1d4430a6-6742-4c90-9dc0-0023c6d6e630 admin admin] The token cache is being invalidate because project 51b30738671f4f7789edbe829e6cb0f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:24.626862 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1d4430a6-6742-4c90-9dc0-0023c6d6e630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:24.627561 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1d4430a6-6742-4c90-9dc0-0023c6d6e630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:24.629139 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1089/2183] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:24 2022] DELETE /identity/v3/projects/51b30738671f4f7789edbe829e6cb0f8 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:24.629896 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4430a6-6742-4c90-9dc0-0023c6d6e630 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:24.631853 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-1d4430a6-6742-4c90-9dc0-0023c6d6e630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:24.651421 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4430a6-6742-4c90-9dc0-0023c6d6e630 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:24.658479 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff543a-fcdc-44f1-ba3c-310895957315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:24.658479 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff543a-fcdc-44f1-ba3c-310895957315 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:24.658479 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff543a-fcdc-44f1-ba3c-310895957315 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:24.658479 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff543a-fcdc-44f1-ba3c-310895957315 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:24.658868 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff543a-fcdc-44f1-ba3c-310895957315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:24.659673 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff543a-fcdc-44f1-ba3c-310895957315 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:24.672962 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1090/2184] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:24.672962 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7a431-4166-4010-a110-ee629dc60ef8 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:24.672962 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7a431-4166-4010-a110-ee629dc60ef8 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:24.672962 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7a431-4166-4010-a110-ee629dc60ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:24.691787 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-d8a7a431-4166-4010-a110-ee629dc60ef8 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:24.693024 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d8a7a431-4166-4010-a110-ee629dc60ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:24.701849 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1091/2185] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:24.702318 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7a431-4166-4010-a110-ee629dc60ef8 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:24.715769 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7a431-4166-4010-a110-ee629dc60ef8 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:24.719362 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c4c8a-a4f0-49a2-951e-f2e5bf8136fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:24.720101 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c4c8a-a4f0-49a2-951e-f2e5bf8136fc admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:24.720454 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c4c8a-a4f0-49a2-951e-f2e5bf8136fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:24.720799 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c4c8a-a4f0-49a2-951e-f2e5bf8136fc admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:24.721741 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c4c8a-a4f0-49a2-951e-f2e5bf8136fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:24.723670 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c4c8a-a4f0-49a2-951e-f2e5bf8136fc admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:24.734610 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1092/2186] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:24.738725 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014ba01-3eb4-4d60-be6d-e98ebfbf0e4f None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:24.738725 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014ba01-3eb4-4d60-be6d-e98ebfbf0e4f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:24.738725 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014ba01-3eb4-4d60-be6d-e98ebfbf0e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:24.762576 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-d014ba01-3eb4-4d60-be6d-e98ebfbf0e4f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:24.763812 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d014ba01-3eb4-4d60-be6d-e98ebfbf0e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:24.774026 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1093/2187] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:24.774924 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014ba01-3eb4-4d60-be6d-e98ebfbf0e4f None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:24.786289 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014ba01-3eb4-4d60-be6d-e98ebfbf0e4f None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:24.791296 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0ae66-8c3a-407e-bf40-239ae28ec223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:24.792216 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0ae66-8c3a-407e-bf40-239ae28ec223 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:24.792514 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0ae66-8c3a-407e-bf40-239ae28ec223 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:24.792777 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac0ae66-8c3a-407e-bf40-239ae28ec223 admin admin] PATH_INFO: `/v3/projects/c2e24c00419344e7b7f7209ea6d162a1/users/1843d2041f8b4898ae5e7c7781640f0e/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:24.806989 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0ae66-8c3a-407e-bf40-239ae28ec223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2e24c00419344e7b7f7209ea6d162a1, user_id=1843d2041f8b4898ae5e7c7781640f0e, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:24.810164 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac0ae66-8c3a-407e-bf40-239ae28ec223 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:24.858806 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-2eb74a14-f6fd-4517-98ed-eea976ef5538 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '877e906e3fbc48919820079f358b2930'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:24.865410 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-2eb74a14-f6fd-4517-98ed-eea976ef5538 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '877e906e3fbc48919820079f358b2930'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:24.902524 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1094/2188] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:24 2022] PUT /identity/v3/projects/c2e24c00419344e7b7f7209ea6d162a1/users/1843d2041f8b4898ae5e7c7781640f0e/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:24.905935 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0ae66-8c3a-407e-bf40-239ae28ec223 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:24.947585 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-2eb74a14-f6fd-4517-98ed-eea976ef5538 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '877e906e3fbc48919820079f358b2930'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:24.948674 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-2eb74a14-f6fd-4517-98ed-eea976ef5538 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '877e906e3fbc48919820079f358b2930'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:24.964658 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-2eb74a14-f6fd-4517-98ed-eea976ef5538 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '877e906e3fbc48919820079f358b2930'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:24.972508 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1095/2189] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:03:24 2022] DELETE /identity/v3/users/877e906e3fbc48919820079f358b2930 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:24.974338 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610a523-d98f-4b6c-bed6-c404be951235 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:24.974794 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610a523-d98f-4b6c-bed6-c404be951235 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:24.975257 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d610a523-d98f-4b6c-bed6-c404be951235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:24.982018 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac0ae66-8c3a-407e-bf40-239ae28ec223 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:25.023023 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-d610a523-d98f-4b6c-bed6-c404be951235 None None] MFA Rules not processed for user `1843d2041f8b4898ae5e7c7781640f0e`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:25.024638 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d610a523-d98f-4b6c-bed6-c404be951235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:25.062156 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae30d1a-f1c9-41ce-9054-2a2d2def43d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:25.062944 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae30d1a-f1c9-41ce-9054-2a2d2def43d7 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:25.063286 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae30d1a-f1c9-41ce-9054-2a2d2def43d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:25.063639 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae30d1a-f1c9-41ce-9054-2a2d2def43d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:25.064479 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae30d1a-f1c9-41ce-9054-2a2d2def43d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:03:25.064862 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae30d1a-f1c9-41ce-9054-2a2d2def43d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:25.066573 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae30d1a-f1c9-41ce-9054-2a2d2def43d7 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:25.086732 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1095/2190] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:03:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:03:25.086732 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae30d1a-f1c9-41ce-9054-2a2d2def43d7 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:25.086732 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-1ae30d1a-f1c9-41ce-9054-2a2d2def43d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:25.101473 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae30d1a-f1c9-41ce-9054-2a2d2def43d7 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:25.104313 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1096/2191] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:25.109317 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48049e94-8f6e-41b0-a336-085f8298f1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:25.109977 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48049e94-8f6e-41b0-a336-085f8298f1ed admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:25.110304 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48049e94-8f6e-41b0-a336-085f8298f1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:25.110578 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48049e94-8f6e-41b0-a336-085f8298f1ed admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:25.111306 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48049e94-8f6e-41b0-a336-085f8298f1ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:25.113201 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48049e94-8f6e-41b0-a336-085f8298f1ed admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:25.196638 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1096/2192] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:03:25 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:03:25.200545 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610a523-d98f-4b6c-bed6-c404be951235 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:25.211614 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d610a523-d98f-4b6c-bed6-c404be951235 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:25.268631 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ed71b-1f49-47a1-b23c-9a4b8e5464b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:25.269368 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ed71b-1f49-47a1-b23c-9a4b8e5464b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:25.269693 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ed71b-1f49-47a1-b23c-9a4b8e5464b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:25.270002 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ed71b-1f49-47a1-b23c-9a4b8e5464b6 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:25.270731 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ed71b-1f49-47a1-b23c-9a4b8e5464b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:25.272971 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ed71b-1f49-47a1-b23c-9a4b8e5464b6 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:25.415944 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48049e94-8f6e-41b0-a336-085f8298f1ed admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:25.418447 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-48049e94-8f6e-41b0-a336-085f8298f1ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:25.427379 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1097/2193] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:03:25 2022] POST /identity/v3/users => generated 292 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:25.431903 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ed71b-1f49-47a1-b23c-9a4b8e5464b6 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:25.442185 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48049e94-8f6e-41b0-a336-085f8298f1ed admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:25.452592 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b7a11-5831-4e82-b72c-5ac32a265c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:25.453713 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b7a11-5831-4e82-b72c-5ac32a265c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:25.454620 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b7a11-5831-4e82-b72c-5ac32a265c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:25.454620 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b7a11-5831-4e82-b72c-5ac32a265c1b admin admin] PATH_INFO: `/v3/projects/ddf8b7647565427597927a2eb7459dcb` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:25.458041 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b7a11-5831-4e82-b72c-5ac32a265c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddf8b7647565427597927a2eb7459dcb)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:25.458122 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ed71b-1f49-47a1-b23c-9a4b8e5464b6 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:25.459198 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b7a11-5831-4e82-b72c-5ac32a265c1b admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:25.486408 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc6a6c-6915-4170-b2f5-f0a15f01de09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:25.490981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc6a6c-6915-4170-b2f5-f0a15f01de09 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:25.490981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc6a6c-6915-4170-b2f5-f0a15f01de09 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:25.490981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc6a6c-6915-4170-b2f5-f0a15f01de09 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:25.490981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc6a6c-6915-4170-b2f5-f0a15f01de09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:25.490981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc6a6c-6915-4170-b2f5-f0a15f01de09 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:25.505270 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1098/2194] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:25.506336 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc6a6c-6915-4170-b2f5-f0a15f01de09 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:25.508555 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1afc6a6c-6915-4170-b2f5-f0a15f01de09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:25.585992 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc6a6c-6915-4170-b2f5-f0a15f01de09 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:25.590550 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0c7c7-9778-4072-9bfd-7ded9afc75ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:25.591215 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0c7c7-9778-4072-9bfd-7ded9afc75ee service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:25.599202 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0c7c7-9778-4072-9bfd-7ded9afc75ee service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:25.599202 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0c7c7-9778-4072-9bfd-7ded9afc75ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:25.615022 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-076b7a11-5831-4e82-b72c-5ac32a265c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddf8b7647565427597927a2eb7459dcb', 'request_id': 'req-076b7a11-5831-4e82-b72c-5ac32a265c1b'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:25.656019 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0c7c7-9778-4072-9bfd-7ded9afc75ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:25.657444 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0c7c7-9778-4072-9bfd-7ded9afc75ee service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:25.666243 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1099/2195] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:03:25.667065 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0c7c7-9778-4072-9bfd-7ded9afc75ee service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:25.677134 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0c7c7-9778-4072-9bfd-7ded9afc75ee service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:25.701538 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-076b7a11-5831-4e82-b72c-5ac32a265c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddf8b7647565427597927a2eb7459dcb', 'request_id': 'req-076b7a11-5831-4e82-b72c-5ac32a265c1b'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:25.707672 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-076b7a11-5831-4e82-b72c-5ac32a265c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddf8b7647565427597927a2eb7459dcb', 'request_id': 'req-076b7a11-5831-4e82-b72c-5ac32a265c1b'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:25.733447 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-076b7a11-5831-4e82-b72c-5ac32a265c1b admin admin] The token cache is being invalidate because project ddf8b7647565427597927a2eb7459dcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:25.733447 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-076b7a11-5831-4e82-b72c-5ac32a265c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:25.733447 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-076b7a11-5831-4e82-b72c-5ac32a265c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:25.733447 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1097/2196] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:25 2022] DELETE /identity/v3/projects/ddf8b7647565427597927a2eb7459dcb => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:25.739573 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b073cc9-431c-426d-93ca-bcd3351a09cd None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:25.739573 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b073cc9-431c-426d-93ca-bcd3351a09cd None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:25.739573 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b073cc9-431c-426d-93ca-bcd3351a09cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:25.757438 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e5a53-ba60-4ae8-b941-bcaf75d3c415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:25.758611 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e5a53-ba60-4ae8-b941-bcaf75d3c415 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:25.759197 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e5a53-ba60-4ae8-b941-bcaf75d3c415 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:25.759706 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e5a53-ba60-4ae8-b941-bcaf75d3c415 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:25.759829 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-9b073cc9-431c-426d-93ca-bcd3351a09cd None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:25.761484 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e5a53-ba60-4ae8-b941-bcaf75d3c415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:25.761593 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-9b073cc9-431c-426d-93ca-bcd3351a09cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:25.763764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e5a53-ba60-4ae8-b941-bcaf75d3c415 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:25.778543 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1100/2197] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:25.778903 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1098/2198] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:25.780011 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac239c-00b2-4164-ae95-85310dc7de26 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:25.780289 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac239c-00b2-4164-ae95-85310dc7de26 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:25.780607 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac239c-00b2-4164-ae95-85310dc7de26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:25.782446 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b073cc9-431c-426d-93ca-bcd3351a09cd None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:25.783883 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-9b073cc9-431c-426d-93ca-bcd3351a09cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:25.796023 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b073cc9-431c-426d-93ca-bcd3351a09cd None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:25.799328 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-f2ac239c-00b2-4164-ae95-85310dc7de26 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:25.800510 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-f2ac239c-00b2-4164-ae95-85310dc7de26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:25.801276 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836b406-d01e-4d95-801c-c5b5ac9bf794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:25.802300 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836b406-d01e-4d95-801c-c5b5ac9bf794 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:25.802649 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836b406-d01e-4d95-801c-c5b5ac9bf794 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:25.803038 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836b406-d01e-4d95-801c-c5b5ac9bf794 admin admin] PATH_INFO: `/v3/projects/052cdae88a72491abdafdb94f2a87a7d/users/a66f89abca684532ab61525e61f81452/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:25.808904 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1101/2199] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:25.814743 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac239c-00b2-4164-ae95-85310dc7de26 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:25.821911 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836b406-d01e-4d95-801c-c5b5ac9bf794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=052cdae88a72491abdafdb94f2a87a7d, user_id=a66f89abca684532ab61525e61f81452, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:25.825122 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac239c-00b2-4164-ae95-85310dc7de26 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:25.825452 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836b406-d01e-4d95-801c-c5b5ac9bf794 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:25.830605 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9205eee-2cff-444d-9e4c-8e72cd1f702f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:25.836345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9205eee-2cff-444d-9e4c-8e72cd1f702f admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:25.836345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9205eee-2cff-444d-9e4c-8e72cd1f702f admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:25.836345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9205eee-2cff-444d-9e4c-8e72cd1f702f admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:25.836345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9205eee-2cff-444d-9e4c-8e72cd1f702f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:03:25.836345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9205eee-2cff-444d-9e4c-8e72cd1f702f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:25.836345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9205eee-2cff-444d-9e4c-8e72cd1f702f admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:25.847474 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1102/2200] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:03:25.852092 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9205eee-2cff-444d-9e4c-8e72cd1f702f admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:25.861869 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9205eee-2cff-444d-9e4c-8e72cd1f702f admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:25.866773 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c420b9-a69d-40e2-b296-ae15aa1cfe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:25.867446 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c420b9-a69d-40e2-b296-ae15aa1cfe72 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:25.867726 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c420b9-a69d-40e2-b296-ae15aa1cfe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:25.868000 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c420b9-a69d-40e2-b296-ae15aa1cfe72 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:25.868704 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c420b9-a69d-40e2-b296-ae15aa1cfe72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:25.870619 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c420b9-a69d-40e2-b296-ae15aa1cfe72 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:25.896256 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1099/2201] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:25 2022] PUT /identity/v3/projects/052cdae88a72491abdafdb94f2a87a7d/users/a66f89abca684532ab61525e61f81452/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:03:25.911713 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92768406-f144-4539-aacd-ca410d219d6b None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:25.911982 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92768406-f144-4539-aacd-ca410d219d6b None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:25.912259 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92768406-f144-4539-aacd-ca410d219d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:25.938017 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-92768406-f144-4539-aacd-ca410d219d6b None None] MFA Rules not processed for user `a66f89abca684532ab61525e61f81452`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:25.939335 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-92768406-f144-4539-aacd-ca410d219d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:25.955993 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1103/2202] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:03:25 2022] POST /identity/v3/projects => generated 379 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:03:25.960334 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c420b9-a69d-40e2-b296-ae15aa1cfe72 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:26.004697 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1100/2203] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:03:26.016444 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92768406-f144-4539-aacd-ca410d219d6b None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:26.017813 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-92768406-f144-4539-aacd-ca410d219d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:26.022572 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c420b9-a69d-40e2-b296-ae15aa1cfe72 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:26.027776 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe69cc1-0256-41ad-a9a2-a1d216533f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:26.028441 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe69cc1-0256-41ad-a9a2-a1d216533f62 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:26.028719 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe69cc1-0256-41ad-a9a2-a1d216533f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:26.028993 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe69cc1-0256-41ad-a9a2-a1d216533f62 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:26.029687 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe69cc1-0256-41ad-a9a2-a1d216533f62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:26.031847 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe69cc1-0256-41ad-a9a2-a1d216533f62 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:26.081088 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92768406-f144-4539-aacd-ca410d219d6b None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:26.098913 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1104/2204] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:03:25 2022] POST /identity/v3/users => generated 290 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:26.104251 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe69cc1-0256-41ad-a9a2-a1d216533f62 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:26.116251 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe69cc1-0256-41ad-a9a2-a1d216533f62 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:26.122783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec94d8-6c7d-473f-8e94-374075aadbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:26.123694 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec94d8-6c7d-473f-8e94-374075aadbe0 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:26.123971 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec94d8-6c7d-473f-8e94-374075aadbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:26.124358 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afec94d8-6c7d-473f-8e94-374075aadbe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:26.125155 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec94d8-6c7d-473f-8e94-374075aadbe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:26.126935 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afec94d8-6c7d-473f-8e94-374075aadbe0 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:26.136906 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94c813-f8e1-4154-a863-a3cf389c6c15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:26.137557 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94c813-f8e1-4154-a863-a3cf389c6c15 service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:26.137894 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94c813-f8e1-4154-a863-a3cf389c6c15 service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:26.138169 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94c813-f8e1-4154-a863-a3cf389c6c15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:26.138257 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1105/2205] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:26.142595 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec94d8-6c7d-473f-8e94-374075aadbe0 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:26.153557 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afec94d8-6c7d-473f-8e94-374075aadbe0 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:26.158247 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4aa25-562b-473f-9ef4-b7b7fa601e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:26.158957 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4aa25-562b-473f-9ef4-b7b7fa601e8d admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:26.159240 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4aa25-562b-473f-9ef4-b7b7fa601e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:26.159510 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4aa25-562b-473f-9ef4-b7b7fa601e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:26.160225 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4aa25-562b-473f-9ef4-b7b7fa601e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:26.161912 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4aa25-562b-473f-9ef4-b7b7fa601e8d admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:26.174172 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1106/2206] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:26.178466 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4aa25-562b-473f-9ef4-b7b7fa601e8d admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:26.188102 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4aa25-562b-473f-9ef4-b7b7fa601e8d admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:26.193723 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c425d49-eb4b-4d98-b674-e1d5e59b41bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:26.194589 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c425d49-eb4b-4d98-b674-e1d5e59b41bd admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:26.194888 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c425d49-eb4b-4d98-b674-e1d5e59b41bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:26.195156 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c425d49-eb4b-4d98-b674-e1d5e59b41bd admin admin] PATH_INFO: `/v3/projects/9ea34902b6a94ccebf88e245fd0198f1/users/732180598177470ca95b10269f3e67e2/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:26.195828 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94c813-f8e1-4154-a863-a3cf389c6c15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:26.197300 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94c813-f8e1-4154-a863-a3cf389c6c15 service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:26.209601 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1101/2207] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:03:26.212806 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c425d49-eb4b-4d98-b674-e1d5e59b41bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea34902b6a94ccebf88e245fd0198f1, user_id=732180598177470ca95b10269f3e67e2, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:26.216498 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c425d49-eb4b-4d98-b674-e1d5e59b41bd admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:26.297667 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1107/2208] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:26 2022] PUT /identity/v3/projects/9ea34902b6a94ccebf88e245fd0198f1/users/732180598177470ca95b10269f3e67e2/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:03:26.307900 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15237264-c0a8-4fff-84fd-8490e9966c04 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:26.308304 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15237264-c0a8-4fff-84fd-8490e9966c04 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:26.308515 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15237264-c0a8-4fff-84fd-8490e9966c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:26.337229 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-15237264-c0a8-4fff-84fd-8490e9966c04 None None] MFA Rules not processed for user `732180598177470ca95b10269f3e67e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:26.338646 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-15237264-c0a8-4fff-84fd-8490e9966c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:26.403832 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1102/2209] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:26.408274 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c425d49-eb4b-4d98-b674-e1d5e59b41bd admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:26.468862 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c425d49-eb4b-4d98-b674-e1d5e59b41bd admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:26.473591 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f77dc-0b29-409b-9bc8-6e99b0a9a133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:26.474182 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f77dc-0b29-409b-9bc8-6e99b0a9a133 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:26.474457 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f77dc-0b29-409b-9bc8-6e99b0a9a133 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:26.474726 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f77dc-0b29-409b-9bc8-6e99b0a9a133 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:26.475456 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f77dc-0b29-409b-9bc8-6e99b0a9a133 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:26.477344 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f77dc-0b29-409b-9bc8-6e99b0a9a133 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:26.645516 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1108/2210] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:03:26 2022] POST /identity/v3/projects => generated 377 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:26.648203 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15237264-c0a8-4fff-84fd-8490e9966c04 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:26.665122 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15237264-c0a8-4fff-84fd-8490e9966c04 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:26.728190 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc486611-8a62-43c7-bde9-ae59aa6fa6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:26.729000 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc486611-8a62-43c7-bde9-ae59aa6fa6ab admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:26.729405 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc486611-8a62-43c7-bde9-ae59aa6fa6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:26.729804 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc486611-8a62-43c7-bde9-ae59aa6fa6ab admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:26.730623 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc486611-8a62-43c7-bde9-ae59aa6fa6ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:26.732929 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc486611-8a62-43c7-bde9-ae59aa6fa6ab admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:26.873262 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1103/2211] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:03:26 2022] POST /identity/v3/users => generated 295 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:26.874476 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f77dc-0b29-409b-9bc8-6e99b0a9a133 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:26.885107 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f77dc-0b29-409b-9bc8-6e99b0a9a133 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:26.890585 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a9d2d-c8ad-4e5c-8d96-82306fd61c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:26.891277 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a9d2d-c8ad-4e5c-8d96-82306fd61c62 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:26.891554 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a9d2d-c8ad-4e5c-8d96-82306fd61c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:26.891828 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a9d2d-c8ad-4e5c-8d96-82306fd61c62 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:26.892554 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a9d2d-c8ad-4e5c-8d96-82306fd61c62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:26.894252 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a9d2d-c8ad-4e5c-8d96-82306fd61c62 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:26.911969 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1109/2212] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:03:26.913047 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc486611-8a62-43c7-bde9-ae59aa6fa6ab admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:26.928853 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc486611-8a62-43c7-bde9-ae59aa6fa6ab admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:26.934897 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa00ca-1c74-49ae-b881-f9caf0397c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:26.935531 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa00ca-1c74-49ae-b881-f9caf0397c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:26.935743 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa00ca-1c74-49ae-b881-f9caf0397c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:26.936133 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa00ca-1c74-49ae-b881-f9caf0397c88 admin admin] PATH_INFO: `/v3/projects/2583846b7a3e46a299e140900e1b7225/users/a1443949c5944165b063de02cd4f3385/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:26.953044 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa00ca-1c74-49ae-b881-f9caf0397c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2583846b7a3e46a299e140900e1b7225, user_id=a1443949c5944165b063de02cd4f3385, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:26.955739 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa00ca-1c74-49ae-b881-f9caf0397c88 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:27.030980 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1104/2213] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:26 2022] PUT /identity/v3/projects/2583846b7a3e46a299e140900e1b7225/users/a1443949c5944165b063de02cd4f3385/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:27.034884 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a9d2d-c8ad-4e5c-8d96-82306fd61c62 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:27.046887 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a9d2d-c8ad-4e5c-8d96-82306fd61c62 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:27.125103 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a0bec-72dd-4f4a-9587-5a9c45f5aa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:27.125103 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0bec-72dd-4f4a-9587-5a9c45f5aa1c admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:27.125103 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0bec-72dd-4f4a-9587-5a9c45f5aa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:27.125103 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a0bec-72dd-4f4a-9587-5a9c45f5aa1c admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:27.125455 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a0bec-72dd-4f4a-9587-5a9c45f5aa1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:27.126780 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a0bec-72dd-4f4a-9587-5a9c45f5aa1c admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:27.137581 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1110/2214] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:03:27.142060 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa00ca-1c74-49ae-b881-f9caf0397c88 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:27.157393 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa00ca-1c74-49ae-b881-f9caf0397c88 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:27.162443 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a3f37-7dbe-410f-95ec-7d357a43b38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:27.163393 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a3f37-7dbe-410f-95ec-7d357a43b38d admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:27.163678 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a3f37-7dbe-410f-95ec-7d357a43b38d admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:27.163952 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a3f37-7dbe-410f-95ec-7d357a43b38d admin admin] PATH_INFO: `/v3/projects/2583846b7a3e46a299e140900e1b7225/users/a1443949c5944165b063de02cd4f3385/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:27.165934 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a3f37-7dbe-410f-95ec-7d357a43b38d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2583846b7a3e46a299e140900e1b7225, user_id=a1443949c5944165b063de02cd4f3385, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:27.169153 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a3f37-7dbe-410f-95ec-7d357a43b38d admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:27.181455 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1105/2215] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:27 2022] PUT /identity/v3/projects/2583846b7a3e46a299e140900e1b7225/users/a1443949c5944165b063de02cd4f3385/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:27.193678 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c773e-554a-4739-92b5-8f57043e89d3 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:27.193972 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c773e-554a-4739-92b5-8f57043e89d3 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:27.194251 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1c773e-554a-4739-92b5-8f57043e89d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:27.227697 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-5d1c773e-554a-4739-92b5-8f57043e89d3 None None] MFA Rules not processed for user `a1443949c5944165b063de02cd4f3385`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:27.229041 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-5d1c773e-554a-4739-92b5-8f57043e89d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:27.312532 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1111/2216] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:27.385408 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a3f37-7dbe-410f-95ec-7d357a43b38d admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:27.387198 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d58a3f37-7dbe-410f-95ec-7d357a43b38d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:27.449184 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a3f37-7dbe-410f-95ec-7d357a43b38d admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:27.452935 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213a918-fbb8-446c-bd30-9ab36833c08b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:27.453944 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213a918-fbb8-446c-bd30-9ab36833c08b service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:27.454241 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213a918-fbb8-446c-bd30-9ab36833c08b service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:27.454520 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213a918-fbb8-446c-bd30-9ab36833c08b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:27.467097 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213a918-fbb8-446c-bd30-9ab36833c08b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:27.469275 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213a918-fbb8-446c-bd30-9ab36833c08b service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:27.482411 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1106/2217] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:03:29.034435 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c773e-554a-4739-92b5-8f57043e89d3 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:29.045294 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1c773e-554a-4739-92b5-8f57043e89d3 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:29.050610 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c636b-6630-40c8-be81-da99b2d39549 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1443949c5944165b063de02cd4f3385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2583846b7a3e46a299e140900e1b7225', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:29.051440 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c636b-6630-40c8-be81-da99b2d39549 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:29.051907 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c636b-6630-40c8-be81-da99b2d39549 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:29.052343 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18c636b-6630-40c8-be81-da99b2d39549 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:29.053178 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c636b-6630-40c8-be81-da99b2d39549 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:03:29.053609 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c636b-6630-40c8-be81-da99b2d39549 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:29.055387 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18c636b-6630-40c8-be81-da99b2d39549 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:29.075829 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1112/2218] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:03:29.076935 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213a918-fbb8-446c-bd30-9ab36833c08b service cinder] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:29.086812 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213a918-fbb8-446c-bd30-9ab36833c08b service cinder] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:29.092045 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73eb128-e8ed-497d-8f25-0ed00abec8d3 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1443949c5944165b063de02cd4f3385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2583846b7a3e46a299e140900e1b7225', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:29.092783 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eb128-e8ed-497d-8f25-0ed00abec8d3 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:29.093064 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eb128-e8ed-497d-8f25-0ed00abec8d3 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:29.093340 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eb128-e8ed-497d-8f25-0ed00abec8d3 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:29.094036 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73eb128-e8ed-497d-8f25-0ed00abec8d3 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:29.095949 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73eb128-e8ed-497d-8f25-0ed00abec8d3 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:29.195479 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1107/2219] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:03:29 2022] POST /identity/v3/projects => generated 353 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:03:29.199687 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c636b-6630-40c8-be81-da99b2d39549 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:29.210442 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18c636b-6630-40c8-be81-da99b2d39549 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:29.275508 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc23b89-9f4a-421f-9adf-2779f3740466 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1443949c5944165b063de02cd4f3385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2583846b7a3e46a299e140900e1b7225', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:29.276295 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc23b89-9f4a-421f-9adf-2779f3740466 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:29.277177 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc23b89-9f4a-421f-9adf-2779f3740466 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:29.277540 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc23b89-9f4a-421f-9adf-2779f3740466 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:29.278344 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc23b89-9f4a-421f-9adf-2779f3740466 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:03:29.278659 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc23b89-9f4a-421f-9adf-2779f3740466 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:29.280255 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc23b89-9f4a-421f-9adf-2779f3740466 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:29.291904 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1113/2220] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:03:29.329162 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73eb128-e8ed-497d-8f25-0ed00abec8d3 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:29.331751 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94299a2-5cd5-4542-9aae-b003cb443fe9 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:29.332053 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94299a2-5cd5-4542-9aae-b003cb443fe9 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:29.332507 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94299a2-5cd5-4542-9aae-b003cb443fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:29.340202 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73eb128-e8ed-497d-8f25-0ed00abec8d3 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:29.347840 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca63e4f-49ff-4c17-8e2a-3ed7016c7694 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a1443949c5944165b063de02cd4f3385', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2583846b7a3e46a299e140900e1b7225', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:29.347840 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca63e4f-49ff-4c17-8e2a-3ed7016c7694 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:29.347840 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca63e4f-49ff-4c17-8e2a-3ed7016c7694 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:29.348120 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca63e4f-49ff-4c17-8e2a-3ed7016c7694 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] PATH_INFO: `/v3/projects/53d93564ce2b4022b4a1af97155414ba` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:29.348120 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca63e4f-49ff-4c17-8e2a-3ed7016c7694 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] RBAC: Authorizing `identity:delete_project(project_id=53d93564ce2b4022b4a1af97155414ba)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:29.349265 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca63e4f-49ff-4c17-8e2a-3ed7016c7694 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:29.351602 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-d94299a2-5cd5-4542-9aae-b003cb443fe9 None None] MFA Rules not processed for user `7b5417dc6db1461e94de39f4d2ca8f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:29.352639 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d94299a2-5cd5-4542-9aae-b003cb443fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:29.411527 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1114/2221] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:03:29.462354 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-5ca63e4f-49ff-4c17-8e2a-3ed7016c7694 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53d93564ce2b4022b4a1af97155414ba', 'request_id': 'req-5ca63e4f-49ff-4c17-8e2a-3ed7016c7694'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:29.535901 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-5ca63e4f-49ff-4c17-8e2a-3ed7016c7694 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53d93564ce2b4022b4a1af97155414ba', 'request_id': 'req-5ca63e4f-49ff-4c17-8e2a-3ed7016c7694'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:29.542510 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-5ca63e4f-49ff-4c17-8e2a-3ed7016c7694 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53d93564ce2b4022b4a1af97155414ba', 'request_id': 'req-5ca63e4f-49ff-4c17-8e2a-3ed7016c7694'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:29.555745 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-5ca63e4f-49ff-4c17-8e2a-3ed7016c7694 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] The token cache is being invalidate because project 53d93564ce2b4022b4a1af97155414ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:29.556034 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-5ca63e4f-49ff-4c17-8e2a-3ed7016c7694 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:29.556699 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-5ca63e4f-49ff-4c17-8e2a-3ed7016c7694 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:29.558903 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1108/2222] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:29 2022] DELETE /identity/v3/projects/53d93564ce2b4022b4a1af97155414ba => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:30.178822 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94299a2-5cd5-4542-9aae-b003cb443fe9 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:30.258764 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca63e4f-49ff-4c17-8e2a-3ed7016c7694 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:30.260546 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-5ca63e4f-49ff-4c17-8e2a-3ed7016c7694 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:30.281905 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94299a2-5cd5-4542-9aae-b003cb443fe9 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:30.346208 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044baf57-7fc0-400c-962e-3add270ec17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:30.347118 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044baf57-7fc0-400c-962e-3add270ec17e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:30.347409 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044baf57-7fc0-400c-962e-3add270ec17e admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:30.347787 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044baf57-7fc0-400c-962e-3add270ec17e admin admin] PATH_INFO: `/v3/users/a66f89abca684532ab61525e61f81452` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:30.349246 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044baf57-7fc0-400c-962e-3add270ec17e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a66f89abca684532ab61525e61f81452)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:30.351781 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044baf57-7fc0-400c-962e-3add270ec17e admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:30.366297 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca63e4f-49ff-4c17-8e2a-3ed7016c7694 tempest-VolumeQuotaClassesTest-90968419 tempest-VolumeQuotaClassesTest-90968419-project-admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:30.377500 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec99b3f-88c4-43c0-a1d2-8079d1ce7271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:30.378510 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec99b3f-88c4-43c0-a1d2-8079d1ce7271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:30.379609 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec99b3f-88c4-43c0-a1d2-8079d1ce7271 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:30.380347 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec99b3f-88c4-43c0-a1d2-8079d1ce7271 admin admin] PATH_INFO: `/v3/users/732180598177470ca95b10269f3e67e2` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:30.387710 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec99b3f-88c4-43c0-a1d2-8079d1ce7271 admin admin] RBAC: Authorizing `identity:delete_user(user_id=732180598177470ca95b10269f3e67e2)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:30.389906 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec99b3f-88c4-43c0-a1d2-8079d1ce7271 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:30.533724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-044baf57-7fc0-400c-962e-3add270ec17e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a66f89abca684532ab61525e61f81452'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:30.543128 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-044baf57-7fc0-400c-962e-3add270ec17e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a66f89abca684532ab61525e61f81452'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:30.577966 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8ec99b3f-88c4-43c0-a1d2-8079d1ce7271 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '732180598177470ca95b10269f3e67e2'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:30.644728 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-044baf57-7fc0-400c-962e-3add270ec17e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a66f89abca684532ab61525e61f81452'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:30.645353 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-044baf57-7fc0-400c-962e-3add270ec17e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a66f89abca684532ab61525e61f81452'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:30.658875 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-044baf57-7fc0-400c-962e-3add270ec17e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a66f89abca684532ab61525e61f81452'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:30.665370 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1115/2223] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:03:30 2022] DELETE /identity/v3/users/a66f89abca684532ab61525e61f81452 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:30.670347 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed054b-bfc6-49f5-875c-735cd2d20fd6 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:30.670659 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed054b-bfc6-49f5-875c-735cd2d20fd6 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:30.670971 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed054b-bfc6-49f5-875c-735cd2d20fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:30.725741 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-e7ed054b-bfc6-49f5-875c-735cd2d20fd6 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:30.727138 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-e7ed054b-bfc6-49f5-875c-735cd2d20fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:30.731162 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8ec99b3f-88c4-43c0-a1d2-8079d1ce7271 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '732180598177470ca95b10269f3e67e2'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:30.732449 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8ec99b3f-88c4-43c0-a1d2-8079d1ce7271 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '732180598177470ca95b10269f3e67e2'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:30.741648 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8ec99b3f-88c4-43c0-a1d2-8079d1ce7271 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '732180598177470ca95b10269f3e67e2'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:30.758859 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8ec99b3f-88c4-43c0-a1d2-8079d1ce7271 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '732180598177470ca95b10269f3e67e2'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:30.789614 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1109/2224] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:03:30 2022] DELETE /identity/v3/users/732180598177470ca95b10269f3e67e2 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:03:30.791327 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2b938-ecf8-4440-b2fd-abe113c05318 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:30.791615 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2b938-ecf8-4440-b2fd-abe113c05318 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:30.791890 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2b938-ecf8-4440-b2fd-abe113c05318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:30.829431 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-26e2b938-ecf8-4440-b2fd-abe113c05318 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:30.836902 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-26e2b938-ecf8-4440-b2fd-abe113c05318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:30.853887 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1116/2225] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:03:30.865830 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed054b-bfc6-49f5-875c-735cd2d20fd6 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:30.867374 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-e7ed054b-bfc6-49f5-875c-735cd2d20fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:30.903948 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1110/2226] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:30.915188 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2b938-ecf8-4440-b2fd-abe113c05318 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:30.917242 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-26e2b938-ecf8-4440-b2fd-abe113c05318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:31.002976 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2b938-ecf8-4440-b2fd-abe113c05318 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:31.010347 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed054b-bfc6-49f5-875c-735cd2d20fd6 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:31.013245 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64efef1-b923-48e8-ae84-bd31195603fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:31.014045 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64efef1-b923-48e8-ae84-bd31195603fb service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:31.014431 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64efef1-b923-48e8-ae84-bd31195603fb service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:31.014809 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64efef1-b923-48e8-ae84-bd31195603fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:31.021155 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5bebe-8b72-4a80-8e41-400d5cfe9778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:31.021813 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5bebe-8b72-4a80-8e41-400d5cfe9778 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:31.022102 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5bebe-8b72-4a80-8e41-400d5cfe9778 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:31.022378 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5bebe-8b72-4a80-8e41-400d5cfe9778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:31.027966 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64efef1-b923-48e8-ae84-bd31195603fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:31.029515 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64efef1-b923-48e8-ae84-bd31195603fb service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:31.033137 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5bebe-8b72-4a80-8e41-400d5cfe9778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:31.034774 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb5bebe-8b72-4a80-8e41-400d5cfe9778 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:31.039933 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1111/2227] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:03:31.040858 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64efef1-b923-48e8-ae84-bd31195603fb service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:31.042890 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d64efef1-b923-48e8-ae84-bd31195603fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:31.045536 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1117/2228] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:03:31.057299 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64efef1-b923-48e8-ae84-bd31195603fb service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:31.063848 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadb14b-758a-4988-8a8f-7b3134641fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:31.066499 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadb14b-758a-4988-8a8f-7b3134641fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:31.066499 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadb14b-758a-4988-8a8f-7b3134641fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:31.066688 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fadb14b-758a-4988-8a8f-7b3134641fe8 admin admin] PATH_INFO: `/v3/users/1843d2041f8b4898ae5e7c7781640f0e` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:31.068327 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadb14b-758a-4988-8a8f-7b3134641fe8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1843d2041f8b4898ae5e7c7781640f0e)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:31.070317 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fadb14b-758a-4988-8a8f-7b3134641fe8 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:31.206302 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3fadb14b-758a-4988-8a8f-7b3134641fe8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1843d2041f8b4898ae5e7c7781640f0e'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:31.307431 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3fadb14b-758a-4988-8a8f-7b3134641fe8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1843d2041f8b4898ae5e7c7781640f0e'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:31.309026 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3fadb14b-758a-4988-8a8f-7b3134641fe8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1843d2041f8b4898ae5e7c7781640f0e'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:31.318647 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3fadb14b-758a-4988-8a8f-7b3134641fe8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1843d2041f8b4898ae5e7c7781640f0e'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:31.334900 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3fadb14b-758a-4988-8a8f-7b3134641fe8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1843d2041f8b4898ae5e7c7781640f0e'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:31.341145 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1112/2229] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:03:31 2022] DELETE /identity/v3/users/1843d2041f8b4898ae5e7c7781640f0e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:31.346361 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815ff73-4f35-470a-a82e-446ed076d905 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:31.346876 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815ff73-4f35-470a-a82e-446ed076d905 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:31.347066 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815ff73-4f35-470a-a82e-446ed076d905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:31.368724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-7815ff73-4f35-470a-a82e-446ed076d905 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:31.369949 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-7815ff73-4f35-470a-a82e-446ed076d905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:31.494323 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1118/2230] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:31.522820 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadb14b-758a-4988-8a8f-7b3134641fe8 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:31.525982 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-3fadb14b-758a-4988-8a8f-7b3134641fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:31.618546 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fadb14b-758a-4988-8a8f-7b3134641fe8 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:31.623749 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9d0ba-2e67-4d07-afff-a243d44ccc07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:31.624467 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9d0ba-2e67-4d07-afff-a243d44ccc07 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:31.624808 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9d0ba-2e67-4d07-afff-a243d44ccc07 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:31.625146 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9d0ba-2e67-4d07-afff-a243d44ccc07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:31.653049 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9d0ba-2e67-4d07-afff-a243d44ccc07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:31.654816 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9d0ba-2e67-4d07-afff-a243d44ccc07 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:31.675885 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1113/2231] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:03:31.713180 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815ff73-4f35-470a-a82e-446ed076d905 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:31.716059 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-7815ff73-4f35-470a-a82e-446ed076d905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:31.737807 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9d0ba-2e67-4d07-afff-a243d44ccc07 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:31.739384 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-cdd9d0ba-2e67-4d07-afff-a243d44ccc07 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:31.751481 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7815ff73-4f35-470a-a82e-446ed076d905 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:31.762501 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9d0ba-2e67-4d07-afff-a243d44ccc07 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:31.764740 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30568e-c43e-4cce-969c-14046dc39f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:31.771525 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30568e-c43e-4cce-969c-14046dc39f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:31.774998 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30568e-c43e-4cce-969c-14046dc39f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:31.774998 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30568e-c43e-4cce-969c-14046dc39f46 admin admin] PATH_INFO: `/v3/projects/052cdae88a72491abdafdb94f2a87a7d` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:31.774998 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30568e-c43e-4cce-969c-14046dc39f46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=052cdae88a72491abdafdb94f2a87a7d)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:31.779971 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30568e-c43e-4cce-969c-14046dc39f46 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:31.781856 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65aba1-14b3-4f7a-a29a-835716e7d5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:31.782814 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65aba1-14b3-4f7a-a29a-835716e7d5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:31.785351 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65aba1-14b3-4f7a-a29a-835716e7d5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:31.785351 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65aba1-14b3-4f7a-a29a-835716e7d5ef admin admin] PATH_INFO: `/v3/projects/9ea34902b6a94ccebf88e245fd0198f1` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:31.788114 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65aba1-14b3-4f7a-a29a-835716e7d5ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ea34902b6a94ccebf88e245fd0198f1)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:31.792026 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65aba1-14b3-4f7a-a29a-835716e7d5ef admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:31.924470 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-5e30568e-c43e-4cce-969c-14046dc39f46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '052cdae88a72491abdafdb94f2a87a7d', 'request_id': 'req-5e30568e-c43e-4cce-969c-14046dc39f46'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:31.929729 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-5e30568e-c43e-4cce-969c-14046dc39f46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '052cdae88a72491abdafdb94f2a87a7d', 'request_id': 'req-5e30568e-c43e-4cce-969c-14046dc39f46'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:31.959436 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-dc65aba1-14b3-4f7a-a29a-835716e7d5ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ea34902b6a94ccebf88e245fd0198f1', 'request_id': 'req-dc65aba1-14b3-4f7a-a29a-835716e7d5ef'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:32.045247 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-5e30568e-c43e-4cce-969c-14046dc39f46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '052cdae88a72491abdafdb94f2a87a7d', 'request_id': 'req-5e30568e-c43e-4cce-969c-14046dc39f46'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:32.057493 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-5e30568e-c43e-4cce-969c-14046dc39f46 admin admin] The token cache is being invalidate because project 052cdae88a72491abdafdb94f2a87a7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:32.057826 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-5e30568e-c43e-4cce-969c-14046dc39f46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:32.058484 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-5e30568e-c43e-4cce-969c-14046dc39f46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:32.060079 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1119/2232] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:31 2022] DELETE /identity/v3/projects/052cdae88a72491abdafdb94f2a87a7d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:32.064719 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384e3cb-8b75-44e4-8d1f-4662ab94cf6f None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:32.065003 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384e3cb-8b75-44e4-8d1f-4662ab94cf6f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:32.065280 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384e3cb-8b75-44e4-8d1f-4662ab94cf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:32.093472 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-b384e3cb-8b75-44e4-8d1f-4662ab94cf6f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:32.094700 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-b384e3cb-8b75-44e4-8d1f-4662ab94cf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:32.101732 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-dc65aba1-14b3-4f7a-a29a-835716e7d5ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ea34902b6a94ccebf88e245fd0198f1', 'request_id': 'req-dc65aba1-14b3-4f7a-a29a-835716e7d5ef'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:32.108792 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-dc65aba1-14b3-4f7a-a29a-835716e7d5ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ea34902b6a94ccebf88e245fd0198f1', 'request_id': 'req-dc65aba1-14b3-4f7a-a29a-835716e7d5ef'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:32.120263 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-dc65aba1-14b3-4f7a-a29a-835716e7d5ef admin admin] The token cache is being invalidate because project 9ea34902b6a94ccebf88e245fd0198f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:32.120546 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-dc65aba1-14b3-4f7a-a29a-835716e7d5ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:32.121208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-dc65aba1-14b3-4f7a-a29a-835716e7d5ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:32.123585 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1114/2233] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:31 2022] DELETE /identity/v3/projects/9ea34902b6a94ccebf88e245fd0198f1 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:32.129232 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65aba1-14b3-4f7a-a29a-835716e7d5ef admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:32.132854 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-dc65aba1-14b3-4f7a-a29a-835716e7d5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:32.187482 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1120/2234] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:03:32.188299 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384e3cb-8b75-44e4-8d1f-4662ab94cf6f None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:32.194963 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-b384e3cb-8b75-44e4-8d1f-4662ab94cf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:32.207530 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384e3cb-8b75-44e4-8d1f-4662ab94cf6f None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:32.208013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65aba1-14b3-4f7a-a29a-835716e7d5ef admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:32.213082 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b87b7-6565-40cc-8721-d26a7827f48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:32.213285 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfca745-4936-4ad5-82e1-58872262e10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:32.214466 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b87b7-6565-40cc-8721-d26a7827f48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:32.214607 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfca745-4936-4ad5-82e1-58872262e10e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:32.214759 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b87b7-6565-40cc-8721-d26a7827f48b admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:32.214926 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfca745-4936-4ad5-82e1-58872262e10e admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:32.215068 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b87b7-6565-40cc-8721-d26a7827f48b admin admin] PATH_INFO: `/v3/projects/c2e24c00419344e7b7f7209ea6d162a1` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:32.215208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfca745-4936-4ad5-82e1-58872262e10e admin admin] PATH_INFO: `/v3/users/a1443949c5944165b063de02cd4f3385` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:32.216261 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b87b7-6565-40cc-8721-d26a7827f48b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2e24c00419344e7b7f7209ea6d162a1)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:32.216442 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfca745-4936-4ad5-82e1-58872262e10e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1443949c5944165b063de02cd4f3385)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:32.218161 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b87b7-6565-40cc-8721-d26a7827f48b admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:32.218340 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfca745-4936-4ad5-82e1-58872262e10e admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:32.379156 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-6dfca745-4936-4ad5-82e1-58872262e10e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1443949c5944165b063de02cd4f3385'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:32.382354 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-273b87b7-6565-40cc-8721-d26a7827f48b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2e24c00419344e7b7f7209ea6d162a1', 'request_id': 'req-273b87b7-6565-40cc-8721-d26a7827f48b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:32.389516 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-273b87b7-6565-40cc-8721-d26a7827f48b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2e24c00419344e7b7f7209ea6d162a1', 'request_id': 'req-273b87b7-6565-40cc-8721-d26a7827f48b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:32.484542 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-6dfca745-4936-4ad5-82e1-58872262e10e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1443949c5944165b063de02cd4f3385'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:32.484999 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-6dfca745-4936-4ad5-82e1-58872262e10e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1443949c5944165b063de02cd4f3385'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:32.493855 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-6dfca745-4936-4ad5-82e1-58872262e10e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1443949c5944165b063de02cd4f3385'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:32.507591 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-6dfca745-4936-4ad5-82e1-58872262e10e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1443949c5944165b063de02cd4f3385'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:32.514587 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1115/2235] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:03:32 2022] DELETE /identity/v3/users/a1443949c5944165b063de02cd4f3385 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:03:32.522102 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68fb89-7497-4b70-9363-a3a81102c180 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:32.522102 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68fb89-7497-4b70-9363-a3a81102c180 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:32.522102 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d68fb89-7497-4b70-9363-a3a81102c180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:32.538759 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-1d68fb89-7497-4b70-9363-a3a81102c180 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:32.544912 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-1d68fb89-7497-4b70-9363-a3a81102c180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:32.545062 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-273b87b7-6565-40cc-8721-d26a7827f48b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2e24c00419344e7b7f7209ea6d162a1', 'request_id': 'req-273b87b7-6565-40cc-8721-d26a7827f48b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:32.557028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-273b87b7-6565-40cc-8721-d26a7827f48b admin admin] The token cache is being invalidate because project c2e24c00419344e7b7f7209ea6d162a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:32.557323 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-273b87b7-6565-40cc-8721-d26a7827f48b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:32.558051 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-273b87b7-6565-40cc-8721-d26a7827f48b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:32.560804 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1121/2236] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:32 2022] DELETE /identity/v3/projects/c2e24c00419344e7b7f7209ea6d162a1 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:32.567589 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf89fc-d736-4158-9911-d2cadfb671ea None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:32.568227 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf89fc-d736-4158-9911-d2cadfb671ea None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:32.568509 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf89fc-d736-4158-9911-d2cadfb671ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:32.600215 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-7eaf89fc-d736-4158-9911-d2cadfb671ea None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:32.601588 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-7eaf89fc-d736-4158-9911-d2cadfb671ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:32.633740 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1116/2237] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:32.639117 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68fb89-7497-4b70-9363-a3a81102c180 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:32.658880 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d68fb89-7497-4b70-9363-a3a81102c180 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:32.672203 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5989a02-0d13-43bd-aa19-563ba96b7740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:32.673024 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5989a02-0d13-43bd-aa19-563ba96b7740 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:32.674660 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5989a02-0d13-43bd-aa19-563ba96b7740 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:32.675037 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5989a02-0d13-43bd-aa19-563ba96b7740 admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:32.678013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5989a02-0d13-43bd-aa19-563ba96b7740 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:03:32.678013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5989a02-0d13-43bd-aa19-563ba96b7740 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:32.680162 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5989a02-0d13-43bd-aa19-563ba96b7740 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:32.706741 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1117/2238] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:03:32.711850 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5989a02-0d13-43bd-aa19-563ba96b7740 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:32.725546 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1122/2239] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:32.727234 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be684be2-50e0-4589-a549-b6df4ce4b2df None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:32.727665 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be684be2-50e0-4589-a549-b6df4ce4b2df None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:32.728079 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be684be2-50e0-4589-a549-b6df4ce4b2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:32.731237 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5989a02-0d13-43bd-aa19-563ba96b7740 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:32.747104 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424fc39-f5ac-4480-92f6-4349e6e49039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:32.747104 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424fc39-f5ac-4480-92f6-4349e6e49039 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:32.747104 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424fc39-f5ac-4480-92f6-4349e6e49039 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:32.747104 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9424fc39-f5ac-4480-92f6-4349e6e49039 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:32.747624 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424fc39-f5ac-4480-92f6-4349e6e49039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:32.747624 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9424fc39-f5ac-4480-92f6-4349e6e49039 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:32.763859 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-be684be2-50e0-4589-a549-b6df4ce4b2df None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:32.765073 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-be684be2-50e0-4589-a549-b6df4ce4b2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:32.788645 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1123/2240] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:03:32.793179 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be684be2-50e0-4589-a549-b6df4ce4b2df None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:32.814959 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be684be2-50e0-4589-a549-b6df4ce4b2df None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:32.820181 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603c538-5568-48b1-b5ab-4d46894e8259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:32.821053 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603c538-5568-48b1-b5ab-4d46894e8259 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:32.821397 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603c538-5568-48b1-b5ab-4d46894e8259 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:32.821764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603c538-5568-48b1-b5ab-4d46894e8259 admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:32.822893 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603c538-5568-48b1-b5ab-4d46894e8259 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:03:32.823268 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603c538-5568-48b1-b5ab-4d46894e8259 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:32.824979 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603c538-5568-48b1-b5ab-4d46894e8259 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:32.847182 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1124/2241] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:03:32.852270 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603c538-5568-48b1-b5ab-4d46894e8259 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:32.864291 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603c538-5568-48b1-b5ab-4d46894e8259 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:32.869848 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1118/2242] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:03:32 2022] POST /identity/v3/projects => generated 373 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:32.880383 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424fc39-f5ac-4480-92f6-4349e6e49039 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:32.966629 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de2fde-8d65-4971-b319-4a84295c2517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:32.967815 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de2fde-8d65-4971-b319-4a84295c2517 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:32.970063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de2fde-8d65-4971-b319-4a84295c2517 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:32.970063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de2fde-8d65-4971-b319-4a84295c2517 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:32.970063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de2fde-8d65-4971-b319-4a84295c2517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:32.971601 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de2fde-8d65-4971-b319-4a84295c2517 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:33.020489 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9424fc39-f5ac-4480-92f6-4349e6e49039 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:33.026030 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78461e5-0609-467b-922a-f0824be70247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:33.026936 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78461e5-0609-467b-922a-f0824be70247 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:33.027230 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78461e5-0609-467b-922a-f0824be70247 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:33.029351 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78461e5-0609-467b-922a-f0824be70247 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:33.029351 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78461e5-0609-467b-922a-f0824be70247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:33.031529 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78461e5-0609-467b-922a-f0824be70247 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:33.057278 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1125/2243] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:03:32 2022] POST /identity/v3/projects => generated 379 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:33.059131 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de2fde-8d65-4971-b319-4a84295c2517 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:33.146217 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1119/2244] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:03:32 2022] POST /identity/v3/users => generated 287 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:33.147556 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78461e5-0609-467b-922a-f0824be70247 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:33.166198 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de2fde-8d65-4971-b319-4a84295c2517 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:33.166405 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78461e5-0609-467b-922a-f0824be70247 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:33.174032 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80dcca9-1d2f-4916-9fd5-e8bc0c41a8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:33.174941 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80dcca9-1d2f-4916-9fd5-e8bc0c41a8bd admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:33.175958 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80dcca9-1d2f-4916-9fd5-e8bc0c41a8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:33.176251 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80dcca9-1d2f-4916-9fd5-e8bc0c41a8bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:33.177256 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80dcca9-1d2f-4916-9fd5-e8bc0c41a8bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:33.178475 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b6b10-66b4-49e0-a9a9-b9175e0f4369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:33.179208 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b6b10-66b4-49e0-a9a9-b9175e0f4369 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:33.179488 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b6b10-66b4-49e0-a9a9-b9175e0f4369 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:33.179762 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b6b10-66b4-49e0-a9a9-b9175e0f4369 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:33.179967 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80dcca9-1d2f-4916-9fd5-e8bc0c41a8bd admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:33.180548 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b6b10-66b4-49e0-a9a9-b9175e0f4369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:33.185057 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b6b10-66b4-49e0-a9a9-b9175e0f4369 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:33.199995 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1120/2245] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:33.202090 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80dcca9-1d2f-4916-9fd5-e8bc0c41a8bd admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:33.217928 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80dcca9-1d2f-4916-9fd5-e8bc0c41a8bd admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:33.224058 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763738f-9b0c-4cc3-8da4-e1e05b43db5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:33.224809 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763738f-9b0c-4cc3-8da4-e1e05b43db5e admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:33.225092 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763738f-9b0c-4cc3-8da4-e1e05b43db5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:33.225375 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9763738f-9b0c-4cc3-8da4-e1e05b43db5e admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:33.226125 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763738f-9b0c-4cc3-8da4-e1e05b43db5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:33.227798 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9763738f-9b0c-4cc3-8da4-e1e05b43db5e admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:33.238949 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1121/2246] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:33.243991 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763738f-9b0c-4cc3-8da4-e1e05b43db5e admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:33.260558 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9763738f-9b0c-4cc3-8da4-e1e05b43db5e admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:33.277477 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ec54b-50a1-4b3e-b874-b74ec090365b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:33.278428 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ec54b-50a1-4b3e-b874-b74ec090365b admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:33.278711 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ec54b-50a1-4b3e-b874-b74ec090365b admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:33.278881 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1126/2247] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:03:33 2022] POST /identity/v3/users => generated 290 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:33.285557 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ec54b-50a1-4b3e-b874-b74ec090365b admin admin] PATH_INFO: `/v3/projects/b103b73fb4c546068220dca1a3f2a5a2/users/ad07436fa4994907b5d29bcd044735c0/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:33.285689 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b6b10-66b4-49e0-a9a9-b9175e0f4369 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:33.295206 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b6b10-66b4-49e0-a9a9-b9175e0f4369 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:33.300717 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ec54b-50a1-4b3e-b874-b74ec090365b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b103b73fb4c546068220dca1a3f2a5a2, user_id=ad07436fa4994907b5d29bcd044735c0, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:33.300855 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473f6ea-05af-4766-b16b-cc22e93110c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:33.301546 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473f6ea-05af-4766-b16b-cc22e93110c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:33.305723 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473f6ea-05af-4766-b16b-cc22e93110c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:33.305723 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473f6ea-05af-4766-b16b-cc22e93110c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:33.305723 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473f6ea-05af-4766-b16b-cc22e93110c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:33.306208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ec54b-50a1-4b3e-b874-b74ec090365b admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:33.306288 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473f6ea-05af-4766-b16b-cc22e93110c9 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:33.319642 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1127/2248] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:33.324954 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473f6ea-05af-4766-b16b-cc22e93110c9 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:33.327157 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-0473f6ea-05af-4766-b16b-cc22e93110c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:33.348872 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473f6ea-05af-4766-b16b-cc22e93110c9 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:33.354091 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00addd92-37ce-42cf-a127-69917529f0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:33.355153 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00addd92-37ce-42cf-a127-69917529f0cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:33.355503 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00addd92-37ce-42cf-a127-69917529f0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:33.355857 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00addd92-37ce-42cf-a127-69917529f0cd admin admin] PATH_INFO: `/v3/projects/2583846b7a3e46a299e140900e1b7225` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:33.357540 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00addd92-37ce-42cf-a127-69917529f0cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2583846b7a3e46a299e140900e1b7225)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:33.359548 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00addd92-37ce-42cf-a127-69917529f0cd admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:33.368722 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1122/2249] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:33 2022] PUT /identity/v3/projects/b103b73fb4c546068220dca1a3f2a5a2/users/ad07436fa4994907b5d29bcd044735c0/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:03:33.368722 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ec54b-50a1-4b3e-b874-b74ec090365b admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:33.446223 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ec54b-50a1-4b3e-b874-b74ec090365b admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:33.451440 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654b3701-e572-4104-b033-9de82d98688d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:33.452113 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b3701-e572-4104-b033-9de82d98688d admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:33.452401 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b3701-e572-4104-b033-9de82d98688d admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:33.458206 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654b3701-e572-4104-b033-9de82d98688d admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:33.458206 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b3701-e572-4104-b033-9de82d98688d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:33.458206 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654b3701-e572-4104-b033-9de82d98688d admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:33.473116 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1123/2250] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:33.476551 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7364b-3169-4c68-a59a-a28d174b8a49 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:33.476914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7364b-3169-4c68-a59a-a28d174b8a49 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:33.477311 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7364b-3169-4c68-a59a-a28d174b8a49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:33.484157 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-00addd92-37ce-42cf-a127-69917529f0cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2583846b7a3e46a299e140900e1b7225', 'request_id': 'req-00addd92-37ce-42cf-a127-69917529f0cd'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:33.494358 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-00addd92-37ce-42cf-a127-69917529f0cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2583846b7a3e46a299e140900e1b7225', 'request_id': 'req-00addd92-37ce-42cf-a127-69917529f0cd'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:33.529367 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-2eb7364b-3169-4c68-a59a-a28d174b8a49 None None] MFA Rules not processed for user `ad07436fa4994907b5d29bcd044735c0`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:33.530761 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-2eb7364b-3169-4c68-a59a-a28d174b8a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:33.576265 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-00addd92-37ce-42cf-a127-69917529f0cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2583846b7a3e46a299e140900e1b7225', 'request_id': 'req-00addd92-37ce-42cf-a127-69917529f0cd'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:33.592725 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-00addd92-37ce-42cf-a127-69917529f0cd admin admin] The token cache is being invalidate because project 2583846b7a3e46a299e140900e1b7225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:33.593101 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-00addd92-37ce-42cf-a127-69917529f0cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:33.593890 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-00addd92-37ce-42cf-a127-69917529f0cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:33.596184 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1128/2251] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:33 2022] DELETE /identity/v3/projects/2583846b7a3e46a299e140900e1b7225 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:33.597002 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00addd92-37ce-42cf-a127-69917529f0cd admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:33.608758 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-00addd92-37ce-42cf-a127-69917529f0cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:33.617852 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1124/2252] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:33 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:33.629809 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2deb3-b8f8-4273-863b-b4ff4a67b29f None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:33.630109 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2deb3-b8f8-4273-863b-b4ff4a67b29f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:33.630393 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e2deb3-b8f8-4273-863b-b4ff4a67b29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:33.649985 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-d0e2deb3-b8f8-4273-863b-b4ff4a67b29f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:33.652113 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d0e2deb3-b8f8-4273-863b-b4ff4a67b29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:33.732231 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1125/2253] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:33.733212 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2deb3-b8f8-4273-863b-b4ff4a67b29f None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:33.734580 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d0e2deb3-b8f8-4273-863b-b4ff4a67b29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:33.743634 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00addd92-37ce-42cf-a127-69917529f0cd admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:33.758377 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0172ee15-2183-4007-9616-201c3b5269d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:33.759288 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172ee15-2183-4007-9616-201c3b5269d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:33.759568 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172ee15-2183-4007-9616-201c3b5269d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:33.759840 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0172ee15-2183-4007-9616-201c3b5269d0 admin admin] PATH_INFO: `/v3/projects/637e4085dc72453bbd93166c9c6bf935/users/666e5f4ec73d46c5834608b1f21a4447/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:33.784539 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172ee15-2183-4007-9616-201c3b5269d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=637e4085dc72453bbd93166c9c6bf935, user_id=666e5f4ec73d46c5834608b1f21a4447, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:33.787346 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0172ee15-2183-4007-9616-201c3b5269d0 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:33.811812 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e2deb3-b8f8-4273-863b-b4ff4a67b29f None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:33.815419 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc111f2-4fae-4d7c-9b96-7531449fb75a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:33.816044 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc111f2-4fae-4d7c-9b96-7531449fb75a service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:33.816320 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc111f2-4fae-4d7c-9b96-7531449fb75a service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:33.816590 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc111f2-4fae-4d7c-9b96-7531449fb75a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:33.824877 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc111f2-4fae-4d7c-9b96-7531449fb75a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:33.826390 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc111f2-4fae-4d7c-9b96-7531449fb75a service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:33.835242 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1126/2254] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:03:33.836443 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce43fe-fd0d-44ec-a5e1-d31e2c984ceb None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:33.836786 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce43fe-fd0d-44ec-a5e1-d31e2c984ceb None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:33.837054 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce43fe-fd0d-44ec-a5e1-d31e2c984ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:33.860861 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-f5ce43fe-fd0d-44ec-a5e1-d31e2c984ceb None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:33.867092 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-f5ce43fe-fd0d-44ec-a5e1-d31e2c984ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:33.876704 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1127/2255] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:33.880434 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce43fe-fd0d-44ec-a5e1-d31e2c984ceb None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:33.884921 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1129/2256] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:33 2022] PUT /identity/v3/projects/637e4085dc72453bbd93166c9c6bf935/users/666e5f4ec73d46c5834608b1f21a4447/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:33.891174 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552179e-d919-455f-ad29-bdb090feed0e None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:33.891498 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552179e-d919-455f-ad29-bdb090feed0e None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:33.891786 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7552179e-d919-455f-ad29-bdb090feed0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:33.899203 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce43fe-fd0d-44ec-a5e1-d31e2c984ceb None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:33.952755 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-7552179e-d919-455f-ad29-bdb090feed0e None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:33.954008 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-7552179e-d919-455f-ad29-bdb090feed0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:34.027960 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06299b9a-36f6-4d5a-b0f3-ccf2ac446975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:34.028615 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06299b9a-36f6-4d5a-b0f3-ccf2ac446975 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:34.028901 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06299b9a-36f6-4d5a-b0f3-ccf2ac446975 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:34.029180 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06299b9a-36f6-4d5a-b0f3-ccf2ac446975 admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:34.029919 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06299b9a-36f6-4d5a-b0f3-ccf2ac446975 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:03:34.030227 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06299b9a-36f6-4d5a-b0f3-ccf2ac446975 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:34.031992 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06299b9a-36f6-4d5a-b0f3-ccf2ac446975 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:34.036959 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1130/2257] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:34.055809 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1128/2258] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:03:34.064260 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552179e-d919-455f-ad29-bdb090feed0e None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:34.077776 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06299b9a-36f6-4d5a-b0f3-ccf2ac446975 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:34.081561 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-06299b9a-36f6-4d5a-b0f3-ccf2ac446975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:34.116597 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7552179e-d919-455f-ad29-bdb090feed0e None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:34.128970 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff72b7-91e9-41b3-a62a-c273ef3e60a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:34.129846 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff72b7-91e9-41b3-a62a-c273ef3e60a7 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:34.130696 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff72b7-91e9-41b3-a62a-c273ef3e60a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:34.131165 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffff72b7-91e9-41b3-a62a-c273ef3e60a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:34.131925 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff72b7-91e9-41b3-a62a-c273ef3e60a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:34.133928 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffff72b7-91e9-41b3-a62a-c273ef3e60a7 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:34.211596 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06299b9a-36f6-4d5a-b0f3-ccf2ac446975 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:34.218560 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a6107-2efa-42bf-b356-a8667c6e1e4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:34.219447 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a6107-2efa-42bf-b356-a8667c6e1e4f service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:34.220491 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a6107-2efa-42bf-b356-a8667c6e1e4f service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:34.220824 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a6107-2efa-42bf-b356-a8667c6e1e4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:34.234734 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a6107-2efa-42bf-b356-a8667c6e1e4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:34.236896 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a6107-2efa-42bf-b356-a8667c6e1e4f service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:34.237871 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1131/2259] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:03:34 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:34.243066 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff72b7-91e9-41b3-a62a-c273ef3e60a7 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:34.251390 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1129/2260] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:03:34.321911 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffff72b7-91e9-41b3-a62a-c273ef3e60a7 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:34.326640 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03945efc-9e94-4712-88d9-5331aad86fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:34.327346 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03945efc-9e94-4712-88d9-5331aad86fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:34.327628 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03945efc-9e94-4712-88d9-5331aad86fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:34.327902 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03945efc-9e94-4712-88d9-5331aad86fe3 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:34.328867 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03945efc-9e94-4712-88d9-5331aad86fe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:34.330821 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03945efc-9e94-4712-88d9-5331aad86fe3 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:34.396148 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1132/2261] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:03:34 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:34.399910 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a6107-2efa-42bf-b356-a8667c6e1e4f service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:34.414826 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a6107-2efa-42bf-b356-a8667c6e1e4f service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:34.423172 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ec0f6-3817-427a-b044-a9536dfd89f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:34.424054 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ec0f6-3817-427a-b044-a9536dfd89f7 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:34.424513 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ec0f6-3817-427a-b044-a9536dfd89f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:34.425172 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ec0f6-3817-427a-b044-a9536dfd89f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:34.439588 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ec0f6-3817-427a-b044-a9536dfd89f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:34.441663 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ec0f6-3817-427a-b044-a9536dfd89f7 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:34.456955 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1130/2262] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:03:34.459355 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03945efc-9e94-4712-88d9-5331aad86fe3 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:34.475396 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03945efc-9e94-4712-88d9-5331aad86fe3 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:34.491705 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec5b7bc-229f-45f5-8711-01d506736ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:34.492769 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5b7bc-229f-45f5-8711-01d506736ddc admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:34.493105 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5b7bc-229f-45f5-8711-01d506736ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:34.494137 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec5b7bc-229f-45f5-8711-01d506736ddc admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:34.495150 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5b7bc-229f-45f5-8711-01d506736ddc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:34.496950 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec5b7bc-229f-45f5-8711-01d506736ddc admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:34.511490 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1133/2263] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:34.514411 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ec0f6-3817-427a-b044-a9536dfd89f7 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:34.528087 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ec0f6-3817-427a-b044-a9536dfd89f7 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:34.536108 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532b7ec-9d6d-4650-8433-9f8c1e63aabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:34.548419 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532b7ec-9d6d-4650-8433-9f8c1e63aabf admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:34.548419 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532b7ec-9d6d-4650-8433-9f8c1e63aabf admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:34.548419 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a532b7ec-9d6d-4650-8433-9f8c1e63aabf admin admin] PATH_INFO: `/v3/projects/aaaf50dffadf49a0aaa668e1b2072665/users/c6bffe2c04c443828fe86284280374d6/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:34.566062 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532b7ec-9d6d-4650-8433-9f8c1e63aabf admin admin] RBAC: Authorizing `identity:create_grant(project_id=aaaf50dffadf49a0aaa668e1b2072665, user_id=c6bffe2c04c443828fe86284280374d6, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:34.569028 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a532b7ec-9d6d-4650-8433-9f8c1e63aabf admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:34.659968 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1131/2264] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:34 2022] PUT /identity/v3/projects/aaaf50dffadf49a0aaa668e1b2072665/users/c6bffe2c04c443828fe86284280374d6/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:34.671705 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f992fd-3774-4cec-82f2-d247c69b83c9 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:34.671996 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f992fd-3774-4cec-82f2-d247c69b83c9 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:34.672277 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f992fd-3774-4cec-82f2-d247c69b83c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:34.701712 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-b3f992fd-3774-4cec-82f2-d247c69b83c9 None None] MFA Rules not processed for user `c6bffe2c04c443828fe86284280374d6`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:34.703042 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-b3f992fd-3774-4cec-82f2-d247c69b83c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:34.788358 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1134/2265] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:03:34.792959 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532b7ec-9d6d-4650-8433-9f8c1e63aabf admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:34.865356 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a532b7ec-9d6d-4650-8433-9f8c1e63aabf admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:34.870703 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a387c1-e234-448f-84d9-9550588b9dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:34.871412 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a387c1-e234-448f-84d9-9550588b9dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:34.871825 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a387c1-e234-448f-84d9-9550588b9dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:34.872385 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a387c1-e234-448f-84d9-9550588b9dc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:34.872890 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a387c1-e234-448f-84d9-9550588b9dc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:34.874857 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a387c1-e234-448f-84d9-9550588b9dc4 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:34.990661 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1132/2266] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:03:34 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:34.998427 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f992fd-3774-4cec-82f2-d247c69b83c9 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:35.009288 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f992fd-3774-4cec-82f2-d247c69b83c9 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:35.064206 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f34129-10d7-42a4-8195-e4252d1a874a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:35.064771 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f34129-10d7-42a4-8195-e4252d1a874a admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:35.065044 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f34129-10d7-42a4-8195-e4252d1a874a admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:35.065311 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f34129-10d7-42a4-8195-e4252d1a874a admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:35.065998 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f34129-10d7-42a4-8195-e4252d1a874a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:35.067926 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f34129-10d7-42a4-8195-e4252d1a874a admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:35.165655 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1135/2267] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:03:34 2022] POST /identity/v3/users => generated 289 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:03:35.170754 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a387c1-e234-448f-84d9-9550588b9dc4 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:35.181337 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a387c1-e234-448f-84d9-9550588b9dc4 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:35.188007 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8532d2-eb57-4250-9d7c-73817ad3685e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:35.188673 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8532d2-eb57-4250-9d7c-73817ad3685e admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:35.188956 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8532d2-eb57-4250-9d7c-73817ad3685e admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:35.189234 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8532d2-eb57-4250-9d7c-73817ad3685e admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:35.189972 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8532d2-eb57-4250-9d7c-73817ad3685e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:35.192452 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8532d2-eb57-4250-9d7c-73817ad3685e admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:35.203754 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1133/2268] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:35.207929 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f34129-10d7-42a4-8195-e4252d1a874a admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:35.218546 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f34129-10d7-42a4-8195-e4252d1a874a admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:35.226397 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255cf05e-36f9-4949-a9b4-1b4d9ab80610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:35.226397 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cf05e-36f9-4949-a9b4-1b4d9ab80610 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:35.226397 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cf05e-36f9-4949-a9b4-1b4d9ab80610 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:35.226397 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255cf05e-36f9-4949-a9b4-1b4d9ab80610 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:35.226763 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cf05e-36f9-4949-a9b4-1b4d9ab80610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:35.227027 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255cf05e-36f9-4949-a9b4-1b4d9ab80610 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:35.242471 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1136/2269] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:03:35.243694 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8532d2-eb57-4250-9d7c-73817ad3685e admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:35.253796 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8532d2-eb57-4250-9d7c-73817ad3685e admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:35.259393 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d24ae-227c-4963-a837-2abda5ea506e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:35.260378 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d24ae-227c-4963-a837-2abda5ea506e admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:35.260707 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d24ae-227c-4963-a837-2abda5ea506e admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:35.261009 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d24ae-227c-4963-a837-2abda5ea506e admin admin] PATH_INFO: `/v3/projects/9fb4e90e3d5a4d838082bdf596ae71d3/users/3910275a37f54a0c90c3c15186b5cf4d/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:35.279094 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d24ae-227c-4963-a837-2abda5ea506e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fb4e90e3d5a4d838082bdf596ae71d3, user_id=3910275a37f54a0c90c3c15186b5cf4d, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:35.282079 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d24ae-227c-4963-a837-2abda5ea506e admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:35.399135 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1134/2270] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:35 2022] PUT /identity/v3/projects/9fb4e90e3d5a4d838082bdf596ae71d3/users/3910275a37f54a0c90c3c15186b5cf4d/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:35.410338 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317eaecc-c5c6-4af1-8362-e819cfed5299 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:35.410736 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317eaecc-c5c6-4af1-8362-e819cfed5299 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:35.411151 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317eaecc-c5c6-4af1-8362-e819cfed5299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:35.438721 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-317eaecc-c5c6-4af1-8362-e819cfed5299 None None] MFA Rules not processed for user `3910275a37f54a0c90c3c15186b5cf4d`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:35.439991 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-317eaecc-c5c6-4af1-8362-e819cfed5299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:35.509096 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1137/2271] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:35.514342 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d24ae-227c-4963-a837-2abda5ea506e admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:35.599904 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d24ae-227c-4963-a837-2abda5ea506e admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:35.611024 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7ec24-48ef-4768-9c8b-834fbc12ce70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:35.611024 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7ec24-48ef-4768-9c8b-834fbc12ce70 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:35.611024 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7ec24-48ef-4768-9c8b-834fbc12ce70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:35.611024 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7ec24-48ef-4768-9c8b-834fbc12ce70 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:35.611321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7ec24-48ef-4768-9c8b-834fbc12ce70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:35.611994 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7ec24-48ef-4768-9c8b-834fbc12ce70 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:35.721370 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1135/2272] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:03:35 2022] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:03:35.725582 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317eaecc-c5c6-4af1-8362-e819cfed5299 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:35.737684 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317eaecc-c5c6-4af1-8362-e819cfed5299 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:35.804576 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7cf5d-78a0-41ce-acdd-7d4db090c488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:35.805337 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7cf5d-78a0-41ce-acdd-7d4db090c488 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:35.805682 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7cf5d-78a0-41ce-acdd-7d4db090c488 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:35.806070 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7cf5d-78a0-41ce-acdd-7d4db090c488 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:35.806853 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7cf5d-78a0-41ce-acdd-7d4db090c488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:35.809411 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7cf5d-78a0-41ce-acdd-7d4db090c488 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:35.873502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1138/2273] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:03:35 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:35.877964 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7ec24-48ef-4768-9c8b-834fbc12ce70 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:35.892539 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7ec24-48ef-4768-9c8b-834fbc12ce70 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:35.898812 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52815c80-b104-406d-b2d6-2f7c8d9bad84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:35.899511 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52815c80-b104-406d-b2d6-2f7c8d9bad84 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:35.899823 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52815c80-b104-406d-b2d6-2f7c8d9bad84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:35.900102 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52815c80-b104-406d-b2d6-2f7c8d9bad84 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:35.900841 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52815c80-b104-406d-b2d6-2f7c8d9bad84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:35.902643 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52815c80-b104-406d-b2d6-2f7c8d9bad84 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:35.914878 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1136/2274] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:35.918534 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7cf5d-78a0-41ce-acdd-7d4db090c488 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:35.929524 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7cf5d-78a0-41ce-acdd-7d4db090c488 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:35.935169 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ae4f4-ea66-44c6-acbb-3b6869d1409d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:35.936106 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ae4f4-ea66-44c6-acbb-3b6869d1409d admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:35.936386 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ae4f4-ea66-44c6-acbb-3b6869d1409d admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:35.936658 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ae4f4-ea66-44c6-acbb-3b6869d1409d admin admin] PATH_INFO: `/v3/projects/1127ca58d342411dbe7812bae76ccc5e/users/d0603dfd199e427db62420ae9d8c8ba2/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:35.952828 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ae4f4-ea66-44c6-acbb-3b6869d1409d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1127ca58d342411dbe7812bae76ccc5e, user_id=d0603dfd199e427db62420ae9d8c8ba2, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:35.955502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ae4f4-ea66-44c6-acbb-3b6869d1409d admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:36.028249 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1139/2275] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:35 2022] PUT /identity/v3/projects/1127ca58d342411dbe7812bae76ccc5e/users/d0603dfd199e427db62420ae9d8c8ba2/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:03:36.031354 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52815c80-b104-406d-b2d6-2f7c8d9bad84 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:36.041865 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52815c80-b104-406d-b2d6-2f7c8d9bad84 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:36.099288 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a184cc-6604-4f0f-a637-73994799d8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:36.100136 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a184cc-6604-4f0f-a637-73994799d8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:36.100414 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a184cc-6604-4f0f-a637-73994799d8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:36.100684 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a184cc-6604-4f0f-a637-73994799d8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:36.101412 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a184cc-6604-4f0f-a637-73994799d8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:36.103147 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a184cc-6604-4f0f-a637-73994799d8d1 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:36.114455 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1137/2276] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:36 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:36.119441 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ae4f4-ea66-44c6-acbb-3b6869d1409d admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:36.132466 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ae4f4-ea66-44c6-acbb-3b6869d1409d admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:36.137953 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab75031-8d62-4de8-88ff-d077830d3e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:36.143219 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab75031-8d62-4de8-88ff-d077830d3e35 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:36.143531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab75031-8d62-4de8-88ff-d077830d3e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:36.143810 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab75031-8d62-4de8-88ff-d077830d3e35 admin admin] PATH_INFO: `/v3/projects/1127ca58d342411dbe7812bae76ccc5e/users/d0603dfd199e427db62420ae9d8c8ba2/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:36.146312 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab75031-8d62-4de8-88ff-d077830d3e35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1127ca58d342411dbe7812bae76ccc5e, user_id=d0603dfd199e427db62420ae9d8c8ba2, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:36.149166 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab75031-8d62-4de8-88ff-d077830d3e35 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:36.160703 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1140/2277] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:36 2022] PUT /identity/v3/projects/1127ca58d342411dbe7812bae76ccc5e/users/d0603dfd199e427db62420ae9d8c8ba2/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:36.172150 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c04a2-dfaa-4d76-9076-289580aedb2f None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:36.172539 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c04a2-dfaa-4d76-9076-289580aedb2f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:36.172896 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69c04a2-dfaa-4d76-9076-289580aedb2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:36.205207 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-d69c04a2-dfaa-4d76-9076-289580aedb2f None None] MFA Rules not processed for user `d0603dfd199e427db62420ae9d8c8ba2`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:36.206928 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d69c04a2-dfaa-4d76-9076-289580aedb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:36.283641 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1138/2278] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:36 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:03:36.295980 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab75031-8d62-4de8-88ff-d077830d3e35 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:36.351865 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab75031-8d62-4de8-88ff-d077830d3e35 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:36.356310 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3605e85-452b-4722-92a7-6e7a7c85483c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:36.357276 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3605e85-452b-4722-92a7-6e7a7c85483c service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:36.357559 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3605e85-452b-4722-92a7-6e7a7c85483c service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:36.357833 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3605e85-452b-4722-92a7-6e7a7c85483c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:36.367038 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3605e85-452b-4722-92a7-6e7a7c85483c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:36.368568 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3605e85-452b-4722-92a7-6e7a7c85483c service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:36.379009 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1141/2279] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:03:36.496224 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c04a2-dfaa-4d76-9076-289580aedb2f None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:36.496224 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d69c04a2-dfaa-4d76-9076-289580aedb2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:36.514252 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69c04a2-dfaa-4d76-9076-289580aedb2f None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:36.522977 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632afb03-e99c-40c7-b3ad-1f1115e8baec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:36.524420 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632afb03-e99c-40c7-b3ad-1f1115e8baec service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:36.524884 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632afb03-e99c-40c7-b3ad-1f1115e8baec service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:36.527371 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632afb03-e99c-40c7-b3ad-1f1115e8baec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:36.612489 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632afb03-e99c-40c7-b3ad-1f1115e8baec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:36.614197 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632afb03-e99c-40c7-b3ad-1f1115e8baec service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:36.630650 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1139/2280] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:03:37.779990 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37c8e8-3690-4042-a8a6-2e8e5faa7285 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:37.779990 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37c8e8-3690-4042-a8a6-2e8e5faa7285 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:37.780712 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37c8e8-3690-4042-a8a6-2e8e5faa7285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:37.803607 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-7c37c8e8-3690-4042-a8a6-2e8e5faa7285 None None] MFA Rules not processed for user `ad07436fa4994907b5d29bcd044735c0`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:37.805312 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-7c37c8e8-3690-4042-a8a6-2e8e5faa7285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:37.883233 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1142/2281] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:38.263392 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c1312-1cfd-4772-9ed5-5f436602d9cc None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:38.270266 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c1312-1cfd-4772-9ed5-5f436602d9cc None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:38.270266 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101c1312-1cfd-4772-9ed5-5f436602d9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:38.291632 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-101c1312-1cfd-4772-9ed5-5f436602d9cc None None] MFA Rules not processed for user `5c7b25e0e29143d783553859a0583d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:38.293488 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-101c1312-1cfd-4772-9ed5-5f436602d9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:38.354498 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1140/2282] 10.222.0.24 () {58 vars in 1009 bytes} [Tue Apr 12 00:03:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:38.408959 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37c8e8-3690-4042-a8a6-2e8e5faa7285 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:38.410470 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-7c37c8e8-3690-4042-a8a6-2e8e5faa7285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:38.479597 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37c8e8-3690-4042-a8a6-2e8e5faa7285 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:38.484814 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd80e2-7965-4c69-b992-c5c6f9ad30e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d616b38304d91bf1c7aded81205e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:38.485492 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd80e2-7965-4c69-b992-c5c6f9ad30e8 service swift] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:38.485777 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd80e2-7965-4c69-b992-c5c6f9ad30e8 service swift] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:38.486050 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd80e2-7965-4c69-b992-c5c6f9ad30e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:38.495598 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd80e2-7965-4c69-b992-c5c6f9ad30e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:38.497526 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd80e2-7965-4c69-b992-c5c6f9ad30e8 service swift] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:38.506272 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1143/2283] 10.222.0.24 () {60 vars in 1384 bytes} [Tue Apr 12 00:03:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:03:41.430327 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c1312-1cfd-4772-9ed5-5f436602d9cc None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:41.593759 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101c1312-1cfd-4772-9ed5-5f436602d9cc None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:41.596906 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab7e04-ec35-4a8a-9fa9-e3ce54d48eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:41.597867 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab7e04-ec35-4a8a-9fa9-e3ce54d48eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:41.598160 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab7e04-ec35-4a8a-9fa9-e3ce54d48eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:41.598436 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab7e04-ec35-4a8a-9fa9-e3ce54d48eb9 admin admin] PATH_INFO: `/v3/users/c6bffe2c04c443828fe86284280374d6` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:41.600365 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab7e04-ec35-4a8a-9fa9-e3ce54d48eb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6bffe2c04c443828fe86284280374d6)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:41.602441 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab7e04-ec35-4a8a-9fa9-e3ce54d48eb9 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:41.872793 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e0ab7e04-ec35-4a8a-9fa9-e3ce54d48eb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6bffe2c04c443828fe86284280374d6'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:41.925212 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e0ab7e04-ec35-4a8a-9fa9-e3ce54d48eb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6bffe2c04c443828fe86284280374d6'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:41.926368 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e0ab7e04-ec35-4a8a-9fa9-e3ce54d48eb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6bffe2c04c443828fe86284280374d6'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:41.938039 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e0ab7e04-ec35-4a8a-9fa9-e3ce54d48eb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6bffe2c04c443828fe86284280374d6'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:41.958925 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e0ab7e04-ec35-4a8a-9fa9-e3ce54d48eb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6bffe2c04c443828fe86284280374d6'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:41.971659 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1141/2284] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:03:41 2022] DELETE /identity/v3/users/c6bffe2c04c443828fe86284280374d6 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:41.973554 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bd0b9-ec48-4450-aa8e-4dc0a49f771f None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:41.974095 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bd0b9-ec48-4450-aa8e-4dc0a49f771f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:41.974095 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bd0b9-ec48-4450-aa8e-4dc0a49f771f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:42.013127 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-a85bd0b9-ec48-4450-aa8e-4dc0a49f771f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:42.014654 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a85bd0b9-ec48-4450-aa8e-4dc0a49f771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:42.218012 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1144/2285] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:42.259834 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab7e04-ec35-4a8a-9fa9-e3ce54d48eb9 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:42.262183 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-e0ab7e04-ec35-4a8a-9fa9-e3ce54d48eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:42.301865 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862f35a-df20-4130-b09e-5725dfa435cd None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:42.304772 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862f35a-df20-4130-b09e-5725dfa435cd None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:42.304772 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862f35a-df20-4130-b09e-5725dfa435cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:42.392265 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-0862f35a-df20-4130-b09e-5725dfa435cd None None] MFA Rules not processed for user `666e5f4ec73d46c5834608b1f21a4447`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:42.402971 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-0862f35a-df20-4130-b09e-5725dfa435cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:42.403125 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab7e04-ec35-4a8a-9fa9-e3ce54d48eb9 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:42.404902 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4a2b4-482e-4d7e-a889-a1544abf83da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:42.405638 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4a2b4-482e-4d7e-a889-a1544abf83da service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:42.405915 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4a2b4-482e-4d7e-a889-a1544abf83da service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:42.406238 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a4a2b4-482e-4d7e-a889-a1544abf83da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:42.421407 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4a2b4-482e-4d7e-a889-a1544abf83da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:42.423328 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a4a2b4-482e-4d7e-a889-a1544abf83da service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:42.438261 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1142/2286] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:03:42.545641 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1145/2287] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:42.546911 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4a2b4-482e-4d7e-a889-a1544abf83da service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:42.548605 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-39a4a2b4-482e-4d7e-a889-a1544abf83da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:42.571082 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a4a2b4-482e-4d7e-a889-a1544abf83da service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:42.580182 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624e749-1779-4cc3-a6f4-148cc021208a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:42.581090 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624e749-1779-4cc3-a6f4-148cc021208a admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:42.581377 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624e749-1779-4cc3-a6f4-148cc021208a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:42.581652 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624e749-1779-4cc3-a6f4-148cc021208a admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:42.582563 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624e749-1779-4cc3-a6f4-148cc021208a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:42.584729 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624e749-1779-4cc3-a6f4-148cc021208a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:42.729423 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1143/2288] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:03:42 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:42.733911 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862f35a-df20-4130-b09e-5725dfa435cd None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:42.747913 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862f35a-df20-4130-b09e-5725dfa435cd None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:42.884968 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cb27b-1566-428d-b177-b4f996f9ea5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:42.884968 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cb27b-1566-428d-b177-b4f996f9ea5e admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:42.884968 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cb27b-1566-428d-b177-b4f996f9ea5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:42.884968 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cb27b-1566-428d-b177-b4f996f9ea5e admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:42.891651 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65cb27b-1566-428d-b177-b4f996f9ea5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:42.893737 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65cb27b-1566-428d-b177-b4f996f9ea5e admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:43.025371 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624e749-1779-4cc3-a6f4-148cc021208a admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:43.036042 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1146/2289] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:03:42 2022] POST /identity/v3/users => generated 296 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:43.047435 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624e749-1779-4cc3-a6f4-148cc021208a admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:43.069651 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d3dc8-396a-4ec6-a963-623981ad68d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:43.070376 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d3dc8-396a-4ec6-a963-623981ad68d4 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:43.070695 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d3dc8-396a-4ec6-a963-623981ad68d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:43.070922 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d3dc8-396a-4ec6-a963-623981ad68d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:43.071666 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d3dc8-396a-4ec6-a963-623981ad68d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:43.073854 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141d3dc8-396a-4ec6-a963-623981ad68d4 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:43.109735 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cb27b-1566-428d-b177-b4f996f9ea5e admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:43.119524 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1144/2290] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:43.121805 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cb27b-1566-428d-b177-b4f996f9ea5e admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:43.137282 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32449910-3a77-4280-a5d2-d3f90e9a90ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:43.142028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32449910-3a77-4280-a5d2-d3f90e9a90ad admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:43.142320 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32449910-3a77-4280-a5d2-d3f90e9a90ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:43.142664 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32449910-3a77-4280-a5d2-d3f90e9a90ad admin admin] PATH_INFO: `/v3/projects/4a307e216a4345eb8d909fa2bcbed0cc/users/723a1922133c4fb1b5bf90604d0866e7/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:43.174087 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32449910-3a77-4280-a5d2-d3f90e9a90ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a307e216a4345eb8d909fa2bcbed0cc, user_id=723a1922133c4fb1b5bf90604d0866e7, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:43.183521 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32449910-3a77-4280-a5d2-d3f90e9a90ad admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:43.297435 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1147/2291] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:43 2022] PUT /identity/v3/projects/4a307e216a4345eb8d909fa2bcbed0cc/users/723a1922133c4fb1b5bf90604d0866e7/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:43.301249 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d3dc8-396a-4ec6-a963-623981ad68d4 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:43.314070 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d3dc8-396a-4ec6-a963-623981ad68d4 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:43.455606 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a62b3e-f28b-4310-b2d7-101f3905b97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:43.456358 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a62b3e-f28b-4310-b2d7-101f3905b97d admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:43.456358 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a62b3e-f28b-4310-b2d7-101f3905b97d admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:43.456688 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a62b3e-f28b-4310-b2d7-101f3905b97d admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:43.459008 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a62b3e-f28b-4310-b2d7-101f3905b97d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:43.461146 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a62b3e-f28b-4310-b2d7-101f3905b97d admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:43.487671 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1145/2292] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:43.491918 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32449910-3a77-4280-a5d2-d3f90e9a90ad admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:43.507915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32449910-3a77-4280-a5d2-d3f90e9a90ad admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:43.520530 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf8125-227b-445a-8258-3317acbd6308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:43.521931 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf8125-227b-445a-8258-3317acbd6308 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:43.522207 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf8125-227b-445a-8258-3317acbd6308 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:43.522479 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf8125-227b-445a-8258-3317acbd6308 admin admin] PATH_INFO: `/v3/projects/4a307e216a4345eb8d909fa2bcbed0cc/users/723a1922133c4fb1b5bf90604d0866e7/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:43.525611 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf8125-227b-445a-8258-3317acbd6308 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a307e216a4345eb8d909fa2bcbed0cc, user_id=723a1922133c4fb1b5bf90604d0866e7, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:43.533224 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf8125-227b-445a-8258-3317acbd6308 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:43.549247 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1148/2293] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:43 2022] PUT /identity/v3/projects/4a307e216a4345eb8d909fa2bcbed0cc/users/723a1922133c4fb1b5bf90604d0866e7/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:43.822747 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a62b3e-f28b-4310-b2d7-101f3905b97d admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:43.825638 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-e0a62b3e-f28b-4310-b2d7-101f3905b97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:43.851648 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a62b3e-f28b-4310-b2d7-101f3905b97d admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:43.977872 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040a671-bc8f-4467-b854-bcd36af4f14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:43.978658 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040a671-bc8f-4467-b854-bcd36af4f14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:43.979055 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040a671-bc8f-4467-b854-bcd36af4f14d admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:43.979474 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040a671-bc8f-4467-b854-bcd36af4f14d admin admin] PATH_INFO: `/v3/projects/aaaf50dffadf49a0aaa668e1b2072665` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:43.984560 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040a671-bc8f-4467-b854-bcd36af4f14d admin admin] RBAC: Authorizing `identity:delete_project(project_id=aaaf50dffadf49a0aaa668e1b2072665)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:43.986381 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040a671-bc8f-4467-b854-bcd36af4f14d admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:44.170989 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-c040a671-bc8f-4467-b854-bcd36af4f14d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aaaf50dffadf49a0aaa668e1b2072665', 'request_id': 'req-c040a671-bc8f-4467-b854-bcd36af4f14d'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:44.256783 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-c040a671-bc8f-4467-b854-bcd36af4f14d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aaaf50dffadf49a0aaa668e1b2072665', 'request_id': 'req-c040a671-bc8f-4467-b854-bcd36af4f14d'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:44.276717 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-c040a671-bc8f-4467-b854-bcd36af4f14d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aaaf50dffadf49a0aaa668e1b2072665', 'request_id': 'req-c040a671-bc8f-4467-b854-bcd36af4f14d'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:44.333871 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-c040a671-bc8f-4467-b854-bcd36af4f14d admin admin] The token cache is being invalidate because project aaaf50dffadf49a0aaa668e1b2072665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:44.355026 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-c040a671-bc8f-4467-b854-bcd36af4f14d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:44.355026 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-c040a671-bc8f-4467-b854-bcd36af4f14d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:44.360771 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1146/2294] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:43 2022] DELETE /identity/v3/projects/aaaf50dffadf49a0aaa668e1b2072665 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:44.364910 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf8125-227b-445a-8258-3317acbd6308 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:44.367715 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-b0bf8125-227b-445a-8258-3317acbd6308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:44.428730 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf8125-227b-445a-8258-3317acbd6308 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:44.552129 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd88762-b6df-49f2-b7d3-7709b5b6b954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:44.553323 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd88762-b6df-49f2-b7d3-7709b5b6b954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:44.553619 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd88762-b6df-49f2-b7d3-7709b5b6b954 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:44.555794 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd88762-b6df-49f2-b7d3-7709b5b6b954 admin admin] PATH_INFO: `/v3/users/3910275a37f54a0c90c3c15186b5cf4d` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:44.557422 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd88762-b6df-49f2-b7d3-7709b5b6b954 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3910275a37f54a0c90c3c15186b5cf4d)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:44.559477 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd88762-b6df-49f2-b7d3-7709b5b6b954 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:44.808945 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-3dd88762-b6df-49f2-b7d3-7709b5b6b954 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3910275a37f54a0c90c3c15186b5cf4d'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:44.828523 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-3dd88762-b6df-49f2-b7d3-7709b5b6b954 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3910275a37f54a0c90c3c15186b5cf4d'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:44.920436 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-3dd88762-b6df-49f2-b7d3-7709b5b6b954 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3910275a37f54a0c90c3c15186b5cf4d'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:44.921278 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-3dd88762-b6df-49f2-b7d3-7709b5b6b954 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3910275a37f54a0c90c3c15186b5cf4d'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:44.969372 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-3dd88762-b6df-49f2-b7d3-7709b5b6b954 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3910275a37f54a0c90c3c15186b5cf4d'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:44.989515 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1149/2295] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:03:44 2022] DELETE /identity/v3/users/3910275a37f54a0c90c3c15186b5cf4d => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:46.408890 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae53990-ef43-4675-83bf-14da882cd858 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:46.409889 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae53990-ef43-4675-83bf-14da882cd858 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:46.410337 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae53990-ef43-4675-83bf-14da882cd858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:46.449919 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-5ae53990-ef43-4675-83bf-14da882cd858 None None] MFA Rules not processed for user `5c7b25e0e29143d783553859a0583d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:46.451198 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-5ae53990-ef43-4675-83bf-14da882cd858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:46.590701 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1147/2296] 10.222.0.24 () {58 vars in 1009 bytes} [Tue Apr 12 00:03:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:46.626872 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd88762-b6df-49f2-b7d3-7709b5b6b954 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:46.626872 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-3dd88762-b6df-49f2-b7d3-7709b5b6b954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:46.783741 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae53990-ef43-4675-83bf-14da882cd858 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:46.783906 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd88762-b6df-49f2-b7d3-7709b5b6b954 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:46.785286 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-5ae53990-ef43-4675-83bf-14da882cd858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:46.798747 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f7be9-89b9-4213-8bd1-7bf07817cee9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d616b38304d91bf1c7aded81205e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:46.804771 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f7be9-89b9-4213-8bd1-7bf07817cee9 service swift] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:46.804771 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f7be9-89b9-4213-8bd1-7bf07817cee9 service swift] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:46.804771 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7f7be9-89b9-4213-8bd1-7bf07817cee9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:46.829121 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f7be9-89b9-4213-8bd1-7bf07817cee9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:46.833142 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7f7be9-89b9-4213-8bd1-7bf07817cee9 service swift] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:46.847533 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1150/2297] 10.222.0.24 () {60 vars in 1384 bytes} [Tue Apr 12 00:03:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:03:47.086728 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae53990-ef43-4675-83bf-14da882cd858 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:47.108543 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799ebee-ac30-4f03-805e-254179588982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:47.110299 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799ebee-ac30-4f03-805e-254179588982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:47.115011 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799ebee-ac30-4f03-805e-254179588982 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:47.115534 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799ebee-ac30-4f03-805e-254179588982 admin admin] PATH_INFO: `/v3/projects/9fb4e90e3d5a4d838082bdf596ae71d3` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:47.120963 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799ebee-ac30-4f03-805e-254179588982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fb4e90e3d5a4d838082bdf596ae71d3)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:47.123028 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799ebee-ac30-4f03-805e-254179588982 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:47.405905 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4799ebee-ac30-4f03-805e-254179588982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fb4e90e3d5a4d838082bdf596ae71d3', 'request_id': 'req-4799ebee-ac30-4f03-805e-254179588982'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:47.496339 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4799ebee-ac30-4f03-805e-254179588982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fb4e90e3d5a4d838082bdf596ae71d3', 'request_id': 'req-4799ebee-ac30-4f03-805e-254179588982'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:47.504791 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4799ebee-ac30-4f03-805e-254179588982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fb4e90e3d5a4d838082bdf596ae71d3', 'request_id': 'req-4799ebee-ac30-4f03-805e-254179588982'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:47.530381 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4799ebee-ac30-4f03-805e-254179588982 admin admin] The token cache is being invalidate because project 9fb4e90e3d5a4d838082bdf596ae71d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:47.535961 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4799ebee-ac30-4f03-805e-254179588982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:47.535961 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4799ebee-ac30-4f03-805e-254179588982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:47.537079 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1148/2298] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:46 2022] DELETE /identity/v3/projects/9fb4e90e3d5a4d838082bdf596ae71d3 => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:47.539473 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f7be9-89b9-4213-8bd1-7bf07817cee9 service swift] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:47.553827 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7f7be9-89b9-4213-8bd1-7bf07817cee9 service swift] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:47.728752 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e427aa2d-2f95-4172-954c-1d67fce5ccfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:47.729664 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427aa2d-2f95-4172-954c-1d67fce5ccfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:47.732596 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427aa2d-2f95-4172-954c-1d67fce5ccfd admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:47.732925 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e427aa2d-2f95-4172-954c-1d67fce5ccfd admin admin] PATH_INFO: `/v3/users/d0603dfd199e427db62420ae9d8c8ba2` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:47.735144 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427aa2d-2f95-4172-954c-1d67fce5ccfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0603dfd199e427db62420ae9d8c8ba2)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:47.739497 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e427aa2d-2f95-4172-954c-1d67fce5ccfd admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:48.029508 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-e427aa2d-2f95-4172-954c-1d67fce5ccfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0603dfd199e427db62420ae9d8c8ba2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:48.047480 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-e427aa2d-2f95-4172-954c-1d67fce5ccfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0603dfd199e427db62420ae9d8c8ba2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:48.130392 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-e427aa2d-2f95-4172-954c-1d67fce5ccfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0603dfd199e427db62420ae9d8c8ba2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:48.133391 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-e427aa2d-2f95-4172-954c-1d67fce5ccfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0603dfd199e427db62420ae9d8c8ba2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:48.176095 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-e427aa2d-2f95-4172-954c-1d67fce5ccfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0603dfd199e427db62420ae9d8c8ba2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:48.196378 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1151/2299] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:03:47 2022] DELETE /identity/v3/users/d0603dfd199e427db62420ae9d8c8ba2 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:49.987909 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799ebee-ac30-4f03-805e-254179588982 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:49.992704 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-4799ebee-ac30-4f03-805e-254179588982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:50.033632 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799ebee-ac30-4f03-805e-254179588982 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:50.216141 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3dd704-b30c-4c31-8483-89d16a8353d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:50.222148 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dd704-b30c-4c31-8483-89d16a8353d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:50.226431 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dd704-b30c-4c31-8483-89d16a8353d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:50.227270 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3dd704-b30c-4c31-8483-89d16a8353d4 admin admin] PATH_INFO: `/v3/projects/1127ca58d342411dbe7812bae76ccc5e` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:50.234056 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dd704-b30c-4c31-8483-89d16a8353d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1127ca58d342411dbe7812bae76ccc5e)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:50.242575 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3dd704-b30c-4c31-8483-89d16a8353d4 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:50.454171 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4b3dd704-b30c-4c31-8483-89d16a8353d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1127ca58d342411dbe7812bae76ccc5e', 'request_id': 'req-4b3dd704-b30c-4c31-8483-89d16a8353d4'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:50.525988 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4b3dd704-b30c-4c31-8483-89d16a8353d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1127ca58d342411dbe7812bae76ccc5e', 'request_id': 'req-4b3dd704-b30c-4c31-8483-89d16a8353d4'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:50.548496 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4b3dd704-b30c-4c31-8483-89d16a8353d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1127ca58d342411dbe7812bae76ccc5e', 'request_id': 'req-4b3dd704-b30c-4c31-8483-89d16a8353d4'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:50.584162 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4b3dd704-b30c-4c31-8483-89d16a8353d4 admin admin] The token cache is being invalidate because project 1127ca58d342411dbe7812bae76ccc5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:03:50.584717 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4b3dd704-b30c-4c31-8483-89d16a8353d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:50.585531 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4b3dd704-b30c-4c31-8483-89d16a8353d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:03:50.590708 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1149/2300] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:03:49 2022] DELETE /identity/v3/projects/1127ca58d342411dbe7812bae76ccc5e => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:03:50.597945 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440b08c-2fe3-4452-b773-dc9b7465205c None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:50.598462 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440b08c-2fe3-4452-b773-dc9b7465205c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:50.598702 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440b08c-2fe3-4452-b773-dc9b7465205c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:50.725758 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-5440b08c-2fe3-4452-b773-dc9b7465205c None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:50.725758 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-5440b08c-2fe3-4452-b773-dc9b7465205c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:50.897594 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1152/2301] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:50.900212 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94a443-aefc-4fea-bf9a-ffd7d8148a13 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:50.900212 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94a443-aefc-4fea-bf9a-ffd7d8148a13 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:50.900212 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94a443-aefc-4fea-bf9a-ffd7d8148a13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:50.933409 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-9c94a443-aefc-4fea-bf9a-ffd7d8148a13 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:50.934628 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-9c94a443-aefc-4fea-bf9a-ffd7d8148a13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:50.959947 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1150/2302] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:50.964231 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440b08c-2fe3-4452-b773-dc9b7465205c None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:50.979193 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440b08c-2fe3-4452-b773-dc9b7465205c None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:51.013685 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372f37e-aedd-4156-aaca-65be0af0ea15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:51.022070 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372f37e-aedd-4156-aaca-65be0af0ea15 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:51.022070 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372f37e-aedd-4156-aaca-65be0af0ea15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:51.022070 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e372f37e-aedd-4156-aaca-65be0af0ea15 admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:51.022070 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372f37e-aedd-4156-aaca-65be0af0ea15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:03:51.022070 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372f37e-aedd-4156-aaca-65be0af0ea15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:51.022070 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e372f37e-aedd-4156-aaca-65be0af0ea15 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:51.079070 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94a443-aefc-4fea-bf9a-ffd7d8148a13 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:51.085755 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1153/2303] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:03:51.090935 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94a443-aefc-4fea-bf9a-ffd7d8148a13 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:51.096617 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c16bd-148b-42ca-885a-83e3d17df01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:51.097616 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c16bd-148b-42ca-885a-83e3d17df01d admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:51.098375 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c16bd-148b-42ca-885a-83e3d17df01d admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:51.098875 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c16bd-148b-42ca-885a-83e3d17df01d admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:51.099803 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c16bd-148b-42ca-885a-83e3d17df01d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:51.103391 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c16bd-148b-42ca-885a-83e3d17df01d admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:51.221812 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1151/2304] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:03:51 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:51.225971 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372f37e-aedd-4156-aaca-65be0af0ea15 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:51.237948 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e372f37e-aedd-4156-aaca-65be0af0ea15 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:51.398607 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226bbd6-9470-49c3-9854-9d2bff9367a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:51.399652 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226bbd6-9470-49c3-9854-9d2bff9367a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:51.401201 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226bbd6-9470-49c3-9854-9d2bff9367a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:51.402074 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226bbd6-9470-49c3-9854-9d2bff9367a3 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:51.406858 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226bbd6-9470-49c3-9854-9d2bff9367a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:51.408994 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226bbd6-9470-49c3-9854-9d2bff9367a3 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:51.523300 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1154/2305] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:03:51 2022] POST /identity/v3/users => generated 288 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:03:51.528581 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c16bd-148b-42ca-885a-83e3d17df01d admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:51.556994 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c16bd-148b-42ca-885a-83e3d17df01d admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:51.581943 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628397c-cf4b-4fb2-b790-b30a9d08b615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:51.583150 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628397c-cf4b-4fb2-b790-b30a9d08b615 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:51.587281 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628397c-cf4b-4fb2-b790-b30a9d08b615 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:51.587778 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628397c-cf4b-4fb2-b790-b30a9d08b615 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:51.588814 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628397c-cf4b-4fb2-b790-b30a9d08b615 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:51.590801 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628397c-cf4b-4fb2-b790-b30a9d08b615 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:51.616085 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1152/2306] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:51.619245 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226bbd6-9470-49c3-9854-9d2bff9367a3 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:51.642011 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226bbd6-9470-49c3-9854-9d2bff9367a3 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:51.650928 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcdb17-2d73-402b-b5b0-de0fdc47ea35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:51.652120 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcdb17-2d73-402b-b5b0-de0fdc47ea35 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:51.653885 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcdb17-2d73-402b-b5b0-de0fdc47ea35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:51.657697 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcdb17-2d73-402b-b5b0-de0fdc47ea35 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:51.660445 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcdb17-2d73-402b-b5b0-de0fdc47ea35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:51.669297 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcdb17-2d73-402b-b5b0-de0fdc47ea35 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:51.691330 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1155/2307] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:03:51.695231 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628397c-cf4b-4fb2-b790-b30a9d08b615 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:51.718411 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628397c-cf4b-4fb2-b790-b30a9d08b615 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:51.741631 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64f5a8-5526-4c38-8186-6a38dd517f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:51.743139 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64f5a8-5526-4c38-8186-6a38dd517f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:51.743753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64f5a8-5526-4c38-8186-6a38dd517f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:51.744175 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce64f5a8-5526-4c38-8186-6a38dd517f43 admin admin] PATH_INFO: `/v3/projects/0e0ea7baf2614bd8a4dd2253caed3bf8/users/495533f7b4104094a718b75dd944d27b/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:51.850003 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64f5a8-5526-4c38-8186-6a38dd517f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0ea7baf2614bd8a4dd2253caed3bf8, user_id=495533f7b4104094a718b75dd944d27b, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:51.857676 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce64f5a8-5526-4c38-8186-6a38dd517f43 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:52.010008 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1153/2308] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:03:51 2022] PUT /identity/v3/projects/0e0ea7baf2614bd8a4dd2253caed3bf8/users/495533f7b4104094a718b75dd944d27b/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:03:52.031690 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599cc6b-9732-4cec-823d-8b20d9be163c None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:52.031925 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599cc6b-9732-4cec-823d-8b20d9be163c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:52.032152 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599cc6b-9732-4cec-823d-8b20d9be163c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:52.115779 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-1599cc6b-9732-4cec-823d-8b20d9be163c None None] MFA Rules not processed for user `495533f7b4104094a718b75dd944d27b`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:03:52.121516 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1599cc6b-9732-4cec-823d-8b20d9be163c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:52.312553 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64f5a8-5526-4c38-8186-6a38dd517f43 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:03:52.313157 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1156/2309] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:03:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:03:52.323390 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ce64f5a8-5526-4c38-8186-6a38dd517f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:03:52.480602 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce64f5a8-5526-4c38-8186-6a38dd517f43 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:03:52.485517 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf53e2-2af9-433f-bfe3-b6662e55d5fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:03:52.486334 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf53e2-2af9-433f-bfe3-b6662e55d5fe service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:03:52.486614 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf53e2-2af9-433f-bfe3-b6662e55d5fe service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:03:52.486922 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf53e2-2af9-433f-bfe3-b6662e55d5fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:03:52.506243 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf53e2-2af9-433f-bfe3-b6662e55d5fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:03:52.508174 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf53e2-2af9-433f-bfe3-b6662e55d5fe service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:03:52.526997 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1154/2310] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:03:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:04:00.024783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1521b-f3df-410e-969b-3118498479cd None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:00.025320 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1521b-f3df-410e-969b-3118498479cd None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:00.025320 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1521b-f3df-410e-969b-3118498479cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:00.059450 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-e4d1521b-f3df-410e-969b-3118498479cd None None] MFA Rules not processed for user `723a1922133c4fb1b5bf90604d0866e7`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:00.061173 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-e4d1521b-f3df-410e-969b-3118498479cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:00.237627 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1157/2311] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:04:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:04:00.248746 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf53e2-2af9-433f-bfe3-b6662e55d5fe service cinder] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:00.250944 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-dabf53e2-2af9-433f-bfe3-b6662e55d5fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:00.461027 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf53e2-2af9-433f-bfe3-b6662e55d5fe service cinder] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:00.475152 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf1c40-9663-4c1e-b012-a5a206847301 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:00.475656 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf1c40-9663-4c1e-b012-a5a206847301 service nova] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:00.475935 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf1c40-9663-4c1e-b012-a5a206847301 service nova] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:00.476206 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf1c40-9663-4c1e-b012-a5a206847301 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:00.485987 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d5bf1c40-9663-4c1e-b012-a5a206847301 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:00.680130 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf1c40-9663-4c1e-b012-a5a206847301 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:00.681729 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf1c40-9663-4c1e-b012-a5a206847301 service nova] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:00.708784 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1155/2312] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:04:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:04:10.413888 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc3bb9-2b1e-466b-a145-b3c09236e5b5 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:10.414402 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc3bb9-2b1e-466b-a145-b3c09236e5b5 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:10.414494 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc3bb9-2b1e-466b-a145-b3c09236e5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:10.443242 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-21dc3bb9-2b1e-466b-a145-b3c09236e5b5 None None] MFA Rules not processed for user `5c7b25e0e29143d783553859a0583d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:10.444561 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-21dc3bb9-2b1e-466b-a145-b3c09236e5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:10.507258 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1158/2313] 10.222.0.24 () {58 vars in 967 bytes} [Tue Apr 12 00:04:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:04:10.521382 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf1c40-9663-4c1e-b012-a5a206847301 service nova] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:10.522802 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d5bf1c40-9663-4c1e-b012-a5a206847301 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:10.592564 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf1c40-9663-4c1e-b012-a5a206847301 service nova] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:10.597508 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f983af-b64f-4e60-b0f2-8c6a13eb618b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d616b38304d91bf1c7aded81205e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:10.598138 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f983af-b64f-4e60-b0f2-8c6a13eb618b service swift] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:10.598414 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f983af-b64f-4e60-b0f2-8c6a13eb618b service swift] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:10.598683 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f983af-b64f-4e60-b0f2-8c6a13eb618b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:10.608105 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f983af-b64f-4e60-b0f2-8c6a13eb618b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:10.609173 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f983af-b64f-4e60-b0f2-8c6a13eb618b service swift] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:10.617975 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1156/2314] 10.222.0.24 () {60 vars in 1384 bytes} [Tue Apr 12 00:04:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:04:12.582947 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46246a0b-f9d0-4167-b86a-e8f6856d88d5 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:12.584112 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46246a0b-f9d0-4167-b86a-e8f6856d88d5 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:12.584390 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46246a0b-f9d0-4167-b86a-e8f6856d88d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:12.604160 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-46246a0b-f9d0-4167-b86a-e8f6856d88d5 None None] MFA Rules not processed for user `5c7b25e0e29143d783553859a0583d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:12.605379 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-46246a0b-f9d0-4167-b86a-e8f6856d88d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:12.615507 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1159/2315] 10.222.0.24 () {58 vars in 1009 bytes} [Tue Apr 12 00:04:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:04:12.628015 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f983af-b64f-4e60-b0f2-8c6a13eb618b service swift] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:12.638337 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f983af-b64f-4e60-b0f2-8c6a13eb618b service swift] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:12.644924 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f6937-9aa4-4aae-95cd-2e17fe41567c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d616b38304d91bf1c7aded81205e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:12.645610 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f6937-9aa4-4aae-95cd-2e17fe41567c service swift] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:12.645890 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f6937-9aa4-4aae-95cd-2e17fe41567c service swift] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:12.646165 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f6937-9aa4-4aae-95cd-2e17fe41567c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:12.655088 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f6937-9aa4-4aae-95cd-2e17fe41567c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:12.656815 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f6937-9aa4-4aae-95cd-2e17fe41567c service swift] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:12.665217 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1157/2316] 10.222.0.24 () {60 vars in 1384 bytes} [Tue Apr 12 00:04:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:04:13.576026 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d22cf-face-4f53-8f5a-7c2a8c87fca0 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:13.576026 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d22cf-face-4f53-8f5a-7c2a8c87fca0 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:13.576026 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d22cf-face-4f53-8f5a-7c2a8c87fca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:13.586018 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-175d22cf-face-4f53-8f5a-7c2a8c87fca0 None None] MFA Rules not processed for user `5c7b25e0e29143d783553859a0583d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:13.587242 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-175d22cf-face-4f53-8f5a-7c2a8c87fca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:13.594496 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1160/2317] 10.222.0.24 () {58 vars in 967 bytes} [Tue Apr 12 00:04:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:04:13.608709 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f6937-9aa4-4aae-95cd-2e17fe41567c service swift] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:13.619301 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f6937-9aa4-4aae-95cd-2e17fe41567c service swift] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:13.624993 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d672031-d895-4575-ac2f-54d4099bd9c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d616b38304d91bf1c7aded81205e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:13.625624 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d672031-d895-4575-ac2f-54d4099bd9c6 service swift] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:13.625922 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d672031-d895-4575-ac2f-54d4099bd9c6 service swift] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:13.626188 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d672031-d895-4575-ac2f-54d4099bd9c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:13.634607 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d672031-d895-4575-ac2f-54d4099bd9c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:13.636244 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d672031-d895-4575-ac2f-54d4099bd9c6 service swift] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:13.644420 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1158/2318] 10.222.0.24 () {60 vars in 1384 bytes} [Tue Apr 12 00:04:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:04:14.790069 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c827c26-0e70-4f07-ae1f-9e8e4805134f None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:14.790603 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c827c26-0e70-4f07-ae1f-9e8e4805134f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:14.790603 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c827c26-0e70-4f07-ae1f-9e8e4805134f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:14.813220 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-0c827c26-0e70-4f07-ae1f-9e8e4805134f None None] MFA Rules not processed for user `5c7b25e0e29143d783553859a0583d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:14.814248 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-0c827c26-0e70-4f07-ae1f-9e8e4805134f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:14.822929 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1161/2319] 10.222.0.24 () {58 vars in 1009 bytes} [Tue Apr 12 00:04:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:04:14.838163 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d672031-d895-4575-ac2f-54d4099bd9c6 service swift] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:14.857004 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d672031-d895-4575-ac2f-54d4099bd9c6 service swift] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:14.866822 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0cb93-ea17-4d23-8197-8e85d1a85f59 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d616b38304d91bf1c7aded81205e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:14.869944 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0cb93-ea17-4d23-8197-8e85d1a85f59 service swift] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:14.870177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0cb93-ea17-4d23-8197-8e85d1a85f59 service swift] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:14.870468 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0cb93-ea17-4d23-8197-8e85d1a85f59 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:14.891990 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0cb93-ea17-4d23-8197-8e85d1a85f59 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:14.891990 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c0cb93-ea17-4d23-8197-8e85d1a85f59 service swift] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:14.896082 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1159/2320] 10.222.0.24 () {60 vars in 1384 bytes} [Tue Apr 12 00:04:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:04:14.917237 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c827c26-0e70-4f07-ae1f-9e8e4805134f None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:14.919675 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-0c827c26-0e70-4f07-ae1f-9e8e4805134f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:15.004851 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c827c26-0e70-4f07-ae1f-9e8e4805134f None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:15.010213 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e03c5-8bac-487e-9f7a-d18d87553750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:15.010346 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e03c5-8bac-487e-9f7a-d18d87553750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:15.010598 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e03c5-8bac-487e-9f7a-d18d87553750 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:15.010928 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e03c5-8bac-487e-9f7a-d18d87553750 admin admin] PATH_INFO: `/v3/users/8c69ae8ba4a344fa8158584fce641c8a` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:15.012136 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e03c5-8bac-487e-9f7a-d18d87553750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c69ae8ba4a344fa8158584fce641c8a)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:15.014702 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e03c5-8bac-487e-9f7a-d18d87553750 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:15.208054 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-559e03c5-8bac-487e-9f7a-d18d87553750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c69ae8ba4a344fa8158584fce641c8a'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:15.214687 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-559e03c5-8bac-487e-9f7a-d18d87553750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c69ae8ba4a344fa8158584fce641c8a'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:15.318326 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-559e03c5-8bac-487e-9f7a-d18d87553750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c69ae8ba4a344fa8158584fce641c8a'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:15.319048 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-559e03c5-8bac-487e-9f7a-d18d87553750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c69ae8ba4a344fa8158584fce641c8a'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:15.331747 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-559e03c5-8bac-487e-9f7a-d18d87553750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c69ae8ba4a344fa8158584fce641c8a'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:15.337739 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1162/2321] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:04:14 2022] DELETE /identity/v3/users/8c69ae8ba4a344fa8158584fce641c8a => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:04:15.510154 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603482e7-564b-4e94-8855-b0986b8254b6 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:15.510447 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603482e7-564b-4e94-8855-b0986b8254b6 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:15.510732 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603482e7-564b-4e94-8855-b0986b8254b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:15.537815 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-603482e7-564b-4e94-8855-b0986b8254b6 None None] MFA Rules not processed for user `5c7b25e0e29143d783553859a0583d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:15.539093 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-603482e7-564b-4e94-8855-b0986b8254b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:15.593516 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1160/2322] 10.222.0.24 () {58 vars in 967 bytes} [Tue Apr 12 00:04:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:04:15.607464 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e03c5-8bac-487e-9f7a-d18d87553750 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:15.609081 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-559e03c5-8bac-487e-9f7a-d18d87553750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:15.642813 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603482e7-564b-4e94-8855-b0986b8254b6 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:15.643970 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-603482e7-564b-4e94-8855-b0986b8254b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:15.709949 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e03c5-8bac-487e-9f7a-d18d87553750 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:15.716050 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa92cc-186e-40c8-a830-a45b12012e46 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d616b38304d91bf1c7aded81205e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:15.716725 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa92cc-186e-40c8-a830-a45b12012e46 service swift] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:15.716996 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa92cc-186e-40c8-a830-a45b12012e46 service swift] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:15.717853 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa92cc-186e-40c8-a830-a45b12012e46 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:15.723100 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603482e7-564b-4e94-8855-b0986b8254b6 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:15.727530 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa92cc-186e-40c8-a830-a45b12012e46 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:15.728809 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa92cc-186e-40c8-a830-a45b12012e46 service swift] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:15.730227 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de59bc-91fd-4aae-a7f2-e13b2986ff7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:15.731133 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de59bc-91fd-4aae-a7f2-e13b2986ff7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:15.734502 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de59bc-91fd-4aae-a7f2-e13b2986ff7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:15.734502 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de59bc-91fd-4aae-a7f2-e13b2986ff7a admin admin] PATH_INFO: `/v3/projects/479c3968044743398ae8418e2b0d5483` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:15.734502 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de59bc-91fd-4aae-a7f2-e13b2986ff7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=479c3968044743398ae8418e2b0d5483)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:15.735059 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de59bc-91fd-4aae-a7f2-e13b2986ff7a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:15.739090 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1163/2323] 10.222.0.24 () {60 vars in 1384 bytes} [Tue Apr 12 00:04:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:04:15.892465 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-20de59bc-91fd-4aae-a7f2-e13b2986ff7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '479c3968044743398ae8418e2b0d5483', 'request_id': 'req-20de59bc-91fd-4aae-a7f2-e13b2986ff7a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:15.981248 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-20de59bc-91fd-4aae-a7f2-e13b2986ff7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '479c3968044743398ae8418e2b0d5483', 'request_id': 'req-20de59bc-91fd-4aae-a7f2-e13b2986ff7a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:15.992524 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-20de59bc-91fd-4aae-a7f2-e13b2986ff7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '479c3968044743398ae8418e2b0d5483', 'request_id': 'req-20de59bc-91fd-4aae-a7f2-e13b2986ff7a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:16.004940 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-20de59bc-91fd-4aae-a7f2-e13b2986ff7a admin admin] The token cache is being invalidate because project 479c3968044743398ae8418e2b0d5483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:04:16.005232 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-20de59bc-91fd-4aae-a7f2-e13b2986ff7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:16.005906 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-20de59bc-91fd-4aae-a7f2-e13b2986ff7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:16.007614 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1161/2324] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:04:15 2022] DELETE /identity/v3/projects/479c3968044743398ae8418e2b0d5483 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:04:16.014302 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730bec3-bc1e-401e-b9c0-62acecb3f9d0 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:16.014764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730bec3-bc1e-401e-b9c0-62acecb3f9d0 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:16.015944 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730bec3-bc1e-401e-b9c0-62acecb3f9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:16.032716 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-e730bec3-bc1e-401e-b9c0-62acecb3f9d0 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:16.033920 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-e730bec3-bc1e-401e-b9c0-62acecb3f9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:16.103008 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1164/2325] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:04:16.111449 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6394556-c3f6-483a-aa38-f46ab30cb280 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:16.112104 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6394556-c3f6-483a-aa38-f46ab30cb280 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:16.112533 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6394556-c3f6-483a-aa38-f46ab30cb280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:16.132397 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-b6394556-c3f6-483a-aa38-f46ab30cb280 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:16.133601 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-b6394556-c3f6-483a-aa38-f46ab30cb280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:16.141846 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1162/2326] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:04:16.146170 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730bec3-bc1e-401e-b9c0-62acecb3f9d0 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:16.156836 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730bec3-bc1e-401e-b9c0-62acecb3f9d0 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:16.162817 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ffee6-749a-4ffe-925d-bc7ca42dd4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:16.163895 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ffee6-749a-4ffe-925d-bc7ca42dd4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:16.164148 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ffee6-749a-4ffe-925d-bc7ca42dd4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:16.164617 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ffee6-749a-4ffe-925d-bc7ca42dd4e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:16.165416 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ffee6-749a-4ffe-925d-bc7ca42dd4e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:04:16.165778 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ffee6-749a-4ffe-925d-bc7ca42dd4e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:16.168237 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ffee6-749a-4ffe-925d-bc7ca42dd4e7 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:16.193496 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1165/2327] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:04:16.199127 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6394556-c3f6-483a-aa38-f46ab30cb280 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:16.215806 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6394556-c3f6-483a-aa38-f46ab30cb280 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:16.221009 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29c315-56d2-4019-be16-734bdea44d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:16.221009 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29c315-56d2-4019-be16-734bdea44d19 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:16.221255 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29c315-56d2-4019-be16-734bdea44d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:16.221435 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29c315-56d2-4019-be16-734bdea44d19 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:16.222587 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29c315-56d2-4019-be16-734bdea44d19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:16.224673 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29c315-56d2-4019-be16-734bdea44d19 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:16.340496 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1163/2328] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:04:16 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:04:16.344834 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ffee6-749a-4ffe-925d-bc7ca42dd4e7 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:16.354877 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ffee6-749a-4ffe-925d-bc7ca42dd4e7 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:16.427761 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4379a4-d109-4f4c-b798-63784cba993a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:16.427761 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4379a4-d109-4f4c-b798-63784cba993a admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:16.427761 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4379a4-d109-4f4c-b798-63784cba993a admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:16.428108 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4379a4-d109-4f4c-b798-63784cba993a admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:16.428895 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4379a4-d109-4f4c-b798-63784cba993a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:16.430889 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4379a4-d109-4f4c-b798-63784cba993a admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:16.487495 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fc389-7acd-4d4c-8b2b-a221315decfe None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:16.487814 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fc389-7acd-4d4c-8b2b-a221315decfe None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:16.488066 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095fc389-7acd-4d4c-8b2b-a221315decfe None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:16.490287 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1164/2329] 10.222.0.24 () {54 vars in 921 bytes} [Tue Apr 12 00:04:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Apr 12 00:04:16.496938 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5368c-6cbc-4e80-8095-00fe5beebcb6 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:16.497295 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5368c-6cbc-4e80-8095-00fe5beebcb6 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:16.497577 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5368c-6cbc-4e80-8095-00fe5beebcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:16.549541 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1166/2330] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:04:16 2022] POST /identity/v3/users => generated 286 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:04:16.554905 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4379a4-d109-4f4c-b798-63784cba993a admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:16.568822 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4379a4-d109-4f4c-b798-63784cba993a admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:16.574427 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b39ac8-2a1f-4081-b6ba-27832b543472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:16.575126 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b39ac8-2a1f-4081-b6ba-27832b543472 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:16.575598 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-a6c5368c-6cbc-4e80-8095-00fe5beebcb6 None None] MFA Rules not processed for user `a9519f49f897415a894c1121278dda9c`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:16.575788 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b39ac8-2a1f-4081-b6ba-27832b543472 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:16.576291 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b39ac8-2a1f-4081-b6ba-27832b543472 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:16.576849 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-a6c5368c-6cbc-4e80-8095-00fe5beebcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:16.577207 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b39ac8-2a1f-4081-b6ba-27832b543472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:16.578915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b39ac8-2a1f-4081-b6ba-27832b543472 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:16.589705 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1167/2331] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:04:16.593833 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b39ac8-2a1f-4081-b6ba-27832b543472 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:16.613366 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b39ac8-2a1f-4081-b6ba-27832b543472 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:16.624749 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d035b4a-3ce8-4ee0-9afa-00bae030e773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:16.625474 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d035b4a-3ce8-4ee0-9afa-00bae030e773 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:16.625754 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d035b4a-3ce8-4ee0-9afa-00bae030e773 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:16.626021 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d035b4a-3ce8-4ee0-9afa-00bae030e773 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:16.626880 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d035b4a-3ce8-4ee0-9afa-00bae030e773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:16.628625 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d035b4a-3ce8-4ee0-9afa-00bae030e773 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:16.643508 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1168/2332] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:04:16.644518 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d035b4a-3ce8-4ee0-9afa-00bae030e773 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:16.658042 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1165/2333] 10.222.0.24 () {58 vars in 1018 bytes} [Tue Apr 12 00:04:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:04:16.659522 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d035b4a-3ce8-4ee0-9afa-00bae030e773 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:16.666528 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19eec4-79fa-40e5-ae46-d80d67d0e6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:16.667819 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19eec4-79fa-40e5-ae46-d80d67d0e6ed admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:16.672061 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19eec4-79fa-40e5-ae46-d80d67d0e6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:16.672061 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19eec4-79fa-40e5-ae46-d80d67d0e6ed admin admin] PATH_INFO: `/v3/projects/4a28cefad8414906a67157e0f9856e92/users/2fea89c5875c45bca29ca524bd327f3f/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:16.672293 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5368c-6cbc-4e80-8095-00fe5beebcb6 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:16.673637 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-a6c5368c-6cbc-4e80-8095-00fe5beebcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:16.687357 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19eec4-79fa-40e5-ae46-d80d67d0e6ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a28cefad8414906a67157e0f9856e92, user_id=2fea89c5875c45bca29ca524bd327f3f, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:16.690671 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19eec4-79fa-40e5-ae46-d80d67d0e6ed admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:16.743103 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5368c-6cbc-4e80-8095-00fe5beebcb6 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:16.747445 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5563a6-efbb-4e54-9a95-c5a1e650d0d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2ad9c7f930e426bb908237f72c04a2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:16.748354 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5563a6-efbb-4e54-9a95-c5a1e650d0d1 service glance] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:16.748698 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5563a6-efbb-4e54-9a95-c5a1e650d0d1 service glance] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:16.748978 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5563a6-efbb-4e54-9a95-c5a1e650d0d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:16.768116 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5563a6-efbb-4e54-9a95-c5a1e650d0d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:16.769880 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5563a6-efbb-4e54-9a95-c5a1e650d0d1 service glance] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:16.782340 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1166/2334] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:04:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:04:16.804187 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1169/2335] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:04:16 2022] PUT /identity/v3/projects/4a28cefad8414906a67157e0f9856e92/users/2fea89c5875c45bca29ca524bd327f3f/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:04:16.814604 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8573bc-b5b5-492e-99a4-01a5647841cf None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:16.814923 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8573bc-b5b5-492e-99a4-01a5647841cf None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:16.815234 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8573bc-b5b5-492e-99a4-01a5647841cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:16.846883 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-3e8573bc-b5b5-492e-99a4-01a5647841cf None None] MFA Rules not processed for user `2fea89c5875c45bca29ca524bd327f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:16.848107 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-3e8573bc-b5b5-492e-99a4-01a5647841cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:16.917441 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1167/2336] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:04:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:04:16.929095 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19eec4-79fa-40e5-ae46-d80d67d0e6ed admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:16.930435 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1f19eec4-79fa-40e5-ae46-d80d67d0e6ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:17.008567 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19eec4-79fa-40e5-ae46-d80d67d0e6ed admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:17.011670 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcbd9e-8729-4ee6-badb-52749c6295bc None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:17.011957 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcbd9e-8729-4ee6-badb-52749c6295bc None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:17.012527 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcbd9e-8729-4ee6-badb-52749c6295bc None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:17.012640 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dc1a1-07aa-4f2e-9812-b45a268c3f23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:17.013229 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dc1a1-07aa-4f2e-9812-b45a268c3f23 service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:17.013517 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dc1a1-07aa-4f2e-9812-b45a268c3f23 service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:17.013791 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320dc1a1-07aa-4f2e-9812-b45a268c3f23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:17.014934 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1168/2337] 10.222.0.24 () {54 vars in 921 bytes} [Tue Apr 12 00:04:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:04:17.020500 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c510770-71b9-4c1d-b91d-7ceccead12b6 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:17.020916 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c510770-71b9-4c1d-b91d-7ceccead12b6 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:17.021787 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c510770-71b9-4c1d-b91d-7ceccead12b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:17.024278 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320dc1a1-07aa-4f2e-9812-b45a268c3f23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:17.025691 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320dc1a1-07aa-4f2e-9812-b45a268c3f23 service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:17.037047 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1170/2338] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:04:16 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:04:17.051727 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-9c510770-71b9-4c1d-b91d-7ceccead12b6 None None] MFA Rules not processed for user `c6936272118b49a9baa19f3bd5066f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:17.052948 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-9c510770-71b9-4c1d-b91d-7ceccead12b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:17.067440 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dc1a1-07aa-4f2e-9812-b45a268c3f23 service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:17.124003 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1169/2339] 10.222.0.24 () {58 vars in 1018 bytes} [Tue Apr 12 00:04:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:04:17.145440 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c510770-71b9-4c1d-b91d-7ceccead12b6 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:17.146921 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-9c510770-71b9-4c1d-b91d-7ceccead12b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:17.161858 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c510770-71b9-4c1d-b91d-7ceccead12b6 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:17.165947 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320dc1a1-07aa-4f2e-9812-b45a268c3f23 service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:17.167930 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b3389-304a-43a9-b51f-012d6d6c57f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:17.168647 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b3389-304a-43a9-b51f-012d6d6c57f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:17.168880 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b3389-304a-43a9-b51f-012d6d6c57f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:17.169442 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b3389-304a-43a9-b51f-012d6d6c57f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:17.172477 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3e1db-4178-4459-bde6-00ba38800ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:17.173356 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3e1db-4178-4459-bde6-00ba38800ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:17.173635 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3e1db-4178-4459-bde6-00ba38800ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:17.173904 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb3e1db-4178-4459-bde6-00ba38800ef0 admin admin] PATH_INFO: `/v3/users/2fea89c5875c45bca29ca524bd327f3f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:17.180062 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3e1db-4178-4459-bde6-00ba38800ef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fea89c5875c45bca29ca524bd327f3f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:17.180062 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb3e1db-4178-4459-bde6-00ba38800ef0 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:17.180289 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b3389-304a-43a9-b51f-012d6d6c57f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:17.180289 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b3389-304a-43a9-b51f-012d6d6c57f8 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:17.192115 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1170/2340] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:04:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:04:17.300262 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e20e8-2915-4e19-80c6-a49a6ae4b183 None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:17.300558 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e20e8-2915-4e19-80c6-a49a6ae4b183 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:17.300832 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e20e8-2915-4e19-80c6-a49a6ae4b183 None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:17.302629 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1171/2341] 10.222.0.24 () {54 vars in 921 bytes} [Tue Apr 12 00:04:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:04:17.308292 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df9512-4eed-4ad4-9a3b-81bae254bfdc None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:17.308739 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df9512-4eed-4ad4-9a3b-81bae254bfdc None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:17.309186 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df9512-4eed-4ad4-9a3b-81bae254bfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:17.334419 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-d3df9512-4eed-4ad4-9a3b-81bae254bfdc None None] MFA Rules not processed for user `a9519f49f897415a894c1121278dda9c`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:17.336298 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d3df9512-4eed-4ad4-9a3b-81bae254bfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:17.387367 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6bb3e1db-4178-4459-bde6-00ba38800ef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fea89c5875c45bca29ca524bd327f3f'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:17.397756 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6bb3e1db-4178-4459-bde6-00ba38800ef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fea89c5875c45bca29ca524bd327f3f'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:17.414499 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1172/2342] 10.222.0.24 () {58 vars in 1018 bytes} [Tue Apr 12 00:04:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:04:17.425159 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df9512-4eed-4ad4-9a3b-81bae254bfdc None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:17.434531 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df9512-4eed-4ad4-9a3b-81bae254bfdc None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:17.438570 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b92e9-2b7d-4b32-8e93-77567f259bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:17.439843 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b92e9-2b7d-4b32-8e93-77567f259bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:17.440262 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b92e9-2b7d-4b32-8e93-77567f259bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:17.440677 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b92e9-2b7d-4b32-8e93-77567f259bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:17.454605 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b92e9-2b7d-4b32-8e93-77567f259bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:17.456121 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b92e9-2b7d-4b32-8e93-77567f259bb4 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:17.472139 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1173/2343] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:04:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:04:17.513137 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6bb3e1db-4178-4459-bde6-00ba38800ef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fea89c5875c45bca29ca524bd327f3f'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:17.513787 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6bb3e1db-4178-4459-bde6-00ba38800ef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fea89c5875c45bca29ca524bd327f3f'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:17.527784 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6bb3e1db-4178-4459-bde6-00ba38800ef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fea89c5875c45bca29ca524bd327f3f'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:17.533844 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1171/2344] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:04:17 2022] DELETE /identity/v3/users/2fea89c5875c45bca29ca524bd327f3f => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:04:17.538672 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbb540-263d-494b-b244-53d7afaaf1d0 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:17.539088 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbb540-263d-494b-b244-53d7afaaf1d0 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:17.539496 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbb540-263d-494b-b244-53d7afaaf1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:17.559228 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-d1cbb540-263d-494b-b244-53d7afaaf1d0 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:17.560521 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d1cbb540-263d-494b-b244-53d7afaaf1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:17.634542 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1174/2345] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:04:17.656718 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3e1db-4178-4459-bde6-00ba38800ef0 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:17.658107 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-6bb3e1db-4178-4459-bde6-00ba38800ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:17.724186 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb3e1db-4178-4459-bde6-00ba38800ef0 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:17.728498 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfe742-bb6d-4003-a69b-d2eeb8791ded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:17.729463 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfe742-bb6d-4003-a69b-d2eeb8791ded service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:17.729926 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfe742-bb6d-4003-a69b-d2eeb8791ded service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:17.730531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfe742-bb6d-4003-a69b-d2eeb8791ded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:17.744978 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfe742-bb6d-4003-a69b-d2eeb8791ded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:17.746383 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfe742-bb6d-4003-a69b-d2eeb8791ded service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:17.766175 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1172/2346] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:04:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:04:18.183538 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbb540-263d-494b-b244-53d7afaaf1d0 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:18.185617 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d1cbb540-263d-494b-b244-53d7afaaf1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:18.198403 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbb540-263d-494b-b244-53d7afaaf1d0 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:18.204869 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647570e9-8886-4140-9aea-52aed2eeadf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:18.205735 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647570e9-8886-4140-9aea-52aed2eeadf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:18.206016 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647570e9-8886-4140-9aea-52aed2eeadf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:18.206286 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647570e9-8886-4140-9aea-52aed2eeadf2 admin admin] PATH_INFO: `/v3/projects/4a28cefad8414906a67157e0f9856e92` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:18.207518 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647570e9-8886-4140-9aea-52aed2eeadf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a28cefad8414906a67157e0f9856e92)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:18.209419 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647570e9-8886-4140-9aea-52aed2eeadf2 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:18.319263 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-647570e9-8886-4140-9aea-52aed2eeadf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a28cefad8414906a67157e0f9856e92', 'request_id': 'req-647570e9-8886-4140-9aea-52aed2eeadf2'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:18.381082 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-647570e9-8886-4140-9aea-52aed2eeadf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a28cefad8414906a67157e0f9856e92', 'request_id': 'req-647570e9-8886-4140-9aea-52aed2eeadf2'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:18.387570 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-647570e9-8886-4140-9aea-52aed2eeadf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a28cefad8414906a67157e0f9856e92', 'request_id': 'req-647570e9-8886-4140-9aea-52aed2eeadf2'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:18.399877 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-647570e9-8886-4140-9aea-52aed2eeadf2 admin admin] The token cache is being invalidate because project 4a28cefad8414906a67157e0f9856e92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:04:18.400159 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-647570e9-8886-4140-9aea-52aed2eeadf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:18.400835 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-647570e9-8886-4140-9aea-52aed2eeadf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:18.402453 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1175/2347] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:04:18 2022] DELETE /identity/v3/projects/4a28cefad8414906a67157e0f9856e92 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:04:18.650783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfe742-bb6d-4003-a69b-d2eeb8791ded service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:18.655220 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-4cdfe742-bb6d-4003-a69b-d2eeb8791ded service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:18.666044 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfe742-bb6d-4003-a69b-d2eeb8791ded service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:18.726508 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49276bd-8dfb-4cdf-ad43-b17ed67c709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:18.727372 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49276bd-8dfb-4cdf-ad43-b17ed67c709a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:18.727649 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49276bd-8dfb-4cdf-ad43-b17ed67c709a admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:18.727917 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49276bd-8dfb-4cdf-ad43-b17ed67c709a admin admin] PATH_INFO: `/v3/users/ad07436fa4994907b5d29bcd044735c0` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:18.729399 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49276bd-8dfb-4cdf-ad43-b17ed67c709a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad07436fa4994907b5d29bcd044735c0)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:18.731576 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49276bd-8dfb-4cdf-ad43-b17ed67c709a admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:18.957914 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-e49276bd-8dfb-4cdf-ad43-b17ed67c709a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad07436fa4994907b5d29bcd044735c0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:18.967013 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-e49276bd-8dfb-4cdf-ad43-b17ed67c709a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad07436fa4994907b5d29bcd044735c0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:19.005933 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647570e9-8886-4140-9aea-52aed2eeadf2 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:19.012346 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-647570e9-8886-4140-9aea-52aed2eeadf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:19.033515 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647570e9-8886-4140-9aea-52aed2eeadf2 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:19.034452 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82146df8-5dcf-4f25-807a-9d9989baf6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:19.036261 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82146df8-5dcf-4f25-807a-9d9989baf6b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:19.044018 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82146df8-5dcf-4f25-807a-9d9989baf6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:19.044018 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82146df8-5dcf-4f25-807a-9d9989baf6b6 admin admin] PATH_INFO: `/v3/users/495533f7b4104094a718b75dd944d27b` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:19.044018 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82146df8-5dcf-4f25-807a-9d9989baf6b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=495533f7b4104094a718b75dd944d27b)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:19.044018 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82146df8-5dcf-4f25-807a-9d9989baf6b6 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:19.068603 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-e49276bd-8dfb-4cdf-ad43-b17ed67c709a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad07436fa4994907b5d29bcd044735c0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:19.069856 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-e49276bd-8dfb-4cdf-ad43-b17ed67c709a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad07436fa4994907b5d29bcd044735c0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:19.085823 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-e49276bd-8dfb-4cdf-ad43-b17ed67c709a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad07436fa4994907b5d29bcd044735c0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:19.093432 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1173/2348] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:04:18 2022] DELETE /identity/v3/users/ad07436fa4994907b5d29bcd044735c0 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:04:19.110014 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b3fe6-e649-4157-9857-2650860c0ce7 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:19.110014 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b3fe6-e649-4157-9857-2650860c0ce7 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:19.110014 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b3fe6-e649-4157-9857-2650860c0ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:19.130312 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-7a6b3fe6-e649-4157-9857-2650860c0ce7 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:19.131690 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-7a6b3fe6-e649-4157-9857-2650860c0ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:19.203263 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1174/2349] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:04:19.203827 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-82146df8-5dcf-4f25-807a-9d9989baf6b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '495533f7b4104094a718b75dd944d27b'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:19.216139 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b3fe6-e649-4157-9857-2650860c0ce7 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:19.217706 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-7a6b3fe6-e649-4157-9857-2650860c0ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:19.273133 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-82146df8-5dcf-4f25-807a-9d9989baf6b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '495533f7b4104094a718b75dd944d27b'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:19.274011 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-82146df8-5dcf-4f25-807a-9d9989baf6b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '495533f7b4104094a718b75dd944d27b'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:19.282935 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-82146df8-5dcf-4f25-807a-9d9989baf6b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '495533f7b4104094a718b75dd944d27b'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:19.288570 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6b3fe6-e649-4157-9857-2650860c0ce7 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:19.294016 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c81751-0443-487b-af32-124477771bd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:19.294677 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c81751-0443-487b-af32-124477771bd1 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:19.295083 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c81751-0443-487b-af32-124477771bd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:19.295390 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c81751-0443-487b-af32-124477771bd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:19.297480 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-35c81751-0443-487b-af32-124477771bd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:19.300417 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-82146df8-5dcf-4f25-807a-9d9989baf6b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '495533f7b4104094a718b75dd944d27b'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:19.307079 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1176/2350] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:04:19 2022] DELETE /identity/v3/users/495533f7b4104094a718b75dd944d27b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:04:19.312609 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7f0f6-fadb-4b83-8779-5c68c1bf544c None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:19.312749 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c81751-0443-487b-af32-124477771bd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:19.312908 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7f0f6-fadb-4b83-8779-5c68c1bf544c None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:19.313345 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf7f0f6-fadb-4b83-8779-5c68c1bf544c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:19.314289 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c81751-0443-487b-af32-124477771bd1 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:19.324097 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1175/2351] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:04:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:04:19.331005 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-daf7f0f6-fadb-4b83-8779-5c68c1bf544c None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:19.332223 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-daf7f0f6-fadb-4b83-8779-5c68c1bf544c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:19.393705 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1177/2352] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:04:19.407127 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c81751-0443-487b-af32-124477771bd1 service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:19.408842 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-35c81751-0443-487b-af32-124477771bd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:19.420075 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c81751-0443-487b-af32-124477771bd1 service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:19.479731 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f2bc1-e458-4f86-874d-85fd62d19604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:19.480379 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f2bc1-e458-4f86-874d-85fd62d19604 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:19.480661 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f2bc1-e458-4f86-874d-85fd62d19604 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:19.480933 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f2bc1-e458-4f86-874d-85fd62d19604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:19.493062 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f2bc1-e458-4f86-874d-85fd62d19604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:19.496581 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f2bc1-e458-4f86-874d-85fd62d19604 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:19.507610 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1176/2353] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:04:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:04:19.569923 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7f0f6-fadb-4b83-8779-5c68c1bf544c None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:19.571476 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-daf7f0f6-fadb-4b83-8779-5c68c1bf544c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:19.584317 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf7f0f6-fadb-4b83-8779-5c68c1bf544c None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:19.591936 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e537b4-df08-49c0-9524-8e2179c0c43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:19.592953 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e537b4-df08-49c0-9524-8e2179c0c43a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:19.593236 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e537b4-df08-49c0-9524-8e2179c0c43a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:19.594220 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e537b4-df08-49c0-9524-8e2179c0c43a admin admin] PATH_INFO: `/v3/projects/b103b73fb4c546068220dca1a3f2a5a2` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:19.595206 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e537b4-df08-49c0-9524-8e2179c0c43a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b103b73fb4c546068220dca1a3f2a5a2)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:19.597182 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e537b4-df08-49c0-9524-8e2179c0c43a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:19.742818 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-61e537b4-df08-49c0-9524-8e2179c0c43a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b103b73fb4c546068220dca1a3f2a5a2', 'request_id': 'req-61e537b4-df08-49c0-9524-8e2179c0c43a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:19.810127 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-61e537b4-df08-49c0-9524-8e2179c0c43a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b103b73fb4c546068220dca1a3f2a5a2', 'request_id': 'req-61e537b4-df08-49c0-9524-8e2179c0c43a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:19.821159 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-61e537b4-df08-49c0-9524-8e2179c0c43a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b103b73fb4c546068220dca1a3f2a5a2', 'request_id': 'req-61e537b4-df08-49c0-9524-8e2179c0c43a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:19.833001 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-61e537b4-df08-49c0-9524-8e2179c0c43a admin admin] The token cache is being invalidate because project b103b73fb4c546068220dca1a3f2a5a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:04:19.833404 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-61e537b4-df08-49c0-9524-8e2179c0c43a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:19.834101 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-61e537b4-df08-49c0-9524-8e2179c0c43a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:19.835739 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1178/2354] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:04:19 2022] DELETE /identity/v3/projects/b103b73fb4c546068220dca1a3f2a5a2 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:04:19.933236 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f2bc1-e458-4f86-874d-85fd62d19604 service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:19.938032 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-ff1f2bc1-e458-4f86-874d-85fd62d19604 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:19.953739 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f2bc1-e458-4f86-874d-85fd62d19604 service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:20.035216 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdde0dd2-9c5a-47d3-8f08-f9bdfa16ede4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:20.040749 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde0dd2-9c5a-47d3-8f08-f9bdfa16ede4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:20.040749 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde0dd2-9c5a-47d3-8f08-f9bdfa16ede4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:20.040749 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde0dd2-9c5a-47d3-8f08-f9bdfa16ede4 admin admin] PATH_INFO: `/v3/projects/0e0ea7baf2614bd8a4dd2253caed3bf8` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:20.040749 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde0dd2-9c5a-47d3-8f08-f9bdfa16ede4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e0ea7baf2614bd8a4dd2253caed3bf8)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:20.040749 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdde0dd2-9c5a-47d3-8f08-f9bdfa16ede4 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:20.159069 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-cdde0dd2-9c5a-47d3-8f08-f9bdfa16ede4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e0ea7baf2614bd8a4dd2253caed3bf8', 'request_id': 'req-cdde0dd2-9c5a-47d3-8f08-f9bdfa16ede4'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:20.164475 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-cdde0dd2-9c5a-47d3-8f08-f9bdfa16ede4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e0ea7baf2614bd8a4dd2253caed3bf8', 'request_id': 'req-cdde0dd2-9c5a-47d3-8f08-f9bdfa16ede4'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:20.233085 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-cdde0dd2-9c5a-47d3-8f08-f9bdfa16ede4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e0ea7baf2614bd8a4dd2253caed3bf8', 'request_id': 'req-cdde0dd2-9c5a-47d3-8f08-f9bdfa16ede4'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:20.246195 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-cdde0dd2-9c5a-47d3-8f08-f9bdfa16ede4 admin admin] The token cache is being invalidate because project 0e0ea7baf2614bd8a4dd2253caed3bf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:04:20.246486 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-cdde0dd2-9c5a-47d3-8f08-f9bdfa16ede4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:20.247157 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-cdde0dd2-9c5a-47d3-8f08-f9bdfa16ede4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:20.248959 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1177/2355] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:04:19 2022] DELETE /identity/v3/projects/0e0ea7baf2614bd8a4dd2253caed3bf8 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:04:20.254125 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741215cf-658a-4f3a-881b-c9112c9ddd17 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:20.254987 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741215cf-658a-4f3a-881b-c9112c9ddd17 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:20.255272 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741215cf-658a-4f3a-881b-c9112c9ddd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:20.276199 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-741215cf-658a-4f3a-881b-c9112c9ddd17 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:20.277478 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-741215cf-658a-4f3a-881b-c9112c9ddd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:20.340980 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1179/2356] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:04:20.349326 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dfcdf-6980-462e-bd7d-9396fd6ad0e5 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:20.349634 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dfcdf-6980-462e-bd7d-9396fd6ad0e5 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:20.350012 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460dfcdf-6980-462e-bd7d-9396fd6ad0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:20.373464 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-460dfcdf-6980-462e-bd7d-9396fd6ad0e5 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:20.374703 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-460dfcdf-6980-462e-bd7d-9396fd6ad0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:20.382910 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1178/2357] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:04:20.387191 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741215cf-658a-4f3a-881b-c9112c9ddd17 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:20.397915 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741215cf-658a-4f3a-881b-c9112c9ddd17 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:20.402988 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03ad0e-4a94-4592-a9b1-1e47b24ea9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:20.403663 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03ad0e-4a94-4592-a9b1-1e47b24ea9ba admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:20.403941 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03ad0e-4a94-4592-a9b1-1e47b24ea9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:20.404244 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03ad0e-4a94-4592-a9b1-1e47b24ea9ba admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:20.405614 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03ad0e-4a94-4592-a9b1-1e47b24ea9ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:04:20.405918 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03ad0e-4a94-4592-a9b1-1e47b24ea9ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:20.407541 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03ad0e-4a94-4592-a9b1-1e47b24ea9ba admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:20.419376 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1180/2358] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:04:20.423993 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460dfcdf-6980-462e-bd7d-9396fd6ad0e5 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:20.433115 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460dfcdf-6980-462e-bd7d-9396fd6ad0e5 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:20.437805 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b8ce2-ba1a-484f-8d2e-f18cf04e031e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:20.438533 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b8ce2-ba1a-484f-8d2e-f18cf04e031e admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:20.438724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b8ce2-ba1a-484f-8d2e-f18cf04e031e admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:20.439038 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b8ce2-ba1a-484f-8d2e-f18cf04e031e admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:20.439733 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b8ce2-ba1a-484f-8d2e-f18cf04e031e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:20.441790 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b8ce2-ba1a-484f-8d2e-f18cf04e031e admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:20.531942 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1179/2359] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:04:20 2022] POST /identity/v3/projects => generated 369 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:04:20.536310 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03ad0e-4a94-4592-a9b1-1e47b24ea9ba admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:20.549095 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03ad0e-4a94-4592-a9b1-1e47b24ea9ba admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:20.608309 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e35e57-21ae-49c4-8c88-7447bb08f159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:20.608984 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e35e57-21ae-49c4-8c88-7447bb08f159 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:20.609265 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e35e57-21ae-49c4-8c88-7447bb08f159 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:20.609534 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e35e57-21ae-49c4-8c88-7447bb08f159 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:20.610237 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e35e57-21ae-49c4-8c88-7447bb08f159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:20.612173 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e35e57-21ae-49c4-8c88-7447bb08f159 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:20.721464 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1181/2360] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:04:20 2022] POST /identity/v3/users => generated 285 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:04:20.726824 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b8ce2-ba1a-484f-8d2e-f18cf04e031e admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:20.738285 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b8ce2-ba1a-484f-8d2e-f18cf04e031e admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:20.742959 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396f0e7-461b-423e-b910-ff07edd51ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:20.743648 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396f0e7-461b-423e-b910-ff07edd51ee5 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:20.743930 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396f0e7-461b-423e-b910-ff07edd51ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:20.744209 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396f0e7-461b-423e-b910-ff07edd51ee5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:20.744973 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396f0e7-461b-423e-b910-ff07edd51ee5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:20.746563 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396f0e7-461b-423e-b910-ff07edd51ee5 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:20.763452 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1180/2361] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:04:20.764656 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e35e57-21ae-49c4-8c88-7447bb08f159 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:20.775163 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e35e57-21ae-49c4-8c88-7447bb08f159 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:20.780618 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd863e-84fa-4fc8-b152-73503dd0cc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:20.781370 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd863e-84fa-4fc8-b152-73503dd0cc2f admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:20.781651 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd863e-84fa-4fc8-b152-73503dd0cc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:20.781925 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd863e-84fa-4fc8-b152-73503dd0cc2f admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:20.782658 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd863e-84fa-4fc8-b152-73503dd0cc2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:20.784279 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dd863e-84fa-4fc8-b152-73503dd0cc2f admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:20.796408 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1182/2362] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:04:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:04:20.799706 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396f0e7-461b-423e-b910-ff07edd51ee5 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:20.809979 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396f0e7-461b-423e-b910-ff07edd51ee5 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:20.814666 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf071851-db0d-4ace-837d-04392976c3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:20.815598 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf071851-db0d-4ace-837d-04392976c3c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:20.815878 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf071851-db0d-4ace-837d-04392976c3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:20.816154 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf071851-db0d-4ace-837d-04392976c3c8 admin admin] PATH_INFO: `/v3/projects/9d227fb8125c43fb8fccd7e13c8fbe3f/users/7e516335354a47cda218cbf5c2147dcb/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:20.830978 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf071851-db0d-4ace-837d-04392976c3c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d227fb8125c43fb8fccd7e13c8fbe3f, user_id=7e516335354a47cda218cbf5c2147dcb, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:20.833650 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf071851-db0d-4ace-837d-04392976c3c8 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:20.942187 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1181/2363] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:04:20 2022] PUT /identity/v3/projects/9d227fb8125c43fb8fccd7e13c8fbe3f/users/7e516335354a47cda218cbf5c2147dcb/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:04:20.957580 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1946bc-dbe3-4c45-9abb-353b92632eba None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:20.961432 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1946bc-dbe3-4c45-9abb-353b92632eba None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:20.961432 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1946bc-dbe3-4c45-9abb-353b92632eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:20.994043 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-bd1946bc-dbe3-4c45-9abb-353b92632eba None None] MFA Rules not processed for user `7e516335354a47cda218cbf5c2147dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:20.994043 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-bd1946bc-dbe3-4c45-9abb-353b92632eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:21.059448 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1183/2364] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:04:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:04:21.071369 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf071851-db0d-4ace-837d-04392976c3c8 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:21.073074 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-cf071851-db0d-4ace-837d-04392976c3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:21.130536 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf071851-db0d-4ace-837d-04392976c3c8 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:21.134369 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dc2ea-0ca9-497c-a465-5c2b50d8fa1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2ad9c7f930e426bb908237f72c04a2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:21.135422 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dc2ea-0ca9-497c-a465-5c2b50d8fa1b service glance] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:21.135422 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dc2ea-0ca9-497c-a465-5c2b50d8fa1b service glance] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:21.135593 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5dc2ea-0ca9-497c-a465-5c2b50d8fa1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:21.144699 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dc2ea-0ca9-497c-a465-5c2b50d8fa1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:21.146113 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5dc2ea-0ca9-497c-a465-5c2b50d8fa1b service glance] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:21.155607 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1182/2365] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:04:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:04:21.171346 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4bcfe-f5a6-422e-b304-8fae1bc146ae None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:21.171634 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4bcfe-f5a6-422e-b304-8fae1bc146ae None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:21.171980 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4bcfe-f5a6-422e-b304-8fae1bc146ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:21.191689 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-faf4bcfe-f5a6-422e-b304-8fae1bc146ae None None] MFA Rules not processed for user `5c7b25e0e29143d783553859a0583d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:21.192899 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-faf4bcfe-f5a6-422e-b304-8fae1bc146ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:21.250865 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1184/2366] 10.222.0.24 () {58 vars in 1009 bytes} [Tue Apr 12 00:04:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:04:21.264217 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dc2ea-0ca9-497c-a465-5c2b50d8fa1b service glance] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:21.265781 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-8b5dc2ea-0ca9-497c-a465-5c2b50d8fa1b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:21.347196 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5dc2ea-0ca9-497c-a465-5c2b50d8fa1b service glance] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:21.352586 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1713d6-5605-495a-9600-417de4553a4e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d616b38304d91bf1c7aded81205e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:21.353308 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1713d6-5605-495a-9600-417de4553a4e service swift] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:21.353656 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1713d6-5605-495a-9600-417de4553a4e service swift] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:21.353991 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1713d6-5605-495a-9600-417de4553a4e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:21.363836 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1713d6-5605-495a-9600-417de4553a4e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:21.365408 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1713d6-5605-495a-9600-417de4553a4e service swift] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:21.374326 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1183/2367] 10.222.0.24 () {60 vars in 1384 bytes} [Tue Apr 12 00:04:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:04:26.412754 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5778b-53f0-484f-b958-2bf50b44a589 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:26.413574 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5778b-53f0-484f-b958-2bf50b44a589 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:26.413574 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5778b-53f0-484f-b958-2bf50b44a589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:26.432789 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-14c5778b-53f0-484f-b958-2bf50b44a589 None None] MFA Rules not processed for user `666e5f4ec73d46c5834608b1f21a4447`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:26.434021 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-14c5778b-53f0-484f-b958-2bf50b44a589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:26.493165 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1185/2368] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:04:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:04:31.780442 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1713d6-5605-495a-9600-417de4553a4e service swift] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:31.784578 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-4e1713d6-5605-495a-9600-417de4553a4e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:31.871986 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1713d6-5605-495a-9600-417de4553a4e service swift] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:31.877045 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b516c-78aa-42c2-89b4-93e4b0a47f5f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47515442e0e84441bed4bfbb7a3b4ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:31.877689 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b516c-78aa-42c2-89b4-93e4b0a47f5f service placement] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:31.877968 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b516c-78aa-42c2-89b4-93e4b0a47f5f service placement] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:31.878272 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b516c-78aa-42c2-89b4-93e4b0a47f5f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:31.880092 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-439b516c-78aa-42c2-89b4-93e4b0a47f5f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:31.892105 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b516c-78aa-42c2-89b4-93e4b0a47f5f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:31.893617 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439b516c-78aa-42c2-89b4-93e4b0a47f5f service placement] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:31.903616 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1184/2369] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:04:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:04:47.515010 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935273e-811b-4582-868b-fc3afa02b7b7 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:47.515010 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935273e-811b-4582-868b-fc3afa02b7b7 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:47.515519 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935273e-811b-4582-868b-fc3afa02b7b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:47.571293 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-f935273e-811b-4582-868b-fc3afa02b7b7 None None] MFA Rules not processed for user `5c7b25e0e29143d783553859a0583d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:47.572573 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-f935273e-811b-4582-868b-fc3afa02b7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:47.590285 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1186/2370] 10.222.0.24 () {58 vars in 967 bytes} [Tue Apr 12 00:04:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:04:47.616673 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b516c-78aa-42c2-89b4-93e4b0a47f5f service placement] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:47.637469 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439b516c-78aa-42c2-89b4-93e4b0a47f5f service placement] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:47.642569 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c2b8d-bffe-40dd-8dac-32a573313b92 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d616b38304d91bf1c7aded81205e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:47.643430 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c2b8d-bffe-40dd-8dac-32a573313b92 service swift] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:47.643722 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c2b8d-bffe-40dd-8dac-32a573313b92 service swift] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:47.643995 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c2b8d-bffe-40dd-8dac-32a573313b92 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:47.652085 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c2b8d-bffe-40dd-8dac-32a573313b92 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:47.653664 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c2b8d-bffe-40dd-8dac-32a573313b92 service swift] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:47.662326 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1185/2371] 10.222.0.24 () {60 vars in 1384 bytes} [Tue Apr 12 00:04:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:04:52.670672 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935273e-811b-4582-868b-fc3afa02b7b7 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:52.672174 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-f935273e-811b-4582-868b-fc3afa02b7b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:52.727596 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935273e-811b-4582-868b-fc3afa02b7b7 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:52.731120 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bf0f1-c74a-40da-a0b1-1823dfa1e41c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:52.732073 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bf0f1-c74a-40da-a0b1-1823dfa1e41c service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:52.732356 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bf0f1-c74a-40da-a0b1-1823dfa1e41c service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:52.732639 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bf0f1-c74a-40da-a0b1-1823dfa1e41c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:52.734677 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-4a2bf0f1-c74a-40da-a0b1-1823dfa1e41c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:52.801471 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bf0f1-c74a-40da-a0b1-1823dfa1e41c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:52.802960 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bf0f1-c74a-40da-a0b1-1823dfa1e41c service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:52.812503 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1187/2372] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:04:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:04:57.399222 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c2b8d-bffe-40dd-8dac-32a573313b92 service swift] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:57.462632 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c2b8d-bffe-40dd-8dac-32a573313b92 service swift] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:57.467076 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa1f46-d45e-46c8-bc93-085e46b9fa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:57.467930 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa1f46-d45e-46c8-bc93-085e46b9fa40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:57.468204 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa1f46-d45e-46c8-bc93-085e46b9fa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:57.468472 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa1f46-d45e-46c8-bc93-085e46b9fa40 admin admin] PATH_INFO: `/v3/users/7e516335354a47cda218cbf5c2147dcb` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:57.469635 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa1f46-d45e-46c8-bc93-085e46b9fa40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e516335354a47cda218cbf5c2147dcb)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:57.471544 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa1f46-d45e-46c8-bc93-085e46b9fa40 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:57.661817 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-feaa1f46-d45e-46c8-bc93-085e46b9fa40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e516335354a47cda218cbf5c2147dcb'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:57.668530 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-feaa1f46-d45e-46c8-bc93-085e46b9fa40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e516335354a47cda218cbf5c2147dcb'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:57.752267 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-feaa1f46-d45e-46c8-bc93-085e46b9fa40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e516335354a47cda218cbf5c2147dcb'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:57.752941 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-feaa1f46-d45e-46c8-bc93-085e46b9fa40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e516335354a47cda218cbf5c2147dcb'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:57.765009 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-feaa1f46-d45e-46c8-bc93-085e46b9fa40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e516335354a47cda218cbf5c2147dcb'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:57.771181 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1186/2373] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:04:57 2022] DELETE /identity/v3/users/7e516335354a47cda218cbf5c2147dcb => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:04:57.775564 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c033c-64bb-4c79-8296-26aaaf9a3b18 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:57.776006 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c033c-64bb-4c79-8296-26aaaf9a3b18 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:57.776174 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c033c-64bb-4c79-8296-26aaaf9a3b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:57.793025 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-397c033c-64bb-4c79-8296-26aaaf9a3b18 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:57.794208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-397c033c-64bb-4c79-8296-26aaaf9a3b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:57.850189 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1188/2374] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:04:57.860434 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa1f46-d45e-46c8-bc93-085e46b9fa40 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:57.861827 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-feaa1f46-d45e-46c8-bc93-085e46b9fa40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:57.915472 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa1f46-d45e-46c8-bc93-085e46b9fa40 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:57.918990 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260a4ff-9efb-4b20-bfef-bca2764606a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:57.919644 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260a4ff-9efb-4b20-bfef-bca2764606a5 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:57.919918 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260a4ff-9efb-4b20-bfef-bca2764606a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:57.920183 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260a4ff-9efb-4b20-bfef-bca2764606a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:57.929430 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260a4ff-9efb-4b20-bfef-bca2764606a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:57.930853 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260a4ff-9efb-4b20-bfef-bca2764606a5 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:57.940550 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1187/2375] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:04:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:04:58.307958 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c033c-64bb-4c79-8296-26aaaf9a3b18 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:58.309383 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-397c033c-64bb-4c79-8296-26aaaf9a3b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:58.322508 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c033c-64bb-4c79-8296-26aaaf9a3b18 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:58.327171 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298712e-b9a7-4ab5-890d-aa230226262c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:58.328124 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298712e-b9a7-4ab5-890d-aa230226262c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:58.328459 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298712e-b9a7-4ab5-890d-aa230226262c admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:58.328802 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298712e-b9a7-4ab5-890d-aa230226262c admin admin] PATH_INFO: `/v3/projects/9d227fb8125c43fb8fccd7e13c8fbe3f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:58.330338 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298712e-b9a7-4ab5-890d-aa230226262c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d227fb8125c43fb8fccd7e13c8fbe3f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:58.341271 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298712e-b9a7-4ab5-890d-aa230226262c admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:58.449691 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d298712e-b9a7-4ab5-890d-aa230226262c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d227fb8125c43fb8fccd7e13c8fbe3f', 'request_id': 'req-d298712e-b9a7-4ab5-890d-aa230226262c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:58.546560 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d298712e-b9a7-4ab5-890d-aa230226262c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d227fb8125c43fb8fccd7e13c8fbe3f', 'request_id': 'req-d298712e-b9a7-4ab5-890d-aa230226262c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:58.552200 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d298712e-b9a7-4ab5-890d-aa230226262c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d227fb8125c43fb8fccd7e13c8fbe3f', 'request_id': 'req-d298712e-b9a7-4ab5-890d-aa230226262c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:58.562769 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d298712e-b9a7-4ab5-890d-aa230226262c admin admin] The token cache is being invalidate because project 9d227fb8125c43fb8fccd7e13c8fbe3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:04:58.563083 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d298712e-b9a7-4ab5-890d-aa230226262c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:58.563692 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d298712e-b9a7-4ab5-890d-aa230226262c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:04:58.565224 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1189/2376] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:04:58 2022] DELETE /identity/v3/projects/9d227fb8125c43fb8fccd7e13c8fbe3f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:04:58.570510 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e239b8-db0f-41a0-872d-b0ff7f900821 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:58.570991 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e239b8-db0f-41a0-872d-b0ff7f900821 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:58.571109 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e239b8-db0f-41a0-872d-b0ff7f900821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:58.588619 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-14e239b8-db0f-41a0-872d-b0ff7f900821 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:58.589823 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-14e239b8-db0f-41a0-872d-b0ff7f900821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:58.645982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1188/2377] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:04:58.653971 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bedcc4-8cab-4981-8594-be382289c609 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:58.654256 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bedcc4-8cab-4981-8594-be382289c609 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:58.654602 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bedcc4-8cab-4981-8594-be382289c609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:58.674046 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-83bedcc4-8cab-4981-8594-be382289c609 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:58.675308 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-83bedcc4-8cab-4981-8594-be382289c609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:58.683171 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1190/2378] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:04:58.691991 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e239b8-db0f-41a0-872d-b0ff7f900821 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:58.701592 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e239b8-db0f-41a0-872d-b0ff7f900821 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:58.706564 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436db92c-608e-40e5-9e6b-20c81261e62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:58.707242 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436db92c-608e-40e5-9e6b-20c81261e62c admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:58.707516 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436db92c-608e-40e5-9e6b-20c81261e62c admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:58.707785 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436db92c-608e-40e5-9e6b-20c81261e62c admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:58.708506 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436db92c-608e-40e5-9e6b-20c81261e62c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:04:58.708805 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436db92c-608e-40e5-9e6b-20c81261e62c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:58.710389 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436db92c-608e-40e5-9e6b-20c81261e62c admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:58.721968 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1189/2379] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:04:58.732293 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bedcc4-8cab-4981-8594-be382289c609 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:58.741568 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bedcc4-8cab-4981-8594-be382289c609 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:58.746190 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb45976-ccd6-46e4-9a42-19e347ab4496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:58.746827 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb45976-ccd6-46e4-9a42-19e347ab4496 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:58.747133 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb45976-ccd6-46e4-9a42-19e347ab4496 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:58.747411 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb45976-ccd6-46e4-9a42-19e347ab4496 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:58.748090 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb45976-ccd6-46e4-9a42-19e347ab4496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:58.750014 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb45976-ccd6-46e4-9a42-19e347ab4496 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:58.828581 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1191/2380] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:04:58 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:04:58.832903 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436db92c-608e-40e5-9e6b-20c81261e62c admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:58.842715 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436db92c-608e-40e5-9e6b-20c81261e62c admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:58.898185 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e3418-db97-4562-bb96-fbe63c24d8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:58.898933 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e3418-db97-4562-bb96-fbe63c24d8a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:58.899217 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e3418-db97-4562-bb96-fbe63c24d8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:58.899520 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e3418-db97-4562-bb96-fbe63c24d8a8 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:58.900206 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e3418-db97-4562-bb96-fbe63c24d8a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:58.902149 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e3418-db97-4562-bb96-fbe63c24d8a8 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:59.020607 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1190/2381] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:04:58 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:04:59.024670 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb45976-ccd6-46e4-9a42-19e347ab4496 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:59.035576 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb45976-ccd6-46e4-9a42-19e347ab4496 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:59.040162 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da79b9f-4ddd-4f22-9471-46b545922dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:59.040808 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da79b9f-4ddd-4f22-9471-46b545922dcb admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:59.041088 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da79b9f-4ddd-4f22-9471-46b545922dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:59.041365 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da79b9f-4ddd-4f22-9471-46b545922dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:59.042094 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da79b9f-4ddd-4f22-9471-46b545922dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:59.043753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da79b9f-4ddd-4f22-9471-46b545922dcb admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:59.054526 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1192/2382] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:04:59.058324 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e3418-db97-4562-bb96-fbe63c24d8a8 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:59.069170 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e3418-db97-4562-bb96-fbe63c24d8a8 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:59.073806 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7e8ac3-86a0-4bf6-95cb-44ee1f6250fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:59.074451 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e8ac3-86a0-4bf6-95cb-44ee1f6250fb admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:59.074731 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e8ac3-86a0-4bf6-95cb-44ee1f6250fb admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:59.075035 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7e8ac3-86a0-4bf6-95cb-44ee1f6250fb admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:59.075762 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e8ac3-86a0-4bf6-95cb-44ee1f6250fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:59.077335 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7e8ac3-86a0-4bf6-95cb-44ee1f6250fb admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:59.087153 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1191/2383] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:04:59.091071 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da79b9f-4ddd-4f22-9471-46b545922dcb admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:59.101366 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da79b9f-4ddd-4f22-9471-46b545922dcb admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:59.105914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72b9e9-32dc-4210-8a19-6a750d4b2a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:59.106785 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72b9e9-32dc-4210-8a19-6a750d4b2a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:59.107097 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72b9e9-32dc-4210-8a19-6a750d4b2a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:59.107369 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72b9e9-32dc-4210-8a19-6a750d4b2a6c admin admin] PATH_INFO: `/v3/projects/a3451f060f234dd8b0a1a7e31a9d1130/users/762264ba0f724cbeaf3a8f0235845dc9/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:59.122086 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72b9e9-32dc-4210-8a19-6a750d4b2a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3451f060f234dd8b0a1a7e31a9d1130, user_id=762264ba0f724cbeaf3a8f0235845dc9, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:59.124757 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72b9e9-32dc-4210-8a19-6a750d4b2a6c admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:59.232540 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1193/2384] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:04:59 2022] PUT /identity/v3/projects/a3451f060f234dd8b0a1a7e31a9d1130/users/762264ba0f724cbeaf3a8f0235845dc9/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:04:59.244340 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5fd5b-c73d-4cca-b46c-8f787729804f None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:59.244628 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5fd5b-c73d-4cca-b46c-8f787729804f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:59.244901 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab5fd5b-c73d-4cca-b46c-8f787729804f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:59.270538 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-4ab5fd5b-c73d-4cca-b46c-8f787729804f None None] MFA Rules not processed for user `762264ba0f724cbeaf3a8f0235845dc9`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:04:59.271800 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-4ab5fd5b-c73d-4cca-b46c-8f787729804f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:59.331811 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1192/2385] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:04:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:04:59.342742 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72b9e9-32dc-4210-8a19-6a750d4b2a6c admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:04:59.345048 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-3a72b9e9-32dc-4210-8a19-6a750d4b2a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:04:59.419003 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72b9e9-32dc-4210-8a19-6a750d4b2a6c admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:04:59.422665 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335fdf8-89b4-4498-81d8-edd0d70c4c6b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2ad9c7f930e426bb908237f72c04a2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:04:59.423324 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335fdf8-89b4-4498-81d8-edd0d70c4c6b service glance] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:04:59.423606 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335fdf8-89b4-4498-81d8-edd0d70c4c6b service glance] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:04:59.423878 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335fdf8-89b4-4498-81d8-edd0d70c4c6b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:04:59.431874 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335fdf8-89b4-4498-81d8-edd0d70c4c6b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:04:59.433292 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335fdf8-89b4-4498-81d8-edd0d70c4c6b service glance] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:04:59.441836 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1194/2386] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:04:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:05:09.018990 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e779bb3-db48-4673-be85-4f6548427600 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:05:09.019520 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e779bb3-db48-4673-be85-4f6548427600 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:05:09.019520 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e779bb3-db48-4673-be85-4f6548427600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:05:09.040357 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-0e779bb3-db48-4673-be85-4f6548427600 None None] MFA Rules not processed for user `7b5417dc6db1461e94de39f4d2ca8f2c`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:05:09.042277 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-0e779bb3-db48-4673-be85-4f6548427600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:05:09.103080 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1193/2387] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:05:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:05:29.629623 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335fdf8-89b4-4498-81d8-edd0d70c4c6b service glance] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:05:29.690590 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335fdf8-89b4-4498-81d8-edd0d70c4c6b service glance] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:05:29.695328 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc229a66-26fc-4e88-817e-c37ad27b124b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:05:29.696123 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc229a66-26fc-4e88-817e-c37ad27b124b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:05:29.696289 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc229a66-26fc-4e88-817e-c37ad27b124b admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:05:29.696561 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc229a66-26fc-4e88-817e-c37ad27b124b admin admin] PATH_INFO: `/v3/users/762264ba0f724cbeaf3a8f0235845dc9` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:05:29.697741 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc229a66-26fc-4e88-817e-c37ad27b124b admin admin] RBAC: Authorizing `identity:delete_user(user_id=762264ba0f724cbeaf3a8f0235845dc9)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:05:29.699855 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc229a66-26fc-4e88-817e-c37ad27b124b admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:05:29.923232 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bc229a66-26fc-4e88-817e-c37ad27b124b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '762264ba0f724cbeaf3a8f0235845dc9'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:05:29.980105 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bc229a66-26fc-4e88-817e-c37ad27b124b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '762264ba0f724cbeaf3a8f0235845dc9'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:05:29.980717 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bc229a66-26fc-4e88-817e-c37ad27b124b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '762264ba0f724cbeaf3a8f0235845dc9'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:05:29.987765 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bc229a66-26fc-4e88-817e-c37ad27b124b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '762264ba0f724cbeaf3a8f0235845dc9'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:05:29.999869 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bc229a66-26fc-4e88-817e-c37ad27b124b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '762264ba0f724cbeaf3a8f0235845dc9'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:05:30.005762 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1195/2388] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:05:29 2022] DELETE /identity/v3/users/762264ba0f724cbeaf3a8f0235845dc9 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:05:30.011956 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c73b61-5dfb-4eeb-a093-4ebd5ecd49a1 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:05:30.012541 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c73b61-5dfb-4eeb-a093-4ebd5ecd49a1 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:05:30.012541 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c73b61-5dfb-4eeb-a093-4ebd5ecd49a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:05:30.030184 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-40c73b61-5dfb-4eeb-a093-4ebd5ecd49a1 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:05:30.031418 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-40c73b61-5dfb-4eeb-a093-4ebd5ecd49a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:05:30.088534 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1194/2389] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:05:30.098007 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc229a66-26fc-4e88-817e-c37ad27b124b admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:05:30.099561 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-bc229a66-26fc-4e88-817e-c37ad27b124b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:05:30.154383 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc229a66-26fc-4e88-817e-c37ad27b124b admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:05:30.157897 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09726f0-7b90-41c1-a489-16c38987e523 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:05:30.158521 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09726f0-7b90-41c1-a489-16c38987e523 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:05:30.158802 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09726f0-7b90-41c1-a489-16c38987e523 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:05:30.159119 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09726f0-7b90-41c1-a489-16c38987e523 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:05:30.168393 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09726f0-7b90-41c1-a489-16c38987e523 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:05:30.169807 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09726f0-7b90-41c1-a489-16c38987e523 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:05:30.179104 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1196/2390] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:05:30.579140 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c73b61-5dfb-4eeb-a093-4ebd5ecd49a1 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:05:30.580540 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-40c73b61-5dfb-4eeb-a093-4ebd5ecd49a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:05:30.595283 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c73b61-5dfb-4eeb-a093-4ebd5ecd49a1 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:05:30.600227 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2886a5-5516-47f4-b09b-1a20215030a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:05:30.601201 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2886a5-5516-47f4-b09b-1a20215030a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:05:30.601374 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2886a5-5516-47f4-b09b-1a20215030a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:05:30.601848 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2886a5-5516-47f4-b09b-1a20215030a5 admin admin] PATH_INFO: `/v3/projects/a3451f060f234dd8b0a1a7e31a9d1130` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:05:30.603076 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2886a5-5516-47f4-b09b-1a20215030a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3451f060f234dd8b0a1a7e31a9d1130)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:05:30.605218 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2886a5-5516-47f4-b09b-1a20215030a5 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:05:30.710108 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-be2886a5-5516-47f4-b09b-1a20215030a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3451f060f234dd8b0a1a7e31a9d1130', 'request_id': 'req-be2886a5-5516-47f4-b09b-1a20215030a5'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:05:30.715343 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-be2886a5-5516-47f4-b09b-1a20215030a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3451f060f234dd8b0a1a7e31a9d1130', 'request_id': 'req-be2886a5-5516-47f4-b09b-1a20215030a5'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:05:30.809502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-be2886a5-5516-47f4-b09b-1a20215030a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3451f060f234dd8b0a1a7e31a9d1130', 'request_id': 'req-be2886a5-5516-47f4-b09b-1a20215030a5'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:05:30.821577 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-be2886a5-5516-47f4-b09b-1a20215030a5 admin admin] The token cache is being invalidate because project a3451f060f234dd8b0a1a7e31a9d1130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:05:30.821869 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-be2886a5-5516-47f4-b09b-1a20215030a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:05:30.822490 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-be2886a5-5516-47f4-b09b-1a20215030a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:05:30.824090 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1195/2391] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:05:30 2022] DELETE /identity/v3/projects/a3451f060f234dd8b0a1a7e31a9d1130 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:05:30.829074 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abebd3f-8e9f-4efd-ab7a-7c3aefef3bf3 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:05:30.829525 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abebd3f-8e9f-4efd-ab7a-7c3aefef3bf3 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:05:30.829679 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abebd3f-8e9f-4efd-ab7a-7c3aefef3bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:05:30.846635 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-5abebd3f-8e9f-4efd-ab7a-7c3aefef3bf3 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:05:30.847881 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-5abebd3f-8e9f-4efd-ab7a-7c3aefef3bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:05:30.906263 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1197/2392] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:05:30.914864 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0efc8c-9886-47d5-a759-59a9f10f7433 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:05:30.916309 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0efc8c-9886-47d5-a759-59a9f10f7433 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:05:30.918347 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0efc8c-9886-47d5-a759-59a9f10f7433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:05:30.940059 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-cc0efc8c-9886-47d5-a759-59a9f10f7433 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:05:30.941370 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-cc0efc8c-9886-47d5-a759-59a9f10f7433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:05:30.950243 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1196/2393] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:05:30.954436 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abebd3f-8e9f-4efd-ab7a-7c3aefef3bf3 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:05:30.964714 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abebd3f-8e9f-4efd-ab7a-7c3aefef3bf3 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:05:30.969229 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f6691-b9aa-4f0b-9abc-a754b1db9a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:05:30.969885 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f6691-b9aa-4f0b-9abc-a754b1db9a1a admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:05:30.970166 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f6691-b9aa-4f0b-9abc-a754b1db9a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:05:30.970442 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f6691-b9aa-4f0b-9abc-a754b1db9a1a admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:05:30.971296 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f6691-b9aa-4f0b-9abc-a754b1db9a1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:05:30.971588 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f6691-b9aa-4f0b-9abc-a754b1db9a1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:05:30.973185 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f6691-b9aa-4f0b-9abc-a754b1db9a1a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:05:30.985015 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1198/2394] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:05:30.989281 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0efc8c-9886-47d5-a759-59a9f10f7433 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:05:30.998427 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0efc8c-9886-47d5-a759-59a9f10f7433 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:05:31.004581 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efbd91-2624-49cc-b37d-0c367ef70237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:05:31.005232 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efbd91-2624-49cc-b37d-0c367ef70237 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:05:31.005509 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efbd91-2624-49cc-b37d-0c367ef70237 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:05:31.005777 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4efbd91-2624-49cc-b37d-0c367ef70237 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:05:31.007022 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efbd91-2624-49cc-b37d-0c367ef70237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:05:31.008982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4efbd91-2624-49cc-b37d-0c367ef70237 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:05:31.099271 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1197/2395] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:05:30 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:05:31.100666 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f6691-b9aa-4f0b-9abc-a754b1db9a1a admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:05:31.111249 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f6691-b9aa-4f0b-9abc-a754b1db9a1a admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:05:31.168963 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c7117-0bdf-4e9a-9a3f-a57719bf14be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:05:31.169699 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c7117-0bdf-4e9a-9a3f-a57719bf14be admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:05:31.169986 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c7117-0bdf-4e9a-9a3f-a57719bf14be admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:05:31.170255 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c7117-0bdf-4e9a-9a3f-a57719bf14be admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:05:31.171064 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c7117-0bdf-4e9a-9a3f-a57719bf14be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:05:31.173167 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c7117-0bdf-4e9a-9a3f-a57719bf14be admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:05:31.269753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1199/2396] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:05:31 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:05:31.271040 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efbd91-2624-49cc-b37d-0c367ef70237 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:05:31.282236 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4efbd91-2624-49cc-b37d-0c367ef70237 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:05:31.287212 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30a959-15e8-4897-bff7-15fee3d0d10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:05:31.287977 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30a959-15e8-4897-bff7-15fee3d0d10e admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:05:31.290399 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30a959-15e8-4897-bff7-15fee3d0d10e admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:05:31.290399 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30a959-15e8-4897-bff7-15fee3d0d10e admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:05:31.290399 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30a959-15e8-4897-bff7-15fee3d0d10e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:05:31.291198 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30a959-15e8-4897-bff7-15fee3d0d10e admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:05:31.303771 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1198/2397] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:05:31.306609 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c7117-0bdf-4e9a-9a3f-a57719bf14be admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:05:31.317123 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c7117-0bdf-4e9a-9a3f-a57719bf14be admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:05:31.322975 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5120dc50-741d-4d8f-ad6d-2ffb1ee675c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:05:31.323634 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120dc50-741d-4d8f-ad6d-2ffb1ee675c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:05:31.323911 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120dc50-741d-4d8f-ad6d-2ffb1ee675c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:05:31.324187 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5120dc50-741d-4d8f-ad6d-2ffb1ee675c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:05:31.324915 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120dc50-741d-4d8f-ad6d-2ffb1ee675c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:05:31.326496 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5120dc50-741d-4d8f-ad6d-2ffb1ee675c1 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:05:31.336759 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1200/2398] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:05:31.341066 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30a959-15e8-4897-bff7-15fee3d0d10e admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:05:31.351200 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30a959-15e8-4897-bff7-15fee3d0d10e admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:05:31.355906 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9b576-4709-489f-928d-fa4049f267ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:05:31.356775 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9b576-4709-489f-928d-fa4049f267ed admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:05:31.357053 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9b576-4709-489f-928d-fa4049f267ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:05:31.357326 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc9b576-4709-489f-928d-fa4049f267ed admin admin] PATH_INFO: `/v3/projects/77d13e16c2694f939137be1ca2e55b6c/users/0cc30086244243e09118bbd25fae7539/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:05:31.372283 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9b576-4709-489f-928d-fa4049f267ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d13e16c2694f939137be1ca2e55b6c, user_id=0cc30086244243e09118bbd25fae7539, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:05:31.374942 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc9b576-4709-489f-928d-fa4049f267ed admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:05:31.701781 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1199/2399] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:05:31 2022] PUT /identity/v3/projects/77d13e16c2694f939137be1ca2e55b6c/users/0cc30086244243e09118bbd25fae7539/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:05:31.706988 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da7f78-a042-49ee-9ff4-513b90be7ca4 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:05:31.707281 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da7f78-a042-49ee-9ff4-513b90be7ca4 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:05:31.707562 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da7f78-a042-49ee-9ff4-513b90be7ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:05:31.725632 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-80da7f78-a042-49ee-9ff4-513b90be7ca4 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:05:31.726756 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-80da7f78-a042-49ee-9ff4-513b90be7ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:05:31.782922 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1201/2400] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:05:31.793195 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9b576-4709-489f-928d-fa4049f267ed admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:05:31.794890 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1cc9b576-4709-489f-928d-fa4049f267ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:05:31.848608 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc9b576-4709-489f-928d-fa4049f267ed admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:05:31.852869 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cae79f-c4e7-4d60-8c1a-730da1522270 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:05:31.853565 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cae79f-c4e7-4d60-8c1a-730da1522270 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:05:31.853842 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cae79f-c4e7-4d60-8c1a-730da1522270 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:05:31.854111 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cae79f-c4e7-4d60-8c1a-730da1522270 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:05:31.864337 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cae79f-c4e7-4d60-8c1a-730da1522270 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:05:31.865815 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cae79f-c4e7-4d60-8c1a-730da1522270 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:05:31.875643 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1200/2401] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:05:33.044027 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e2140-740d-4f22-9f12-bac5371ae3d8 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:05:33.044536 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e2140-740d-4f22-9f12-bac5371ae3d8 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:05:33.044640 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e2140-740d-4f22-9f12-bac5371ae3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:05:33.070133 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-576e2140-740d-4f22-9f12-bac5371ae3d8 None None] MFA Rules not processed for user `0cc30086244243e09118bbd25fae7539`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:05:33.071366 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-576e2140-740d-4f22-9f12-bac5371ae3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:05:33.133616 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1202/2402] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:05:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:05:33.144230 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cae79f-c4e7-4d60-8c1a-730da1522270 service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:05:33.145596 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-49cae79f-c4e7-4d60-8c1a-730da1522270 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:05:33.200511 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cae79f-c4e7-4d60-8c1a-730da1522270 service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:05:33.204032 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b478a15-12a5-45d8-8192-543aecdc730e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:05:33.204660 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b478a15-12a5-45d8-8192-543aecdc730e service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:05:33.204935 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b478a15-12a5-45d8-8192-543aecdc730e service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:05:33.205206 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b478a15-12a5-45d8-8192-543aecdc730e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:05:33.213822 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b478a15-12a5-45d8-8192-543aecdc730e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:05:33.215266 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b478a15-12a5-45d8-8192-543aecdc730e service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:05:33.223804 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1201/2403] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:05:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:05:34.990459 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fba573-26a7-4cac-aa7d-f147ce5548b5 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:05:34.991023 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fba573-26a7-4cac-aa7d-f147ce5548b5 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:05:34.991023 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fba573-26a7-4cac-aa7d-f147ce5548b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:05:35.008736 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-79fba573-26a7-4cac-aa7d-f147ce5548b5 None None] MFA Rules not processed for user `0cc30086244243e09118bbd25fae7539`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:05:35.009927 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-79fba573-26a7-4cac-aa7d-f147ce5548b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:05:35.016705 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1203/2404] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:05:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:05:50.434674 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabf681-51cf-4f5c-af20-7eccc314d1ec None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:05:50.435210 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabf681-51cf-4f5c-af20-7eccc314d1ec None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:05:50.435210 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aabf681-51cf-4f5c-af20-7eccc314d1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:05:50.453154 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-2aabf681-51cf-4f5c-af20-7eccc314d1ec None None] MFA Rules not processed for user `1da750621eb94e5db8e50dddb008602c`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:05:50.454373 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-2aabf681-51cf-4f5c-af20-7eccc314d1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:05:50.511254 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1202/2405] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:05:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:06:11.023042 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea63302-9979-4171-b339-589966fe1e89 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:11.023630 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea63302-9979-4171-b339-589966fe1e89 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:11.023630 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea63302-9979-4171-b339-589966fe1e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:11.041123 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-eea63302-9979-4171-b339-589966fe1e89 None None] MFA Rules not processed for user `f03a84381dae444a907bf9624d2fefaa`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:06:11.044003 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-eea63302-9979-4171-b339-589966fe1e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:11.095688 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1204/2406] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:06:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:06:28.065964 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabf681-51cf-4f5c-af20-7eccc314d1ec None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:28.067558 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-2aabf681-51cf-4f5c-af20-7eccc314d1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:28.081397 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aabf681-51cf-4f5c-af20-7eccc314d1ec None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:28.085765 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91337ac2-8ed7-4a26-a5b9-bdb9cccd8827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:28.086621 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91337ac2-8ed7-4a26-a5b9-bdb9cccd8827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:28.086926 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91337ac2-8ed7-4a26-a5b9-bdb9cccd8827 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:28.087284 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91337ac2-8ed7-4a26-a5b9-bdb9cccd8827 admin admin] PATH_INFO: `/v3/users/7b5417dc6db1461e94de39f4d2ca8f2c` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:28.088359 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91337ac2-8ed7-4a26-a5b9-bdb9cccd8827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b5417dc6db1461e94de39f4d2ca8f2c)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:28.090304 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91337ac2-8ed7-4a26-a5b9-bdb9cccd8827 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:28.257888 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-91337ac2-8ed7-4a26-a5b9-bdb9cccd8827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b5417dc6db1461e94de39f4d2ca8f2c'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:28.265178 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-91337ac2-8ed7-4a26-a5b9-bdb9cccd8827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b5417dc6db1461e94de39f4d2ca8f2c'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:28.355885 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-91337ac2-8ed7-4a26-a5b9-bdb9cccd8827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b5417dc6db1461e94de39f4d2ca8f2c'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:28.356537 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-91337ac2-8ed7-4a26-a5b9-bdb9cccd8827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b5417dc6db1461e94de39f4d2ca8f2c'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:28.368877 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-91337ac2-8ed7-4a26-a5b9-bdb9cccd8827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b5417dc6db1461e94de39f4d2ca8f2c'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:28.375338 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1203/2407] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:06:28 2022] DELETE /identity/v3/users/7b5417dc6db1461e94de39f4d2ca8f2c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:06:28.626983 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea63302-9979-4171-b339-589966fe1e89 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:28.639663 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea63302-9979-4171-b339-589966fe1e89 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:28.695353 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764edc6b-9c6b-41de-83a5-63cf6e78fd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:28.696199 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764edc6b-9c6b-41de-83a5-63cf6e78fd6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:28.696477 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764edc6b-9c6b-41de-83a5-63cf6e78fd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:28.696742 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764edc6b-9c6b-41de-83a5-63cf6e78fd6c admin admin] PATH_INFO: `/v3/projects/a6462994c4f146a2a17f698efbaeb2dc` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:28.697926 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764edc6b-9c6b-41de-83a5-63cf6e78fd6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6462994c4f146a2a17f698efbaeb2dc)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:28.699931 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764edc6b-9c6b-41de-83a5-63cf6e78fd6c admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:28.803068 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-764edc6b-9c6b-41de-83a5-63cf6e78fd6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6462994c4f146a2a17f698efbaeb2dc', 'request_id': 'req-764edc6b-9c6b-41de-83a5-63cf6e78fd6c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:28.854309 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-764edc6b-9c6b-41de-83a5-63cf6e78fd6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6462994c4f146a2a17f698efbaeb2dc', 'request_id': 'req-764edc6b-9c6b-41de-83a5-63cf6e78fd6c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:28.860636 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-764edc6b-9c6b-41de-83a5-63cf6e78fd6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6462994c4f146a2a17f698efbaeb2dc', 'request_id': 'req-764edc6b-9c6b-41de-83a5-63cf6e78fd6c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:28.871438 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-764edc6b-9c6b-41de-83a5-63cf6e78fd6c admin admin] The token cache is being invalidate because project a6462994c4f146a2a17f698efbaeb2dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:06:28.871674 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-764edc6b-9c6b-41de-83a5-63cf6e78fd6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:28.872297 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-764edc6b-9c6b-41de-83a5-63cf6e78fd6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:28.873825 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1205/2408] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:06:28 2022] DELETE /identity/v3/projects/a6462994c4f146a2a17f698efbaeb2dc => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:06:28.883954 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81638c0-230a-4aef-a728-4bb7d7a5589d None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:28.889622 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81638c0-230a-4aef-a728-4bb7d7a5589d None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:28.889622 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81638c0-230a-4aef-a728-4bb7d7a5589d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:28.902651 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-a81638c0-230a-4aef-a728-4bb7d7a5589d None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:06:28.903885 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a81638c0-230a-4aef-a728-4bb7d7a5589d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:28.960961 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1204/2409] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:06:28.969862 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d8cb9-e655-44b1-933e-96b04b0bb60f None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:28.970151 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d8cb9-e655-44b1-933e-96b04b0bb60f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:28.970435 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d8cb9-e655-44b1-933e-96b04b0bb60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:28.988606 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-c51d8cb9-e655-44b1-933e-96b04b0bb60f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:06:28.989806 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-c51d8cb9-e655-44b1-933e-96b04b0bb60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:28.997697 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1206/2410] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:06:29.001865 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81638c0-230a-4aef-a728-4bb7d7a5589d None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:29.011875 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81638c0-230a-4aef-a728-4bb7d7a5589d None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:29.016441 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8388a6-ccd0-4aef-abcf-e83be8774722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:29.017100 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8388a6-ccd0-4aef-abcf-e83be8774722 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:29.017378 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8388a6-ccd0-4aef-abcf-e83be8774722 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:29.027180 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8388a6-ccd0-4aef-abcf-e83be8774722 admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:29.027180 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8388a6-ccd0-4aef-abcf-e83be8774722 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:06:29.027180 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8388a6-ccd0-4aef-abcf-e83be8774722 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:29.027180 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8388a6-ccd0-4aef-abcf-e83be8774722 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:29.032010 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1205/2411] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:06:29.036482 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d8cb9-e655-44b1-933e-96b04b0bb60f None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:29.045595 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d8cb9-e655-44b1-933e-96b04b0bb60f None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:29.050265 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cda208-7ba5-4256-9160-7e1bfa7c9d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:29.050932 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cda208-7ba5-4256-9160-7e1bfa7c9d44 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:29.051214 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cda208-7ba5-4256-9160-7e1bfa7c9d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:29.051485 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cda208-7ba5-4256-9160-7e1bfa7c9d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:29.052181 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cda208-7ba5-4256-9160-7e1bfa7c9d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:29.054082 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cda208-7ba5-4256-9160-7e1bfa7c9d44 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:29.176125 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1207/2412] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:06:29 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:06:29.180204 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8388a6-ccd0-4aef-abcf-e83be8774722 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:29.195261 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8388a6-ccd0-4aef-abcf-e83be8774722 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:29.275332 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454c482-c6f0-4293-a6c0-1576422a95a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:29.276207 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454c482-c6f0-4293-a6c0-1576422a95a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:29.277065 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454c482-c6f0-4293-a6c0-1576422a95a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:29.277344 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5454c482-c6f0-4293-a6c0-1576422a95a2 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:29.278449 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454c482-c6f0-4293-a6c0-1576422a95a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:29.280565 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5454c482-c6f0-4293-a6c0-1576422a95a2 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:29.387124 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1206/2413] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:06:29 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:06:29.391719 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cda208-7ba5-4256-9160-7e1bfa7c9d44 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:29.402324 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cda208-7ba5-4256-9160-7e1bfa7c9d44 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:29.407147 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7f343-1203-4ba8-98a1-bc889b726bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:29.408003 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7f343-1203-4ba8-98a1-bc889b726bbd admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:29.408283 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7f343-1203-4ba8-98a1-bc889b726bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:29.408784 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7f343-1203-4ba8-98a1-bc889b726bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:29.409779 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7f343-1203-4ba8-98a1-bc889b726bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:29.411445 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7f343-1203-4ba8-98a1-bc889b726bbd admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:29.422102 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1208/2414] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:06:29.426326 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454c482-c6f0-4293-a6c0-1576422a95a2 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:29.475018 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5454c482-c6f0-4293-a6c0-1576422a95a2 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:29.475018 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aabd8b-689a-4fea-9725-bc35f0b6fbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:29.475018 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aabd8b-689a-4fea-9725-bc35f0b6fbfa admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:29.475018 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aabd8b-689a-4fea-9725-bc35f0b6fbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:29.475557 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aabd8b-689a-4fea-9725-bc35f0b6fbfa admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:29.475557 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aabd8b-689a-4fea-9725-bc35f0b6fbfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:29.475557 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aabd8b-689a-4fea-9725-bc35f0b6fbfa admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:29.475557 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1207/2415] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:06:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:06:29.477909 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7f343-1203-4ba8-98a1-bc889b726bbd admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:29.488702 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7f343-1203-4ba8-98a1-bc889b726bbd admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:29.493741 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50402319-3aaa-4f23-8481-be25359b2a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:29.494710 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50402319-3aaa-4f23-8481-be25359b2a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:29.495627 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50402319-3aaa-4f23-8481-be25359b2a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:29.495927 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50402319-3aaa-4f23-8481-be25359b2a69 admin admin] PATH_INFO: `/v3/projects/4553bb1ab64f4a56a7a802584b5087da/users/de59a12bc9d54dd89539a5304b4fe03d/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:29.512727 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50402319-3aaa-4f23-8481-be25359b2a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4553bb1ab64f4a56a7a802584b5087da, user_id=de59a12bc9d54dd89539a5304b4fe03d, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:29.515434 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50402319-3aaa-4f23-8481-be25359b2a69 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:29.606778 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1209/2416] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:06:29 2022] PUT /identity/v3/projects/4553bb1ab64f4a56a7a802584b5087da/users/de59a12bc9d54dd89539a5304b4fe03d/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:06:29.616812 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f8196-e0c8-44fb-9952-78e4108ffdc7 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:29.617125 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f8196-e0c8-44fb-9952-78e4108ffdc7 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:29.617398 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f8196-e0c8-44fb-9952-78e4108ffdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:29.645618 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-cb4f8196-e0c8-44fb-9952-78e4108ffdc7 None None] MFA Rules not processed for user `de59a12bc9d54dd89539a5304b4fe03d`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:06:29.647014 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-cb4f8196-e0c8-44fb-9952-78e4108ffdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:29.710980 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1208/2417] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:06:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:06:29.715684 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50402319-3aaa-4f23-8481-be25359b2a69 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:29.776469 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50402319-3aaa-4f23-8481-be25359b2a69 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:29.781142 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e681f2-0727-464c-9699-274b307999fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:29.781840 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e681f2-0727-464c-9699-274b307999fe admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:29.782096 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e681f2-0727-464c-9699-274b307999fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:29.782366 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e681f2-0727-464c-9699-274b307999fe admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:29.783096 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e681f2-0727-464c-9699-274b307999fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:29.784970 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e681f2-0727-464c-9699-274b307999fe admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:29.882395 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1210/2418] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:06:29 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:06:29.886496 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f8196-e0c8-44fb-9952-78e4108ffdc7 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:29.897681 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f8196-e0c8-44fb-9952-78e4108ffdc7 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:29.952001 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d6e79-694c-4820-bb0a-5cf9052f75a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:29.952780 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d6e79-694c-4820-bb0a-5cf9052f75a8 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:29.953041 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d6e79-694c-4820-bb0a-5cf9052f75a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:29.953311 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d6e79-694c-4820-bb0a-5cf9052f75a8 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:29.953990 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d6e79-694c-4820-bb0a-5cf9052f75a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:29.955917 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825d6e79-694c-4820-bb0a-5cf9052f75a8 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:30.036958 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1209/2419] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:06:29 2022] POST /identity/v3/users => generated 292 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:06:30.040836 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e681f2-0727-464c-9699-274b307999fe admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:30.050887 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e681f2-0727-464c-9699-274b307999fe admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:30.055392 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74333a45-2d24-4f5e-a2a6-37c05f6c0203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:30.056034 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74333a45-2d24-4f5e-a2a6-37c05f6c0203 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:30.058227 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74333a45-2d24-4f5e-a2a6-37c05f6c0203 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:30.058227 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74333a45-2d24-4f5e-a2a6-37c05f6c0203 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:30.058227 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74333a45-2d24-4f5e-a2a6-37c05f6c0203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:30.059435 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74333a45-2d24-4f5e-a2a6-37c05f6c0203 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:30.069548 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1211/2420] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:06:30.074041 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d6e79-694c-4820-bb0a-5cf9052f75a8 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:30.083713 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d6e79-694c-4820-bb0a-5cf9052f75a8 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:30.088300 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b5770-1c38-48b5-b5a9-8597f7b7f573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:30.089674 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b5770-1c38-48b5-b5a9-8597f7b7f573 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:30.089949 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b5770-1c38-48b5-b5a9-8597f7b7f573 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:30.090218 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b5770-1c38-48b5-b5a9-8597f7b7f573 admin admin] PATH_INFO: `/v3/projects/45fbaa59adb541249cdbe39da0a22340/users/258640bcc50b4d7aa1d2a57693874e14/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:30.104174 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b5770-1c38-48b5-b5a9-8597f7b7f573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45fbaa59adb541249cdbe39da0a22340, user_id=258640bcc50b4d7aa1d2a57693874e14, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:30.107453 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b5770-1c38-48b5-b5a9-8597f7b7f573 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:30.185447 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1210/2421] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:06:30 2022] PUT /identity/v3/projects/45fbaa59adb541249cdbe39da0a22340/users/258640bcc50b4d7aa1d2a57693874e14/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:06:30.189450 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74333a45-2d24-4f5e-a2a6-37c05f6c0203 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:30.199450 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74333a45-2d24-4f5e-a2a6-37c05f6c0203 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:30.253551 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d82fec-df6d-4838-8927-ffdd36cb3aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:30.254130 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d82fec-df6d-4838-8927-ffdd36cb3aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:30.254404 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d82fec-df6d-4838-8927-ffdd36cb3aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:30.254679 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d82fec-df6d-4838-8927-ffdd36cb3aa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:30.255419 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d82fec-df6d-4838-8927-ffdd36cb3aa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:30.256995 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d82fec-df6d-4838-8927-ffdd36cb3aa2 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:30.266969 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1212/2422] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:06:30.271189 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b5770-1c38-48b5-b5a9-8597f7b7f573 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:30.281194 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b5770-1c38-48b5-b5a9-8597f7b7f573 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:30.285671 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498b172-5ed9-4851-ab7c-55cda84f8539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:30.286531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498b172-5ed9-4851-ab7c-55cda84f8539 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:30.286801 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498b172-5ed9-4851-ab7c-55cda84f8539 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:30.287089 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498b172-5ed9-4851-ab7c-55cda84f8539 admin admin] PATH_INFO: `/v3/projects/45fbaa59adb541249cdbe39da0a22340/users/258640bcc50b4d7aa1d2a57693874e14/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:30.289001 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498b172-5ed9-4851-ab7c-55cda84f8539 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45fbaa59adb541249cdbe39da0a22340, user_id=258640bcc50b4d7aa1d2a57693874e14, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:30.291644 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a498b172-5ed9-4851-ab7c-55cda84f8539 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:30.301427 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1211/2423] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:06:30 2022] PUT /identity/v3/projects/45fbaa59adb541249cdbe39da0a22340/users/258640bcc50b4d7aa1d2a57693874e14/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:06:30.312871 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88040df5-f10b-4336-b5c2-5533fc29d51b None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:30.313161 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88040df5-f10b-4336-b5c2-5533fc29d51b None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:30.313439 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88040df5-f10b-4336-b5c2-5533fc29d51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:30.339408 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-88040df5-f10b-4336-b5c2-5533fc29d51b None None] MFA Rules not processed for user `258640bcc50b4d7aa1d2a57693874e14`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:06:30.340642 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-88040df5-f10b-4336-b5c2-5533fc29d51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:30.406783 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1213/2424] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:06:30 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:06:30.417785 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498b172-5ed9-4851-ab7c-55cda84f8539 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:30.419655 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a498b172-5ed9-4851-ab7c-55cda84f8539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:30.474068 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498b172-5ed9-4851-ab7c-55cda84f8539 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:30.478432 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af208625-a538-4286-b6b7-747b40e6de18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:30.479113 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af208625-a538-4286-b6b7-747b40e6de18 service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:30.479422 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af208625-a538-4286-b6b7-747b40e6de18 service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:30.480282 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af208625-a538-4286-b6b7-747b40e6de18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:30.490744 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af208625-a538-4286-b6b7-747b40e6de18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:30.492208 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af208625-a538-4286-b6b7-747b40e6de18 service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:30.502566 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1212/2425] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:06:30 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:06:31.408901 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88040df5-f10b-4336-b5c2-5533fc29d51b None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:31.468657 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88040df5-f10b-4336-b5c2-5533fc29d51b None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:31.473309 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3acda-620f-4678-999c-d5b61630c2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:31.474157 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3acda-620f-4678-999c-d5b61630c2d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:31.474438 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3acda-620f-4678-999c-d5b61630c2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:31.474708 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a3acda-620f-4678-999c-d5b61630c2d1 admin admin] PATH_INFO: `/v3/users/de59a12bc9d54dd89539a5304b4fe03d` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:31.475903 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3acda-620f-4678-999c-d5b61630c2d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de59a12bc9d54dd89539a5304b4fe03d)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:31.477803 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a3acda-620f-4678-999c-d5b61630c2d1 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:31.605012 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-c8a3acda-620f-4678-999c-d5b61630c2d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de59a12bc9d54dd89539a5304b4fe03d'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:31.683654 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-c8a3acda-620f-4678-999c-d5b61630c2d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de59a12bc9d54dd89539a5304b4fe03d'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:31.687059 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-c8a3acda-620f-4678-999c-d5b61630c2d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de59a12bc9d54dd89539a5304b4fe03d'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:31.691754 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-c8a3acda-620f-4678-999c-d5b61630c2d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de59a12bc9d54dd89539a5304b4fe03d'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:31.704521 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-c8a3acda-620f-4678-999c-d5b61630c2d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de59a12bc9d54dd89539a5304b4fe03d'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:31.710400 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1214/2426] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:06:31 2022] DELETE /identity/v3/users/de59a12bc9d54dd89539a5304b4fe03d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:06:31.715007 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e76acc-58f4-41e4-876f-78517a555611 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:31.715503 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e76acc-58f4-41e4-876f-78517a555611 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:31.715780 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e76acc-58f4-41e4-876f-78517a555611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:31.733365 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-f7e76acc-58f4-41e4-876f-78517a555611 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:06:31.734958 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-f7e76acc-58f4-41e4-876f-78517a555611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:31.799687 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1213/2427] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:06:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:06:31.809852 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3acda-620f-4678-999c-d5b61630c2d1 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:31.811406 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-c8a3acda-620f-4678-999c-d5b61630c2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:31.894526 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a3acda-620f-4678-999c-d5b61630c2d1 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:31.899787 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303155d-a040-4f8b-b59d-9d0e6978efae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:31.900436 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303155d-a040-4f8b-b59d-9d0e6978efae service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:31.900713 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303155d-a040-4f8b-b59d-9d0e6978efae service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:31.900985 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303155d-a040-4f8b-b59d-9d0e6978efae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:31.913548 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303155d-a040-4f8b-b59d-9d0e6978efae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:31.915026 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e303155d-a040-4f8b-b59d-9d0e6978efae service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:31.925323 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1215/2428] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:06:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:06:32.341979 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e76acc-58f4-41e4-876f-78517a555611 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:32.341979 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-f7e76acc-58f4-41e4-876f-78517a555611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:32.361058 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e76acc-58f4-41e4-876f-78517a555611 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:32.378085 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f435d5-305c-4aa6-9bb6-c16a8f31985b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:32.379008 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f435d5-305c-4aa6-9bb6-c16a8f31985b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:32.379295 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f435d5-305c-4aa6-9bb6-c16a8f31985b admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:32.379563 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f435d5-305c-4aa6-9bb6-c16a8f31985b admin admin] PATH_INFO: `/v3/projects/4553bb1ab64f4a56a7a802584b5087da` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:32.380784 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f435d5-305c-4aa6-9bb6-c16a8f31985b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4553bb1ab64f4a56a7a802584b5087da)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:32.382939 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f435d5-305c-4aa6-9bb6-c16a8f31985b admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:32.487494 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-41f435d5-305c-4aa6-9bb6-c16a8f31985b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4553bb1ab64f4a56a7a802584b5087da', 'request_id': 'req-41f435d5-305c-4aa6-9bb6-c16a8f31985b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:32.492880 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-41f435d5-305c-4aa6-9bb6-c16a8f31985b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4553bb1ab64f4a56a7a802584b5087da', 'request_id': 'req-41f435d5-305c-4aa6-9bb6-c16a8f31985b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:32.576961 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-41f435d5-305c-4aa6-9bb6-c16a8f31985b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4553bb1ab64f4a56a7a802584b5087da', 'request_id': 'req-41f435d5-305c-4aa6-9bb6-c16a8f31985b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:32.585895 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-41f435d5-305c-4aa6-9bb6-c16a8f31985b admin admin] The token cache is being invalidate because project 4553bb1ab64f4a56a7a802584b5087da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:06:32.586351 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-41f435d5-305c-4aa6-9bb6-c16a8f31985b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:32.587047 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-41f435d5-305c-4aa6-9bb6-c16a8f31985b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:32.589457 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1214/2429] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:06:32 2022] DELETE /identity/v3/projects/4553bb1ab64f4a56a7a802584b5087da => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:06:32.593436 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303155d-a040-4f8b-b59d-9d0e6978efae service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:32.603509 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303155d-a040-4f8b-b59d-9d0e6978efae service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:32.664225 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144be54-7858-4bdc-9085-647396119769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:32.665086 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144be54-7858-4bdc-9085-647396119769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:32.665360 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144be54-7858-4bdc-9085-647396119769 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:32.665627 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144be54-7858-4bdc-9085-647396119769 admin admin] PATH_INFO: `/v3/users/258640bcc50b4d7aa1d2a57693874e14` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:32.666828 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144be54-7858-4bdc-9085-647396119769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=258640bcc50b4d7aa1d2a57693874e14)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:32.669347 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144be54-7858-4bdc-9085-647396119769 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:33.144046 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4144be54-7858-4bdc-9085-647396119769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '258640bcc50b4d7aa1d2a57693874e14'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:33.206624 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4144be54-7858-4bdc-9085-647396119769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '258640bcc50b4d7aa1d2a57693874e14'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:33.207439 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4144be54-7858-4bdc-9085-647396119769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '258640bcc50b4d7aa1d2a57693874e14'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:33.216163 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4144be54-7858-4bdc-9085-647396119769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '258640bcc50b4d7aa1d2a57693874e14'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:33.228772 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4144be54-7858-4bdc-9085-647396119769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '258640bcc50b4d7aa1d2a57693874e14'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:33.241045 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1216/2430] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:06:32 2022] DELETE /identity/v3/users/258640bcc50b4d7aa1d2a57693874e14 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:06:33.811782 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f435d5-305c-4aa6-9bb6-c16a8f31985b admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:33.813543 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-41f435d5-305c-4aa6-9bb6-c16a8f31985b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:33.829325 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f435d5-305c-4aa6-9bb6-c16a8f31985b admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:33.893431 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c8020-c1f8-4763-8fa8-7715300ec8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:33.897820 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c8020-c1f8-4763-8fa8-7715300ec8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:33.897820 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c8020-c1f8-4763-8fa8-7715300ec8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:33.897820 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c8020-c1f8-4763-8fa8-7715300ec8d3 admin admin] PATH_INFO: `/v3/projects/45fbaa59adb541249cdbe39da0a22340` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:33.897820 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c8020-c1f8-4763-8fa8-7715300ec8d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45fbaa59adb541249cdbe39da0a22340)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:33.898642 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c8020-c1f8-4763-8fa8-7715300ec8d3 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:33.996615 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-eb0c8020-c1f8-4763-8fa8-7715300ec8d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45fbaa59adb541249cdbe39da0a22340', 'request_id': 'req-eb0c8020-c1f8-4763-8fa8-7715300ec8d3'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:34.002180 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-eb0c8020-c1f8-4763-8fa8-7715300ec8d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45fbaa59adb541249cdbe39da0a22340', 'request_id': 'req-eb0c8020-c1f8-4763-8fa8-7715300ec8d3'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:34.100432 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-eb0c8020-c1f8-4763-8fa8-7715300ec8d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45fbaa59adb541249cdbe39da0a22340', 'request_id': 'req-eb0c8020-c1f8-4763-8fa8-7715300ec8d3'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:34.112851 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-eb0c8020-c1f8-4763-8fa8-7715300ec8d3 admin admin] The token cache is being invalidate because project 45fbaa59adb541249cdbe39da0a22340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:06:34.113135 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-eb0c8020-c1f8-4763-8fa8-7715300ec8d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:34.113772 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-eb0c8020-c1f8-4763-8fa8-7715300ec8d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:34.115394 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1215/2431] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:06:33 2022] DELETE /identity/v3/projects/45fbaa59adb541249cdbe39da0a22340 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:06:34.120227 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2e7c4-a468-4638-8f75-e78795051262 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:34.120783 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2e7c4-a468-4638-8f75-e78795051262 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:34.120931 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef2e7c4-a468-4638-8f75-e78795051262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:34.139184 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-aef2e7c4-a468-4638-8f75-e78795051262 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:06:34.140722 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-aef2e7c4-a468-4638-8f75-e78795051262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:34.199577 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1217/2432] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:06:34.210432 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f9437-64d3-4c33-b2fc-70ed229028cd None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:34.210719 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f9437-64d3-4c33-b2fc-70ed229028cd None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:34.211021 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66f9437-64d3-4c33-b2fc-70ed229028cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:34.229605 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-f66f9437-64d3-4c33-b2fc-70ed229028cd None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:06:34.230862 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-f66f9437-64d3-4c33-b2fc-70ed229028cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:34.240238 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1216/2433] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:06:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:06:34.244502 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2e7c4-a468-4638-8f75-e78795051262 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:34.254320 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef2e7c4-a468-4638-8f75-e78795051262 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:34.258904 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c4bef-a274-4b18-bcfa-5740e0d512b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:34.259552 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c4bef-a274-4b18-bcfa-5740e0d512b7 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:34.259833 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c4bef-a274-4b18-bcfa-5740e0d512b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:34.260100 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93c4bef-a274-4b18-bcfa-5740e0d512b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:34.261328 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c4bef-a274-4b18-bcfa-5740e0d512b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:06:34.261623 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c4bef-a274-4b18-bcfa-5740e0d512b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:34.263247 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93c4bef-a274-4b18-bcfa-5740e0d512b7 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:34.275465 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1218/2434] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:06:34.280324 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f9437-64d3-4c33-b2fc-70ed229028cd None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:34.289765 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66f9437-64d3-4c33-b2fc-70ed229028cd None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:34.294612 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85260aa7-e3d4-48b8-befd-c6d4c6cee60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:34.295279 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85260aa7-e3d4-48b8-befd-c6d4c6cee60e admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:34.295554 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85260aa7-e3d4-48b8-befd-c6d4c6cee60e admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:34.295820 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85260aa7-e3d4-48b8-befd-c6d4c6cee60e admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:34.296502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85260aa7-e3d4-48b8-befd-c6d4c6cee60e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:34.298371 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85260aa7-e3d4-48b8-befd-c6d4c6cee60e admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:34.376554 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1217/2435] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:06:34 2022] POST /identity/v3/projects => generated 409 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:06:34.381998 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c4bef-a274-4b18-bcfa-5740e0d512b7 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:34.392237 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93c4bef-a274-4b18-bcfa-5740e0d512b7 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:34.444125 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca55fff-21e8-4c84-abf3-0aaa90dfa867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:34.444775 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca55fff-21e8-4c84-abf3-0aaa90dfa867 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:34.445051 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca55fff-21e8-4c84-abf3-0aaa90dfa867 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:34.445320 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca55fff-21e8-4c84-abf3-0aaa90dfa867 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:34.446006 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca55fff-21e8-4c84-abf3-0aaa90dfa867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:34.447940 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca55fff-21e8-4c84-abf3-0aaa90dfa867 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:34.551244 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1219/2436] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:06:34 2022] POST /identity/v3/users => generated 305 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:06:34.555283 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85260aa7-e3d4-48b8-befd-c6d4c6cee60e admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:34.565999 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85260aa7-e3d4-48b8-befd-c6d4c6cee60e admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:34.570602 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5bb8f-b24b-4dc7-9648-995e21b3cb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:34.571289 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5bb8f-b24b-4dc7-9648-995e21b3cb75 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:34.571566 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5bb8f-b24b-4dc7-9648-995e21b3cb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:34.571836 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a5bb8f-b24b-4dc7-9648-995e21b3cb75 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:34.572551 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5bb8f-b24b-4dc7-9648-995e21b3cb75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:34.574742 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a5bb8f-b24b-4dc7-9648-995e21b3cb75 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:34.584791 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1218/2437] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:06:34.588537 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca55fff-21e8-4c84-abf3-0aaa90dfa867 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:34.598233 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca55fff-21e8-4c84-abf3-0aaa90dfa867 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:34.603052 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ea0aef-b724-4fab-a516-8b5d897c5441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:34.603701 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea0aef-b724-4fab-a516-8b5d897c5441 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:34.603980 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea0aef-b724-4fab-a516-8b5d897c5441 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:34.604254 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ea0aef-b724-4fab-a516-8b5d897c5441 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:34.604979 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea0aef-b724-4fab-a516-8b5d897c5441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:34.606587 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ea0aef-b724-4fab-a516-8b5d897c5441 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:34.616805 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1220/2438] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:06:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:06:34.621224 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5bb8f-b24b-4dc7-9648-995e21b3cb75 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:34.630797 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a5bb8f-b24b-4dc7-9648-995e21b3cb75 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:34.635355 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c8354-051f-49f9-a953-e709adb2c008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:34.636871 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c8354-051f-49f9-a953-e709adb2c008 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:34.637143 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c8354-051f-49f9-a953-e709adb2c008 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:34.637410 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384c8354-051f-49f9-a953-e709adb2c008 admin admin] PATH_INFO: `/v3/projects/b1aab7605fd248d083b9ec4fdbac7cf0/users/df3f596b8b7649abb49502b470f39a19/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:34.651290 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c8354-051f-49f9-a953-e709adb2c008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1aab7605fd248d083b9ec4fdbac7cf0, user_id=df3f596b8b7649abb49502b470f39a19, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:34.654526 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384c8354-051f-49f9-a953-e709adb2c008 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:34.712382 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1219/2439] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:06:34 2022] PUT /identity/v3/projects/b1aab7605fd248d083b9ec4fdbac7cf0/users/df3f596b8b7649abb49502b470f39a19/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:06:34.722976 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8950cd5-89bb-4efd-b25c-67f72baa48b0 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:34.723307 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8950cd5-89bb-4efd-b25c-67f72baa48b0 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:34.723549 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8950cd5-89bb-4efd-b25c-67f72baa48b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:34.750636 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-c8950cd5-89bb-4efd-b25c-67f72baa48b0 None None] MFA Rules not processed for user `df3f596b8b7649abb49502b470f39a19`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:06:34.751921 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-c8950cd5-89bb-4efd-b25c-67f72baa48b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:34.818533 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1221/2440] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:06:34 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:06:34.822905 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c8354-051f-49f9-a953-e709adb2c008 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:34.883498 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384c8354-051f-49f9-a953-e709adb2c008 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:34.888636 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6f07f-7d07-40b3-b40d-0dd13cb55592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:34.889285 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6f07f-7d07-40b3-b40d-0dd13cb55592 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:34.889559 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6f07f-7d07-40b3-b40d-0dd13cb55592 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:34.889827 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6f07f-7d07-40b3-b40d-0dd13cb55592 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:34.890643 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6f07f-7d07-40b3-b40d-0dd13cb55592 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:34.892759 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6f07f-7d07-40b3-b40d-0dd13cb55592 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:34.964516 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1220/2441] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:06:34 2022] POST /identity/v3/projects => generated 409 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:06:34.968398 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8950cd5-89bb-4efd-b25c-67f72baa48b0 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:34.979213 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8950cd5-89bb-4efd-b25c-67f72baa48b0 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:35.033695 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095aabb-7fc7-4f83-98c4-300f8d414e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:35.034346 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095aabb-7fc7-4f83-98c4-300f8d414e3c admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:35.034630 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095aabb-7fc7-4f83-98c4-300f8d414e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:35.034936 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095aabb-7fc7-4f83-98c4-300f8d414e3c admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:35.035628 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095aabb-7fc7-4f83-98c4-300f8d414e3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:35.037520 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095aabb-7fc7-4f83-98c4-300f8d414e3c admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:35.134943 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1222/2442] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:06:34 2022] POST /identity/v3/users => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:06:35.138990 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6f07f-7d07-40b3-b40d-0dd13cb55592 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:35.149584 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6f07f-7d07-40b3-b40d-0dd13cb55592 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:35.154189 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936ef45-ef7c-4831-945c-1fce8525a2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:35.154845 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936ef45-ef7c-4831-945c-1fce8525a2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:35.155133 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936ef45-ef7c-4831-945c-1fce8525a2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:35.155404 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f936ef45-ef7c-4831-945c-1fce8525a2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:35.156142 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936ef45-ef7c-4831-945c-1fce8525a2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:35.157707 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f936ef45-ef7c-4831-945c-1fce8525a2c6 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:35.168258 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1221/2443] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:06:35.172070 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095aabb-7fc7-4f83-98c4-300f8d414e3c admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:35.181810 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095aabb-7fc7-4f83-98c4-300f8d414e3c admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:35.187046 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f170bda-3d23-4ded-a04c-6870ce9e867b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:35.187927 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f170bda-3d23-4ded-a04c-6870ce9e867b admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:35.188202 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f170bda-3d23-4ded-a04c-6870ce9e867b admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:35.188474 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f170bda-3d23-4ded-a04c-6870ce9e867b admin admin] PATH_INFO: `/v3/projects/e026f19c2ac0439fa48516d53852299c/users/72ef106b056b4017af385b23f736b508/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:35.202417 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f170bda-3d23-4ded-a04c-6870ce9e867b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e026f19c2ac0439fa48516d53852299c, user_id=72ef106b056b4017af385b23f736b508, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:35.205052 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f170bda-3d23-4ded-a04c-6870ce9e867b admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:35.271432 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1223/2444] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:06:35 2022] PUT /identity/v3/projects/e026f19c2ac0439fa48516d53852299c/users/72ef106b056b4017af385b23f736b508/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:06:35.275297 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936ef45-ef7c-4831-945c-1fce8525a2c6 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:35.287843 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f936ef45-ef7c-4831-945c-1fce8525a2c6 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:35.347877 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a21a89a-3960-4c3a-9a42-a03b767775ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:35.348536 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21a89a-3960-4c3a-9a42-a03b767775ac admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:35.348812 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21a89a-3960-4c3a-9a42-a03b767775ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:35.349079 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a21a89a-3960-4c3a-9a42-a03b767775ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:35.349824 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21a89a-3960-4c3a-9a42-a03b767775ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:35.351714 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a21a89a-3960-4c3a-9a42-a03b767775ac admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:35.361745 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1222/2445] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:06:35.365858 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f170bda-3d23-4ded-a04c-6870ce9e867b admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:35.376756 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f170bda-3d23-4ded-a04c-6870ce9e867b admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:35.382230 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ceb6e-f998-46c5-9399-3c723c997503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:35.383680 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ceb6e-f998-46c5-9399-3c723c997503 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:35.384136 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ceb6e-f998-46c5-9399-3c723c997503 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:35.384876 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1ceb6e-f998-46c5-9399-3c723c997503 admin admin] PATH_INFO: `/v3/projects/e026f19c2ac0439fa48516d53852299c/users/72ef106b056b4017af385b23f736b508/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:35.389370 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ceb6e-f998-46c5-9399-3c723c997503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e026f19c2ac0439fa48516d53852299c, user_id=72ef106b056b4017af385b23f736b508, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:35.390278 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1ceb6e-f998-46c5-9399-3c723c997503 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:35.401053 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1224/2446] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:06:35 2022] PUT /identity/v3/projects/e026f19c2ac0439fa48516d53852299c/users/72ef106b056b4017af385b23f736b508/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:06:35.412229 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e0963-455a-47ae-a62f-4ed9aa986c77 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:35.412591 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e0963-455a-47ae-a62f-4ed9aa986c77 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:35.412866 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e0963-455a-47ae-a62f-4ed9aa986c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:35.440111 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-933e0963-455a-47ae-a62f-4ed9aa986c77 None None] MFA Rules not processed for user `72ef106b056b4017af385b23f736b508`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:06:35.441345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-933e0963-455a-47ae-a62f-4ed9aa986c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:35.508662 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1223/2447] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:06:35 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:06:35.519850 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ceb6e-f998-46c5-9399-3c723c997503 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:35.521736 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-8c1ceb6e-f998-46c5-9399-3c723c997503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:35.578341 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1ceb6e-f998-46c5-9399-3c723c997503 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:35.581980 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d514dc-214b-4fe8-a5f1-44bc67a67640 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:35.582621 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d514dc-214b-4fe8-a5f1-44bc67a67640 service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:35.582944 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d514dc-214b-4fe8-a5f1-44bc67a67640 service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:35.583222 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d514dc-214b-4fe8-a5f1-44bc67a67640 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:35.592572 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d514dc-214b-4fe8-a5f1-44bc67a67640 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:35.594012 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d514dc-214b-4fe8-a5f1-44bc67a67640 service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:35.604003 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1225/2448] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:06:35 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:06:35.951782 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e0963-455a-47ae-a62f-4ed9aa986c77 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:35.961352 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e0963-455a-47ae-a62f-4ed9aa986c77 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:35.965037 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156ef35-6ca7-4107-a46a-fa5f6005f9a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:35.965744 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156ef35-6ca7-4107-a46a-fa5f6005f9a9 service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:35.965981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156ef35-6ca7-4107-a46a-fa5f6005f9a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:35.966256 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156ef35-6ca7-4107-a46a-fa5f6005f9a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:36.022672 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156ef35-6ca7-4107-a46a-fa5f6005f9a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:36.024168 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a156ef35-6ca7-4107-a46a-fa5f6005f9a9 service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:36.033310 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1224/2449] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:06:35 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:06:48.313731 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a9eb3-addd-4ed8-9560-1b84f02d4dc8 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:48.314309 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a9eb3-addd-4ed8-9560-1b84f02d4dc8 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:48.314309 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a9eb3-addd-4ed8-9560-1b84f02d4dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:48.334166 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-db5a9eb3-addd-4ed8-9560-1b84f02d4dc8 None None] MFA Rules not processed for user `0cc30086244243e09118bbd25fae7539`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:06:48.335407 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-db5a9eb3-addd-4ed8-9560-1b84f02d4dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:48.391409 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1226/2450] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:06:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:06:48.425082 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156ef35-6ca7-4107-a46a-fa5f6005f9a9 service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:48.426550 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a156ef35-6ca7-4107-a46a-fa5f6005f9a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:48.481673 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156ef35-6ca7-4107-a46a-fa5f6005f9a9 service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:48.485749 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a41cfc-f7e3-45b0-b93a-10f56f01b28f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2ad9c7f930e426bb908237f72c04a2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:48.486386 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a41cfc-f7e3-45b0-b93a-10f56f01b28f service glance] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:48.486665 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a41cfc-f7e3-45b0-b93a-10f56f01b28f service glance] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:48.486970 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a41cfc-f7e3-45b0-b93a-10f56f01b28f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:48.488762 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-99a41cfc-f7e3-45b0-b93a-10f56f01b28f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:48.687579 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a41cfc-f7e3-45b0-b93a-10f56f01b28f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:48.689053 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a41cfc-f7e3-45b0-b93a-10f56f01b28f service glance] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:48.699959 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1225/2451] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:06:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:06:48.897288 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a9eb3-addd-4ed8-9560-1b84f02d4dc8 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:48.902233 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-db5a9eb3-addd-4ed8-9560-1b84f02d4dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:48.956052 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a9eb3-addd-4ed8-9560-1b84f02d4dc8 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:48.959492 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fb163-8518-4c07-aa31-54f39011ed57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:48.960111 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fb163-8518-4c07-aa31-54f39011ed57 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:48.960387 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fb163-8518-4c07-aa31-54f39011ed57 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:48.960653 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fb163-8518-4c07-aa31-54f39011ed57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:48.962398 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-aa5fb163-8518-4c07-aa31-54f39011ed57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:48.971895 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fb163-8518-4c07-aa31-54f39011ed57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:48.973296 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fb163-8518-4c07-aa31-54f39011ed57 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:48.981517 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1227/2452] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:06:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:06:49.576570 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a41cfc-f7e3-45b0-b93a-10f56f01b28f service glance] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:49.581024 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-99a41cfc-f7e3-45b0-b93a-10f56f01b28f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:49.585112 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fb163-8518-4c07-aa31-54f39011ed57 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:49.593735 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fb163-8518-4c07-aa31-54f39011ed57 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:49.597312 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae8b43-2dd5-4f08-a821-81b7d7d9553d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:49.597939 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae8b43-2dd5-4f08-a821-81b7d7d9553d service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:49.598214 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae8b43-2dd5-4f08-a821-81b7d7d9553d service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:49.598484 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae8b43-2dd5-4f08-a821-81b7d7d9553d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:49.600279 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-0fae8b43-2dd5-4f08-a821-81b7d7d9553d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:49.614704 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae8b43-2dd5-4f08-a821-81b7d7d9553d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:49.616179 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae8b43-2dd5-4f08-a821-81b7d7d9553d service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:49.628021 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1228/2453] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:06:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:06:49.645547 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a41cfc-f7e3-45b0-b93a-10f56f01b28f service glance] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:49.650852 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e615c0c0-b8ff-4038-adf5-2217ba1c3fb7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47515442e0e84441bed4bfbb7a3b4ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:49.651521 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615c0c0-b8ff-4038-adf5-2217ba1c3fb7 service placement] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:49.651799 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615c0c0-b8ff-4038-adf5-2217ba1c3fb7 service placement] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:49.652064 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e615c0c0-b8ff-4038-adf5-2217ba1c3fb7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:49.653838 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-e615c0c0-b8ff-4038-adf5-2217ba1c3fb7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:49.665700 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615c0c0-b8ff-4038-adf5-2217ba1c3fb7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:49.667283 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e615c0c0-b8ff-4038-adf5-2217ba1c3fb7 service placement] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:49.681190 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1226/2454] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:06:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:06:50.003018 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae8b43-2dd5-4f08-a821-81b7d7d9553d service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:50.064408 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae8b43-2dd5-4f08-a821-81b7d7d9553d service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:50.068899 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7cbde-eba5-43fe-a1e1-e71ec3eb39ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:50.073780 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7cbde-eba5-43fe-a1e1-e71ec3eb39ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:50.073780 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7cbde-eba5-43fe-a1e1-e71ec3eb39ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:50.073780 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c7cbde-eba5-43fe-a1e1-e71ec3eb39ef admin admin] PATH_INFO: `/v3/users/df3f596b8b7649abb49502b470f39a19` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:50.073780 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7cbde-eba5-43fe-a1e1-e71ec3eb39ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=df3f596b8b7649abb49502b470f39a19)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:50.073780 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c7cbde-eba5-43fe-a1e1-e71ec3eb39ef admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:50.239070 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-97c7cbde-eba5-43fe-a1e1-e71ec3eb39ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df3f596b8b7649abb49502b470f39a19'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:50.326426 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-97c7cbde-eba5-43fe-a1e1-e71ec3eb39ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df3f596b8b7649abb49502b470f39a19'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:50.327032 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-97c7cbde-eba5-43fe-a1e1-e71ec3eb39ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df3f596b8b7649abb49502b470f39a19'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:50.334065 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-97c7cbde-eba5-43fe-a1e1-e71ec3eb39ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df3f596b8b7649abb49502b470f39a19'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:50.345907 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-97c7cbde-eba5-43fe-a1e1-e71ec3eb39ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df3f596b8b7649abb49502b470f39a19'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:50.351793 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1229/2455] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:06:50 2022] DELETE /identity/v3/users/df3f596b8b7649abb49502b470f39a19 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:06:50.356279 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28788509-d5a5-4711-ad5d-c16cfb3a4044 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:50.356566 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28788509-d5a5-4711-ad5d-c16cfb3a4044 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:50.361716 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28788509-d5a5-4711-ad5d-c16cfb3a4044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:50.374397 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-28788509-d5a5-4711-ad5d-c16cfb3a4044 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:06:50.375606 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-28788509-d5a5-4711-ad5d-c16cfb3a4044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:50.430641 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1227/2456] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:06:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:06:50.441015 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7cbde-eba5-43fe-a1e1-e71ec3eb39ef admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:50.442390 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-97c7cbde-eba5-43fe-a1e1-e71ec3eb39ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:50.499902 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c7cbde-eba5-43fe-a1e1-e71ec3eb39ef admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:50.503657 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded15024-1796-44b3-9c90-000c86123dd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:50.504323 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded15024-1796-44b3-9c90-000c86123dd2 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:50.504604 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded15024-1796-44b3-9c90-000c86123dd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:50.504877 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded15024-1796-44b3-9c90-000c86123dd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:50.514653 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded15024-1796-44b3-9c90-000c86123dd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:50.516142 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded15024-1796-44b3-9c90-000c86123dd2 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:50.525778 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1230/2457] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:06:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:06:50.916479 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28788509-d5a5-4711-ad5d-c16cfb3a4044 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:50.918072 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-28788509-d5a5-4711-ad5d-c16cfb3a4044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:50.935056 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28788509-d5a5-4711-ad5d-c16cfb3a4044 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:50.940149 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b768d-17c0-4018-bac7-75a6e0f8a8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:50.941028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b768d-17c0-4018-bac7-75a6e0f8a8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:50.942984 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b768d-17c0-4018-bac7-75a6e0f8a8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:50.942984 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b768d-17c0-4018-bac7-75a6e0f8a8d5 admin admin] PATH_INFO: `/v3/projects/b1aab7605fd248d083b9ec4fdbac7cf0` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:50.942984 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b768d-17c0-4018-bac7-75a6e0f8a8d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1aab7605fd248d083b9ec4fdbac7cf0)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:50.944741 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b768d-17c0-4018-bac7-75a6e0f8a8d5 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:51.054800 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6d2b768d-17c0-4018-bac7-75a6e0f8a8d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1aab7605fd248d083b9ec4fdbac7cf0', 'request_id': 'req-6d2b768d-17c0-4018-bac7-75a6e0f8a8d5'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:51.060158 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6d2b768d-17c0-4018-bac7-75a6e0f8a8d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1aab7605fd248d083b9ec4fdbac7cf0', 'request_id': 'req-6d2b768d-17c0-4018-bac7-75a6e0f8a8d5'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:51.128579 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6d2b768d-17c0-4018-bac7-75a6e0f8a8d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1aab7605fd248d083b9ec4fdbac7cf0', 'request_id': 'req-6d2b768d-17c0-4018-bac7-75a6e0f8a8d5'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:51.139866 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6d2b768d-17c0-4018-bac7-75a6e0f8a8d5 admin admin] The token cache is being invalidate because project b1aab7605fd248d083b9ec4fdbac7cf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:06:51.140147 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6d2b768d-17c0-4018-bac7-75a6e0f8a8d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:51.140764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6d2b768d-17c0-4018-bac7-75a6e0f8a8d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:51.142297 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1228/2458] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:06:50 2022] DELETE /identity/v3/projects/b1aab7605fd248d083b9ec4fdbac7cf0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:06:51.146252 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded15024-1796-44b3-9c90-000c86123dd2 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:51.156427 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded15024-1796-44b3-9c90-000c86123dd2 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:51.210406 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f1761-6ff1-4561-a95b-ec043617468a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:51.211254 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f1761-6ff1-4561-a95b-ec043617468a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:51.211535 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f1761-6ff1-4561-a95b-ec043617468a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:51.211807 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f1761-6ff1-4561-a95b-ec043617468a admin admin] PATH_INFO: `/v3/users/72ef106b056b4017af385b23f736b508` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:51.212997 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f1761-6ff1-4561-a95b-ec043617468a admin admin] RBAC: Authorizing `identity:delete_user(user_id=72ef106b056b4017af385b23f736b508)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:51.214947 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f1761-6ff1-4561-a95b-ec043617468a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:51.353542 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-364f1761-6ff1-4561-a95b-ec043617468a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72ef106b056b4017af385b23f736b508'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:51.400210 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-364f1761-6ff1-4561-a95b-ec043617468a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72ef106b056b4017af385b23f736b508'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:51.400836 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-364f1761-6ff1-4561-a95b-ec043617468a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72ef106b056b4017af385b23f736b508'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:51.408774 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-364f1761-6ff1-4561-a95b-ec043617468a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72ef106b056b4017af385b23f736b508'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:51.420600 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-364f1761-6ff1-4561-a95b-ec043617468a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72ef106b056b4017af385b23f736b508'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:51.426420 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1231/2459] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:06:51 2022] DELETE /identity/v3/users/72ef106b056b4017af385b23f736b508 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:06:51.973471 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b768d-17c0-4018-bac7-75a6e0f8a8d5 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:51.974953 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-6d2b768d-17c0-4018-bac7-75a6e0f8a8d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:51.989665 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b768d-17c0-4018-bac7-75a6e0f8a8d5 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:52.046653 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdedd38-c7b2-4647-8150-b9e039b3b110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:52.047461 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdedd38-c7b2-4647-8150-b9e039b3b110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:52.047740 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdedd38-c7b2-4647-8150-b9e039b3b110 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:52.048015 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdedd38-c7b2-4647-8150-b9e039b3b110 admin admin] PATH_INFO: `/v3/projects/e026f19c2ac0439fa48516d53852299c` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:52.049190 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdedd38-c7b2-4647-8150-b9e039b3b110 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e026f19c2ac0439fa48516d53852299c)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:52.051334 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdedd38-c7b2-4647-8150-b9e039b3b110 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:52.186568 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-cfdedd38-c7b2-4647-8150-b9e039b3b110 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e026f19c2ac0439fa48516d53852299c', 'request_id': 'req-cfdedd38-c7b2-4647-8150-b9e039b3b110'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:52.191859 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-cfdedd38-c7b2-4647-8150-b9e039b3b110 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e026f19c2ac0439fa48516d53852299c', 'request_id': 'req-cfdedd38-c7b2-4647-8150-b9e039b3b110'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:52.263009 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-cfdedd38-c7b2-4647-8150-b9e039b3b110 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e026f19c2ac0439fa48516d53852299c', 'request_id': 'req-cfdedd38-c7b2-4647-8150-b9e039b3b110'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:52.274997 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-cfdedd38-c7b2-4647-8150-b9e039b3b110 admin admin] The token cache is being invalidate because project e026f19c2ac0439fa48516d53852299c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:06:52.275280 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-cfdedd38-c7b2-4647-8150-b9e039b3b110 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:52.275908 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-cfdedd38-c7b2-4647-8150-b9e039b3b110 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:52.277426 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1229/2460] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:06:51 2022] DELETE /identity/v3/projects/e026f19c2ac0439fa48516d53852299c => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:06:52.282265 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf962e-b4e1-46ac-94d1-c88661c1bec7 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:52.282751 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf962e-b4e1-46ac-94d1-c88661c1bec7 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:52.282889 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bf962e-b4e1-46ac-94d1-c88661c1bec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:52.302207 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-41bf962e-b4e1-46ac-94d1-c88661c1bec7 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:06:52.303402 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-41bf962e-b4e1-46ac-94d1-c88661c1bec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:52.361656 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1232/2461] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:06:52.369378 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f256b-d091-4f9e-a559-456fa998118c None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:52.369658 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f256b-d091-4f9e-a559-456fa998118c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:52.369924 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f256b-d091-4f9e-a559-456fa998118c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:52.387566 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-8a7f256b-d091-4f9e-a559-456fa998118c None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:06:52.391076 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-8a7f256b-d091-4f9e-a559-456fa998118c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:52.396396 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1230/2462] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:06:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:06:52.400340 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf962e-b4e1-46ac-94d1-c88661c1bec7 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:52.409937 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bf962e-b4e1-46ac-94d1-c88661c1bec7 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:52.414575 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37047e-c38a-4ad5-a1b0-15faeb7c6b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:52.415250 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37047e-c38a-4ad5-a1b0-15faeb7c6b7b admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:52.415530 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37047e-c38a-4ad5-a1b0-15faeb7c6b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:52.415803 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37047e-c38a-4ad5-a1b0-15faeb7c6b7b admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:52.416575 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37047e-c38a-4ad5-a1b0-15faeb7c6b7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:06:52.416991 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37047e-c38a-4ad5-a1b0-15faeb7c6b7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:52.419000 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37047e-c38a-4ad5-a1b0-15faeb7c6b7b admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:52.430567 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1233/2463] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:06:52.439108 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f256b-d091-4f9e-a559-456fa998118c None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:52.448326 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f256b-d091-4f9e-a559-456fa998118c None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:52.453031 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4d491-aadc-41b1-9353-810af8658bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:52.453684 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4d491-aadc-41b1-9353-810af8658bdb admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:52.453962 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4d491-aadc-41b1-9353-810af8658bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:52.454347 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4d491-aadc-41b1-9353-810af8658bdb admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:52.455085 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4d491-aadc-41b1-9353-810af8658bdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:52.456984 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4d491-aadc-41b1-9353-810af8658bdb admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:52.533352 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1231/2464] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:06:52 2022] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:06:52.534826 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37047e-c38a-4ad5-a1b0-15faeb7c6b7b admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:52.544706 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37047e-c38a-4ad5-a1b0-15faeb7c6b7b admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:52.599747 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed9752-8675-43f0-a8b9-3dfbb46d33a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:52.600334 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed9752-8675-43f0-a8b9-3dfbb46d33a9 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:52.600618 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed9752-8675-43f0-a8b9-3dfbb46d33a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:52.600893 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed9752-8675-43f0-a8b9-3dfbb46d33a9 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:52.601613 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed9752-8675-43f0-a8b9-3dfbb46d33a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:52.603562 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed9752-8675-43f0-a8b9-3dfbb46d33a9 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:52.698021 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1234/2465] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:06:52 2022] POST /identity/v3/users => generated 291 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:06:52.701781 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4d491-aadc-41b1-9353-810af8658bdb admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:52.711879 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4d491-aadc-41b1-9353-810af8658bdb admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:52.716976 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9607c-84d1-46c3-be47-b145b992dc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:52.717748 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9607c-84d1-46c3-be47-b145b992dc9a admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:52.718027 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9607c-84d1-46c3-be47-b145b992dc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:52.718299 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9607c-84d1-46c3-be47-b145b992dc9a admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:52.719060 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9607c-84d1-46c3-be47-b145b992dc9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:52.720655 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9607c-84d1-46c3-be47-b145b992dc9a admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:52.730791 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1232/2466] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:06:52.735938 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed9752-8675-43f0-a8b9-3dfbb46d33a9 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:52.745869 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed9752-8675-43f0-a8b9-3dfbb46d33a9 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:52.750629 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e044db7e-1a14-4a48-8948-9e7bb3370c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:52.751324 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044db7e-1a14-4a48-8948-9e7bb3370c11 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:52.751607 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044db7e-1a14-4a48-8948-9e7bb3370c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:52.751889 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e044db7e-1a14-4a48-8948-9e7bb3370c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:52.752654 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044db7e-1a14-4a48-8948-9e7bb3370c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:52.754257 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e044db7e-1a14-4a48-8948-9e7bb3370c11 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:52.764605 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1235/2467] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:06:52.770618 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9607c-84d1-46c3-be47-b145b992dc9a admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:52.780905 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9607c-84d1-46c3-be47-b145b992dc9a admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:52.785445 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922cf04-5e59-40ff-b0e2-8d0481648c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:52.786310 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922cf04-5e59-40ff-b0e2-8d0481648c49 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:52.786587 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922cf04-5e59-40ff-b0e2-8d0481648c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:52.786912 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922cf04-5e59-40ff-b0e2-8d0481648c49 admin admin] PATH_INFO: `/v3/projects/5820e16b0acc457b820f36a02cb5660f/users/2a0cbbf21c394749a8edc4eb83a11a2b/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:52.801550 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922cf04-5e59-40ff-b0e2-8d0481648c49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5820e16b0acc457b820f36a02cb5660f, user_id=2a0cbbf21c394749a8edc4eb83a11a2b, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:52.804258 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922cf04-5e59-40ff-b0e2-8d0481648c49 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:52.875251 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1233/2468] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:06:52 2022] PUT /identity/v3/projects/5820e16b0acc457b820f36a02cb5660f/users/2a0cbbf21c394749a8edc4eb83a11a2b/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:06:52.885247 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f3425-36c6-4802-a65c-9a1734020d06 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:52.885635 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f3425-36c6-4802-a65c-9a1734020d06 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:52.885961 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7f3425-36c6-4802-a65c-9a1734020d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:52.918166 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-7c7f3425-36c6-4802-a65c-9a1734020d06 None None] MFA Rules not processed for user `2a0cbbf21c394749a8edc4eb83a11a2b`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:06:52.920064 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-7c7f3425-36c6-4802-a65c-9a1734020d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:52.988930 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1236/2469] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:06:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:06:52.992835 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922cf04-5e59-40ff-b0e2-8d0481648c49 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:53.056138 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922cf04-5e59-40ff-b0e2-8d0481648c49 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:53.061754 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6ece2-e105-4105-ac02-b3f54e800be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:53.062417 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6ece2-e105-4105-ac02-b3f54e800be7 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:53.062689 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6ece2-e105-4105-ac02-b3f54e800be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:53.062997 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6ece2-e105-4105-ac02-b3f54e800be7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:53.063726 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6ece2-e105-4105-ac02-b3f54e800be7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:53.065610 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6ece2-e105-4105-ac02-b3f54e800be7 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:53.171539 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1234/2470] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:06:52 2022] POST /identity/v3/projects => generated 381 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:06:53.175668 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f3425-36c6-4802-a65c-9a1734020d06 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:53.188908 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7f3425-36c6-4802-a65c-9a1734020d06 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:53.245143 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb2df8-3bb5-41c5-a2c8-03ae8db77998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:53.245815 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb2df8-3bb5-41c5-a2c8-03ae8db77998 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:53.246093 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb2df8-3bb5-41c5-a2c8-03ae8db77998 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:53.246365 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb2df8-3bb5-41c5-a2c8-03ae8db77998 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:53.247637 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb2df8-3bb5-41c5-a2c8-03ae8db77998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:53.249548 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb2df8-3bb5-41c5-a2c8-03ae8db77998 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:53.332828 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1237/2471] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:06:53 2022] POST /identity/v3/users => generated 297 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:06:53.336887 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6ece2-e105-4105-ac02-b3f54e800be7 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:53.347578 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6ece2-e105-4105-ac02-b3f54e800be7 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:53.357919 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28ee3e-56e8-46fb-8b16-bee9b7047d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:53.358607 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28ee3e-56e8-46fb-8b16-bee9b7047d95 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:53.358922 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28ee3e-56e8-46fb-8b16-bee9b7047d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:53.359201 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28ee3e-56e8-46fb-8b16-bee9b7047d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:53.360215 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28ee3e-56e8-46fb-8b16-bee9b7047d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:53.361814 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28ee3e-56e8-46fb-8b16-bee9b7047d95 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:53.374194 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1235/2472] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:06:53.378394 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb2df8-3bb5-41c5-a2c8-03ae8db77998 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:53.389207 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb2df8-3bb5-41c5-a2c8-03ae8db77998 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:53.393902 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4603c-f48e-45c2-b54a-26b26aac7102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:53.394734 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4603c-f48e-45c2-b54a-26b26aac7102 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:53.395045 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4603c-f48e-45c2-b54a-26b26aac7102 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:53.395339 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4603c-f48e-45c2-b54a-26b26aac7102 admin admin] PATH_INFO: `/v3/projects/c92ada53686c4d3b82011f40e600bcdd/users/c4ed1893e6824010af61de0db48afe44/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:53.410023 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4603c-f48e-45c2-b54a-26b26aac7102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c92ada53686c4d3b82011f40e600bcdd, user_id=c4ed1893e6824010af61de0db48afe44, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:53.412711 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4603c-f48e-45c2-b54a-26b26aac7102 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:53.489376 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1238/2473] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:06:53 2022] PUT /identity/v3/projects/c92ada53686c4d3b82011f40e600bcdd/users/c4ed1893e6824010af61de0db48afe44/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:06:53.493214 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28ee3e-56e8-46fb-8b16-bee9b7047d95 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:53.503781 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28ee3e-56e8-46fb-8b16-bee9b7047d95 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:53.559562 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfc3b7-3552-420c-aeb2-98a9d90496cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:53.560229 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfc3b7-3552-420c-aeb2-98a9d90496cd admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:53.560497 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfc3b7-3552-420c-aeb2-98a9d90496cd admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:53.560768 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfc3b7-3552-420c-aeb2-98a9d90496cd admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:53.561485 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfc3b7-3552-420c-aeb2-98a9d90496cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:53.563162 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfc3b7-3552-420c-aeb2-98a9d90496cd admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:53.572918 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1236/2474] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:06:53.577579 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4603c-f48e-45c2-b54a-26b26aac7102 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:53.588376 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4603c-f48e-45c2-b54a-26b26aac7102 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:53.593035 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262eec01-9b11-4aa0-9a66-44c102408c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:53.593914 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262eec01-9b11-4aa0-9a66-44c102408c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:53.594201 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262eec01-9b11-4aa0-9a66-44c102408c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:53.594475 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262eec01-9b11-4aa0-9a66-44c102408c40 admin admin] PATH_INFO: `/v3/projects/c92ada53686c4d3b82011f40e600bcdd/users/c4ed1893e6824010af61de0db48afe44/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:53.596497 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262eec01-9b11-4aa0-9a66-44c102408c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c92ada53686c4d3b82011f40e600bcdd, user_id=c4ed1893e6824010af61de0db48afe44, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:53.599169 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262eec01-9b11-4aa0-9a66-44c102408c40 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:53.609458 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1239/2475] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:06:53 2022] PUT /identity/v3/projects/c92ada53686c4d3b82011f40e600bcdd/users/c4ed1893e6824010af61de0db48afe44/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:06:53.620822 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4da6c7-56fa-42ae-8577-9358492ddc6d None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:53.621110 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4da6c7-56fa-42ae-8577-9358492ddc6d None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:53.621385 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4da6c7-56fa-42ae-8577-9358492ddc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:53.648449 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-bb4da6c7-56fa-42ae-8577-9358492ddc6d None None] MFA Rules not processed for user `c4ed1893e6824010af61de0db48afe44`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:06:53.649704 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-bb4da6c7-56fa-42ae-8577-9358492ddc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:53.717451 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1237/2476] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:06:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:06:53.729335 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262eec01-9b11-4aa0-9a66-44c102408c40 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:53.734917 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-262eec01-9b11-4aa0-9a66-44c102408c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:53.790087 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262eec01-9b11-4aa0-9a66-44c102408c40 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:53.794363 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff068319-f8fe-4f92-bf85-b81dc19045d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:53.795083 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff068319-f8fe-4f92-bf85-b81dc19045d2 service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:53.795369 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff068319-f8fe-4f92-bf85-b81dc19045d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:53.795646 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff068319-f8fe-4f92-bf85-b81dc19045d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:53.800388 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4da6c7-56fa-42ae-8577-9358492ddc6d None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:53.801868 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-bb4da6c7-56fa-42ae-8577-9358492ddc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:53.805357 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff068319-f8fe-4f92-bf85-b81dc19045d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:53.806785 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff068319-f8fe-4f92-bf85-b81dc19045d2 service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:53.817511 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1240/2477] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:06:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:06:53.860017 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4da6c7-56fa-42ae-8577-9358492ddc6d None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:53.863801 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8a957-ae6b-45c8-8aa3-8dfb18ea133e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:53.864453 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8a957-ae6b-45c8-8aa3-8dfb18ea133e service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:53.864752 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8a957-ae6b-45c8-8aa3-8dfb18ea133e service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:53.865443 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8a957-ae6b-45c8-8aa3-8dfb18ea133e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:53.866976 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-dbe8a957-ae6b-45c8-8aa3-8dfb18ea133e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:53.877381 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8a957-ae6b-45c8-8aa3-8dfb18ea133e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:53.878794 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8a957-ae6b-45c8-8aa3-8dfb18ea133e service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:53.886568 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1238/2478] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:06:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:06:53.959404 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff068319-f8fe-4f92-bf85-b81dc19045d2 service cinder] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:53.968378 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff068319-f8fe-4f92-bf85-b81dc19045d2 service cinder] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:53.972305 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b08050-2fb2-4f79-af3b-672c6bb42ca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:53.972965 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b08050-2fb2-4f79-af3b-672c6bb42ca4 service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:53.973245 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b08050-2fb2-4f79-af3b-672c6bb42ca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:53.973519 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b08050-2fb2-4f79-af3b-672c6bb42ca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:54.029929 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b08050-2fb2-4f79-af3b-672c6bb42ca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:54.031399 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b08050-2fb2-4f79-af3b-672c6bb42ca4 service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:54.040388 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1241/2479] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:06:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:06:54.508073 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8a957-ae6b-45c8-8aa3-8dfb18ea133e service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:54.567170 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8a957-ae6b-45c8-8aa3-8dfb18ea133e service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:54.571641 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d86f3-551f-4fd2-9421-e8b6b7f7ed02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:54.572485 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d86f3-551f-4fd2-9421-e8b6b7f7ed02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:54.572762 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d86f3-551f-4fd2-9421-e8b6b7f7ed02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:54.573031 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d86f3-551f-4fd2-9421-e8b6b7f7ed02 admin admin] PATH_INFO: `/v3/users/2a0cbbf21c394749a8edc4eb83a11a2b` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:54.574189 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d86f3-551f-4fd2-9421-e8b6b7f7ed02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a0cbbf21c394749a8edc4eb83a11a2b)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:54.576126 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d86f3-551f-4fd2-9421-e8b6b7f7ed02 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:54.729838 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-650d86f3-551f-4fd2-9421-e8b6b7f7ed02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a0cbbf21c394749a8edc4eb83a11a2b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:54.737709 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-650d86f3-551f-4fd2-9421-e8b6b7f7ed02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a0cbbf21c394749a8edc4eb83a11a2b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:54.806124 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-650d86f3-551f-4fd2-9421-e8b6b7f7ed02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a0cbbf21c394749a8edc4eb83a11a2b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:54.806737 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-650d86f3-551f-4fd2-9421-e8b6b7f7ed02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a0cbbf21c394749a8edc4eb83a11a2b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:54.819158 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-650d86f3-551f-4fd2-9421-e8b6b7f7ed02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a0cbbf21c394749a8edc4eb83a11a2b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:54.825098 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1239/2480] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:06:54 2022] DELETE /identity/v3/users/2a0cbbf21c394749a8edc4eb83a11a2b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:06:54.836634 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adb85a-6d38-43c1-b1b9-ee611a29c1d9 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:54.837089 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adb85a-6d38-43c1-b1b9-ee611a29c1d9 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:54.837185 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adb85a-6d38-43c1-b1b9-ee611a29c1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:54.854336 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-87adb85a-6d38-43c1-b1b9-ee611a29c1d9 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:06:54.855562 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-87adb85a-6d38-43c1-b1b9-ee611a29c1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:54.913350 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1242/2481] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:06:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:06:54.923551 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d86f3-551f-4fd2-9421-e8b6b7f7ed02 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:54.924945 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-650d86f3-551f-4fd2-9421-e8b6b7f7ed02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:54.979977 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d86f3-551f-4fd2-9421-e8b6b7f7ed02 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:54.983629 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84728ff-7f68-47ea-8e76-55562a4fe480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:54.984270 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84728ff-7f68-47ea-8e76-55562a4fe480 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:54.984811 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84728ff-7f68-47ea-8e76-55562a4fe480 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:54.985084 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84728ff-7f68-47ea-8e76-55562a4fe480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:54.993880 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84728ff-7f68-47ea-8e76-55562a4fe480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:54.995322 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84728ff-7f68-47ea-8e76-55562a4fe480 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:55.005082 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1240/2482] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:06:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:06:55.402605 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adb85a-6d38-43c1-b1b9-ee611a29c1d9 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:55.404998 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-87adb85a-6d38-43c1-b1b9-ee611a29c1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:55.419022 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adb85a-6d38-43c1-b1b9-ee611a29c1d9 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:55.426261 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0785c33-ed4c-47ab-913a-c684c69bdf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:55.427763 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0785c33-ed4c-47ab-913a-c684c69bdf43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:55.427952 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0785c33-ed4c-47ab-913a-c684c69bdf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:55.428458 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0785c33-ed4c-47ab-913a-c684c69bdf43 admin admin] PATH_INFO: `/v3/projects/5820e16b0acc457b820f36a02cb5660f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:55.441271 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0785c33-ed4c-47ab-913a-c684c69bdf43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5820e16b0acc457b820f36a02cb5660f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:55.443259 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0785c33-ed4c-47ab-913a-c684c69bdf43 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:55.563050 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e0785c33-ed4c-47ab-913a-c684c69bdf43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5820e16b0acc457b820f36a02cb5660f', 'request_id': 'req-e0785c33-ed4c-47ab-913a-c684c69bdf43'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:55.631504 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e0785c33-ed4c-47ab-913a-c684c69bdf43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5820e16b0acc457b820f36a02cb5660f', 'request_id': 'req-e0785c33-ed4c-47ab-913a-c684c69bdf43'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:55.636940 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e0785c33-ed4c-47ab-913a-c684c69bdf43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5820e16b0acc457b820f36a02cb5660f', 'request_id': 'req-e0785c33-ed4c-47ab-913a-c684c69bdf43'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:55.648198 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e0785c33-ed4c-47ab-913a-c684c69bdf43 admin admin] The token cache is being invalidate because project 5820e16b0acc457b820f36a02cb5660f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:06:55.648485 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e0785c33-ed4c-47ab-913a-c684c69bdf43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:55.649126 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e0785c33-ed4c-47ab-913a-c684c69bdf43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:55.650703 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1243/2483] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:06:55 2022] DELETE /identity/v3/projects/5820e16b0acc457b820f36a02cb5660f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:06:55.654524 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84728ff-7f68-47ea-8e76-55562a4fe480 service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:55.663897 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84728ff-7f68-47ea-8e76-55562a4fe480 service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:55.718040 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d512a8a7-6ffa-4d36-8aeb-efee890d8003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:55.718932 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512a8a7-6ffa-4d36-8aeb-efee890d8003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:55.719209 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512a8a7-6ffa-4d36-8aeb-efee890d8003 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:55.719481 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d512a8a7-6ffa-4d36-8aeb-efee890d8003 admin admin] PATH_INFO: `/v3/users/c4ed1893e6824010af61de0db48afe44` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:55.720658 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512a8a7-6ffa-4d36-8aeb-efee890d8003 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4ed1893e6824010af61de0db48afe44)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:55.722565 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d512a8a7-6ffa-4d36-8aeb-efee890d8003 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:55.904461 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-d512a8a7-6ffa-4d36-8aeb-efee890d8003 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4ed1893e6824010af61de0db48afe44'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:55.909281 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-d512a8a7-6ffa-4d36-8aeb-efee890d8003 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4ed1893e6824010af61de0db48afe44'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:55.968378 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-d512a8a7-6ffa-4d36-8aeb-efee890d8003 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4ed1893e6824010af61de0db48afe44'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:55.968995 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-d512a8a7-6ffa-4d36-8aeb-efee890d8003 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4ed1893e6824010af61de0db48afe44'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:55.980587 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-d512a8a7-6ffa-4d36-8aeb-efee890d8003 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4ed1893e6824010af61de0db48afe44'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:55.987362 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1241/2484] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:06:55 2022] DELETE /identity/v3/users/c4ed1893e6824010af61de0db48afe44 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:06:56.447308 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0785c33-ed4c-47ab-913a-c684c69bdf43 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:56.448747 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-e0785c33-ed4c-47ab-913a-c684c69bdf43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:56.468550 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0785c33-ed4c-47ab-913a-c684c69bdf43 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:56.526003 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a299b23-38e3-42de-baae-87eabd97c786 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:56.526875 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a299b23-38e3-42de-baae-87eabd97c786 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:56.527156 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a299b23-38e3-42de-baae-87eabd97c786 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:56.527431 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a299b23-38e3-42de-baae-87eabd97c786 admin admin] PATH_INFO: `/v3/projects/c92ada53686c4d3b82011f40e600bcdd` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:56.528636 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a299b23-38e3-42de-baae-87eabd97c786 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c92ada53686c4d3b82011f40e600bcdd)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:56.530628 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a299b23-38e3-42de-baae-87eabd97c786 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:56.630131 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1a299b23-38e3-42de-baae-87eabd97c786 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c92ada53686c4d3b82011f40e600bcdd', 'request_id': 'req-1a299b23-38e3-42de-baae-87eabd97c786'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:56.720434 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1a299b23-38e3-42de-baae-87eabd97c786 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c92ada53686c4d3b82011f40e600bcdd', 'request_id': 'req-1a299b23-38e3-42de-baae-87eabd97c786'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:56.726334 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1a299b23-38e3-42de-baae-87eabd97c786 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c92ada53686c4d3b82011f40e600bcdd', 'request_id': 'req-1a299b23-38e3-42de-baae-87eabd97c786'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:56.738217 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1a299b23-38e3-42de-baae-87eabd97c786 admin admin] The token cache is being invalidate because project c92ada53686c4d3b82011f40e600bcdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:06:56.738503 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1a299b23-38e3-42de-baae-87eabd97c786 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:56.739142 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-1a299b23-38e3-42de-baae-87eabd97c786 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:06:56.740689 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1244/2485] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:06:56 2022] DELETE /identity/v3/projects/c92ada53686c4d3b82011f40e600bcdd => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:06:56.745547 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2919fa-279a-43c9-9cba-d8e53366bd9c None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:56.746045 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2919fa-279a-43c9-9cba-d8e53366bd9c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:56.746150 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2919fa-279a-43c9-9cba-d8e53366bd9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:56.764602 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-9c2919fa-279a-43c9-9cba-d8e53366bd9c None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:06:56.765793 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-9c2919fa-279a-43c9-9cba-d8e53366bd9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:56.821173 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1242/2486] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:06:56.829288 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b20a1-3ba4-4ed4-81c3-f4c51b1f237a None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:56.829572 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b20a1-3ba4-4ed4-81c3-f4c51b1f237a None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:56.829847 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b20a1-3ba4-4ed4-81c3-f4c51b1f237a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:56.847748 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-384b20a1-3ba4-4ed4-81c3-f4c51b1f237a None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:06:56.848939 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-384b20a1-3ba4-4ed4-81c3-f4c51b1f237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:56.857169 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1245/2487] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:06:56.861564 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2919fa-279a-43c9-9cba-d8e53366bd9c None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:56.870864 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2919fa-279a-43c9-9cba-d8e53366bd9c None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:56.876016 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386aeb13-6fe1-4efd-a385-c37c07a70b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:56.876650 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386aeb13-6fe1-4efd-a385-c37c07a70b23 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:56.876924 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386aeb13-6fe1-4efd-a385-c37c07a70b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:56.877193 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386aeb13-6fe1-4efd-a385-c37c07a70b23 admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:56.877904 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386aeb13-6fe1-4efd-a385-c37c07a70b23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:06:56.878200 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386aeb13-6fe1-4efd-a385-c37c07a70b23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:56.879789 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386aeb13-6fe1-4efd-a385-c37c07a70b23 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:56.890763 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1243/2488] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:06:56.895168 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b20a1-3ba4-4ed4-81c3-f4c51b1f237a None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:56.904301 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b20a1-3ba4-4ed4-81c3-f4c51b1f237a None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:56.908900 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7df37-ae6c-4b8d-b6fb-432948eb8072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:56.909532 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7df37-ae6c-4b8d-b6fb-432948eb8072 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:56.909810 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7df37-ae6c-4b8d-b6fb-432948eb8072 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:56.910083 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7df37-ae6c-4b8d-b6fb-432948eb8072 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:56.910773 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7df37-ae6c-4b8d-b6fb-432948eb8072 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:56.912679 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7df37-ae6c-4b8d-b6fb-432948eb8072 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:56.997222 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1246/2489] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:06:56 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:06:57.001890 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386aeb13-6fe1-4efd-a385-c37c07a70b23 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:57.011999 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386aeb13-6fe1-4efd-a385-c37c07a70b23 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:57.067241 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22842724-801d-4f1b-9831-5facf243cde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:57.067902 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22842724-801d-4f1b-9831-5facf243cde7 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:57.068180 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22842724-801d-4f1b-9831-5facf243cde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:57.068453 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22842724-801d-4f1b-9831-5facf243cde7 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:57.069141 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22842724-801d-4f1b-9831-5facf243cde7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:57.071096 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22842724-801d-4f1b-9831-5facf243cde7 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:57.160938 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1244/2490] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:06:57 2022] POST /identity/v3/users => generated 282 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:06:57.165401 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7df37-ae6c-4b8d-b6fb-432948eb8072 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:57.176731 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7df37-ae6c-4b8d-b6fb-432948eb8072 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:57.181372 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc937d0-d97d-43c6-a008-eb9c40bb872d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:57.182019 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc937d0-d97d-43c6-a008-eb9c40bb872d admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:57.182298 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc937d0-d97d-43c6-a008-eb9c40bb872d admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:57.182576 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc937d0-d97d-43c6-a008-eb9c40bb872d admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:57.183335 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc937d0-d97d-43c6-a008-eb9c40bb872d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:57.184964 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc937d0-d97d-43c6-a008-eb9c40bb872d admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:57.195233 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1247/2491] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:06:57.199077 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22842724-801d-4f1b-9831-5facf243cde7 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:57.208826 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22842724-801d-4f1b-9831-5facf243cde7 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:57.213461 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e1aa5-e9b1-49f2-a330-e9d2e28c0181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:57.222381 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e1aa5-e9b1-49f2-a330-e9d2e28c0181 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:57.222381 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e1aa5-e9b1-49f2-a330-e9d2e28c0181 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:57.222381 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e1aa5-e9b1-49f2-a330-e9d2e28c0181 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:57.222381 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e1aa5-e9b1-49f2-a330-e9d2e28c0181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:57.222381 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e1aa5-e9b1-49f2-a330-e9d2e28c0181 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:57.227327 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1245/2492] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:06:57.231560 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc937d0-d97d-43c6-a008-eb9c40bb872d admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:57.245526 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc937d0-d97d-43c6-a008-eb9c40bb872d admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:57.246809 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2bfa3-f938-47dc-a543-7b3c79566c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:57.247766 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2bfa3-f938-47dc-a543-7b3c79566c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:57.247988 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2bfa3-f938-47dc-a543-7b3c79566c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:57.248259 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2bfa3-f938-47dc-a543-7b3c79566c75 admin admin] PATH_INFO: `/v3/projects/42165e006f0548cb96d381879b8acb6e/users/3bf259203dfd421bbea48b3bb306405a/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:57.263227 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2bfa3-f938-47dc-a543-7b3c79566c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42165e006f0548cb96d381879b8acb6e, user_id=3bf259203dfd421bbea48b3bb306405a, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:57.265988 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2bfa3-f938-47dc-a543-7b3c79566c75 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:57.323577 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1248/2493] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:06:57 2022] PUT /identity/v3/projects/42165e006f0548cb96d381879b8acb6e/users/3bf259203dfd421bbea48b3bb306405a/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:06:57.335441 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a0217-9923-4534-a8b6-138ca5525343 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:57.335726 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a0217-9923-4534-a8b6-138ca5525343 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:57.336095 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3a0217-9923-4534-a8b6-138ca5525343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:57.363419 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-1b3a0217-9923-4534-a8b6-138ca5525343 None None] MFA Rules not processed for user `3bf259203dfd421bbea48b3bb306405a`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:06:57.364494 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1b3a0217-9923-4534-a8b6-138ca5525343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:57.440247 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1246/2494] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:06:57 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:06:57.452293 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2bfa3-f938-47dc-a543-7b3c79566c75 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:57.454029 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-62b2bfa3-f938-47dc-a543-7b3c79566c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:57.511458 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2bfa3-f938-47dc-a543-7b3c79566c75 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:57.515610 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f5800-58ec-49f7-9ae9-e0a035ec0e0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:57.516248 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f5800-58ec-49f7-9ae9-e0a035ec0e0b service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:57.516532 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f5800-58ec-49f7-9ae9-e0a035ec0e0b service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:57.516811 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f5800-58ec-49f7-9ae9-e0a035ec0e0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:57.525172 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f5800-58ec-49f7-9ae9-e0a035ec0e0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:57.526671 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f5800-58ec-49f7-9ae9-e0a035ec0e0b service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:57.536292 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1249/2495] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:06:57 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:06:58.764153 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a0217-9923-4534-a8b6-138ca5525343 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:06:58.765845 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1b3a0217-9923-4534-a8b6-138ca5525343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:58.838509 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3a0217-9923-4534-a8b6-138ca5525343 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:06:58.844445 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6fd9d-48b9-4a5a-b6b6-796090e09039 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:06:58.845115 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6fd9d-48b9-4a5a-b6b6-796090e09039 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:06:58.845391 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6fd9d-48b9-4a5a-b6b6-796090e09039 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:06:58.845663 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6fd9d-48b9-4a5a-b6b6-796090e09039 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:06:58.847752 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-47d6fd9d-48b9-4a5a-b6b6-796090e09039 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:06:58.906279 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6fd9d-48b9-4a5a-b6b6-796090e09039 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:06:58.907890 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6fd9d-48b9-4a5a-b6b6-796090e09039 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:06:58.916921 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1247/2496] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:06:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:07:10.997416 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f5800-58ec-49f7-9ae9-e0a035ec0e0b service cinder] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:07:11.009495 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f5800-58ec-49f7-9ae9-e0a035ec0e0b service cinder] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:07:11.014922 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2815d-2a65-456b-9521-ec713d226d01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:07:11.015543 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2815d-2a65-456b-9521-ec713d226d01 service nova] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:11.015882 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2815d-2a65-456b-9521-ec713d226d01 service nova] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:11.016156 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2815d-2a65-456b-9521-ec713d226d01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:11.017905 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-5ca2815d-2a65-456b-9521-ec713d226d01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:07:11.074712 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2815d-2a65-456b-9521-ec713d226d01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:07:11.076535 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2815d-2a65-456b-9521-ec713d226d01 service nova] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:07:11.085678 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1250/2497] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:07:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:07:20.094172 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6fd9d-48b9-4a5a-b6b6-796090e09039 service nova] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:07:20.094172 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-47d6fd9d-48b9-4a5a-b6b6-796090e09039 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:07:20.108743 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6fd9d-48b9-4a5a-b6b6-796090e09039 service nova] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:07:20.115877 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a221d54-a4b9-49e2-9be8-5ee5f9e09d70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:07:20.116533 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a221d54-a4b9-49e2-9be8-5ee5f9e09d70 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:20.116814 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a221d54-a4b9-49e2-9be8-5ee5f9e09d70 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:20.117099 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a221d54-a4b9-49e2-9be8-5ee5f9e09d70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:20.118921 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-4a221d54-a4b9-49e2-9be8-5ee5f9e09d70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:07:20.132681 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a221d54-a4b9-49e2-9be8-5ee5f9e09d70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:07:20.134565 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a221d54-a4b9-49e2-9be8-5ee5f9e09d70 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:07:20.146330 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1248/2498] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:07:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:07:21.493189 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3386d8b-fd84-419c-94cc-6106004fe43b None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:21.493683 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3386d8b-fd84-419c-94cc-6106004fe43b None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:21.493798 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3386d8b-fd84-419c-94cc-6106004fe43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:21.511474 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-d3386d8b-fd84-419c-94cc-6106004fe43b None None] MFA Rules not processed for user `666e5f4ec73d46c5834608b1f21a4447`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:07:21.512731 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d3386d8b-fd84-419c-94cc-6106004fe43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:07:21.566744 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1251/2499] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:07:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:07:25.497424 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a221d54-a4b9-49e2-9be8-5ee5f9e09d70 service nova] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:07:25.510815 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a221d54-a4b9-49e2-9be8-5ee5f9e09d70 service nova] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:07:25.519067 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13ce2d-0a52-4058-bf97-8ff3f90d2c70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:07:25.519979 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13ce2d-0a52-4058-bf97-8ff3f90d2c70 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:25.520429 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13ce2d-0a52-4058-bf97-8ff3f90d2c70 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:25.524682 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13ce2d-0a52-4058-bf97-8ff3f90d2c70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:25.530299 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1f13ce2d-0a52-4058-bf97-8ff3f90d2c70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:07:25.567440 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13ce2d-0a52-4058-bf97-8ff3f90d2c70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:07:25.569330 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13ce2d-0a52-4058-bf97-8ff3f90d2c70 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:07:25.591796 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1249/2500] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:07:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:07:26.184532 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7105a-0dab-4aff-899d-44395e1b300f None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:26.185517 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7105a-0dab-4aff-899d-44395e1b300f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:26.185952 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7105a-0dab-4aff-899d-44395e1b300f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:26.219606 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-50e7105a-0dab-4aff-899d-44395e1b300f None None] MFA Rules not processed for user `5c7b25e0e29143d783553859a0583d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:07:26.220855 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-50e7105a-0dab-4aff-899d-44395e1b300f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:07:26.301742 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1252/2501] 10.222.0.24 () {58 vars in 1009 bytes} [Tue Apr 12 00:07:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:07:26.423345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13ce2d-0a52-4058-bf97-8ff3f90d2c70 service nova] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:07:26.424558 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1f13ce2d-0a52-4058-bf97-8ff3f90d2c70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:07:26.545097 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13ce2d-0a52-4058-bf97-8ff3f90d2c70 service nova] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:07:26.552077 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca31219-ad25-47fb-a155-73c55721d6d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d616b38304d91bf1c7aded81205e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:07:26.555248 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca31219-ad25-47fb-a155-73c55721d6d6 service swift] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:26.555583 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca31219-ad25-47fb-a155-73c55721d6d6 service swift] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:26.555863 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca31219-ad25-47fb-a155-73c55721d6d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:26.565932 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca31219-ad25-47fb-a155-73c55721d6d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:07:26.568487 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca31219-ad25-47fb-a155-73c55721d6d6 service swift] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:07:26.580623 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1250/2502] 10.222.0.24 () {60 vars in 1384 bytes} [Tue Apr 12 00:07:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:07:46.571504 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6b0ed-9e74-4738-988a-097bc0cb369a None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:46.572074 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6b0ed-9e74-4738-988a-097bc0cb369a None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:46.572223 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6b0ed-9e74-4738-988a-097bc0cb369a None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:46.574654 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1253/2503] 10.222.0.24 () {54 vars in 921 bytes} [Tue Apr 12 00:07:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:07:46.585562 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742a863-b13a-4f08-9f80-a6857db5294b None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:46.586439 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742a863-b13a-4f08-9f80-a6857db5294b None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:46.586715 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742a863-b13a-4f08-9f80-a6857db5294b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:46.604963 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-d742a863-b13a-4f08-9f80-a6857db5294b None None] MFA Rules not processed for user `a9519f49f897415a894c1121278dda9c`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:07:46.606764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d742a863-b13a-4f08-9f80-a6857db5294b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:07:46.627094 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1251/2504] 10.222.0.24 () {58 vars in 1018 bytes} [Tue Apr 12 00:07:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:07:46.642398 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6b0ed-9e74-4738-988a-097bc0cb369a None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:07:46.644115 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-27c6b0ed-9e74-4738-988a-097bc0cb369a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:07:46.705403 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6b0ed-9e74-4738-988a-097bc0cb369a None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:07:46.709013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c04110-f07c-4c48-a171-bd8d49a20bae service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2ad9c7f930e426bb908237f72c04a2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:07:46.709593 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c04110-f07c-4c48-a171-bd8d49a20bae service glance] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:46.709902 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c04110-f07c-4c48-a171-bd8d49a20bae service glance] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:46.710177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c04110-f07c-4c48-a171-bd8d49a20bae service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:46.720128 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c04110-f07c-4c48-a171-bd8d49a20bae service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:07:46.721547 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c04110-f07c-4c48-a171-bd8d49a20bae service glance] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:07:46.732603 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1254/2505] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:07:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:07:46.947363 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34826bac-9109-46bd-aa82-09d2c5301bcf None None] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:46.947765 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34826bac-9109-46bd-aa82-09d2c5301bcf None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:46.950596 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34826bac-9109-46bd-aa82-09d2c5301bcf None None] PATH_INFO: `/` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:46.950596 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1252/2506] 10.222.0.24 () {54 vars in 921 bytes} [Tue Apr 12 00:07:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:07:46.955247 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8654bf-cfc3-4b30-9efb-153fa49c80cf None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:46.955610 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8654bf-cfc3-4b30-9efb-153fa49c80cf None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:46.955915 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8654bf-cfc3-4b30-9efb-153fa49c80cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:46.973831 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-fb8654bf-cfc3-4b30-9efb-153fa49c80cf None None] MFA Rules not processed for user `c6936272118b49a9baa19f3bd5066f9d`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:07:46.975105 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-fb8654bf-cfc3-4b30-9efb-153fa49c80cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:07:47.032832 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1255/2507] 10.222.0.24 () {58 vars in 1018 bytes} [Tue Apr 12 00:07:46 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:07:47.045659 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34826bac-9109-46bd-aa82-09d2c5301bcf None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:07:47.047436 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-34826bac-9109-46bd-aa82-09d2c5301bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:07:47.062690 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34826bac-9109-46bd-aa82-09d2c5301bcf None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:07:47.066406 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5df3df5-24e7-4287-a3dc-1502c7fb5056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:07:47.067164 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df3df5-24e7-4287-a3dc-1502c7fb5056 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:47.067442 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df3df5-24e7-4287-a3dc-1502c7fb5056 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:47.067713 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5df3df5-24e7-4287-a3dc-1502c7fb5056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:47.075524 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df3df5-24e7-4287-a3dc-1502c7fb5056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:07:47.076951 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5df3df5-24e7-4287-a3dc-1502c7fb5056 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:07:47.086738 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1253/2508] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:07:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:07:47.191561 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2d085-b931-467b-811b-e7dc2298f4ac None None] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:47.191867 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2d085-b931-467b-811b-e7dc2298f4ac None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:47.192130 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2d085-b931-467b-811b-e7dc2298f4ac None None] PATH_INFO: `/` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:47.194494 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1256/2509] 10.222.0.24 () {54 vars in 921 bytes} [Tue Apr 12 00:07:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Apr 12 00:07:47.201895 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45966d9-3bc7-4d1e-b22a-a5f749ea52e0 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:47.202201 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45966d9-3bc7-4d1e-b22a-a5f749ea52e0 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:47.202479 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45966d9-3bc7-4d1e-b22a-a5f749ea52e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:47.223869 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-a45966d9-3bc7-4d1e-b22a-a5f749ea52e0 None None] MFA Rules not processed for user `a9519f49f897415a894c1121278dda9c`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:07:47.224983 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a45966d9-3bc7-4d1e-b22a-a5f749ea52e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:07:47.238229 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1254/2510] 10.222.0.24 () {58 vars in 1018 bytes} [Tue Apr 12 00:07:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:07:47.251772 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2d085-b931-467b-811b-e7dc2298f4ac None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:07:47.264883 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2d085-b931-467b-811b-e7dc2298f4ac None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:07:47.268583 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424320c-9e25-41e3-a78a-fb4b28105422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:07:47.269222 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424320c-9e25-41e3-a78a-fb4b28105422 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:47.269554 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424320c-9e25-41e3-a78a-fb4b28105422 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:47.269833 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424320c-9e25-41e3-a78a-fb4b28105422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:47.281102 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424320c-9e25-41e3-a78a-fb4b28105422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:07:47.282633 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424320c-9e25-41e3-a78a-fb4b28105422 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:07:47.295556 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1257/2511] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:07:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:07:49.786341 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9865b6e-14c6-4aec-96eb-af471bfa431a None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:49.786804 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9865b6e-14c6-4aec-96eb-af471bfa431a None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:49.787016 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9865b6e-14c6-4aec-96eb-af471bfa431a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:49.805812 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-f9865b6e-14c6-4aec-96eb-af471bfa431a None None] MFA Rules not processed for user `5c7b25e0e29143d783553859a0583d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:07:49.807089 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-f9865b6e-14c6-4aec-96eb-af471bfa431a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:07:49.814279 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1255/2512] 10.222.0.24 () {58 vars in 1009 bytes} [Tue Apr 12 00:07:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:07:49.826589 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424320c-9e25-41e3-a78a-fb4b28105422 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:07:49.837777 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424320c-9e25-41e3-a78a-fb4b28105422 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:07:49.842657 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df951f2-48f0-4f52-a835-cdaa4c4b5526 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d616b38304d91bf1c7aded81205e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:07:49.843306 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df951f2-48f0-4f52-a835-cdaa4c4b5526 service swift] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:49.843629 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df951f2-48f0-4f52-a835-cdaa4c4b5526 service swift] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:49.843929 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df951f2-48f0-4f52-a835-cdaa4c4b5526 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:49.854899 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df951f2-48f0-4f52-a835-cdaa4c4b5526 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:07:49.858596 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df951f2-48f0-4f52-a835-cdaa4c4b5526 service swift] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:07:49.864753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1258/2513] 10.222.0.24 () {60 vars in 1384 bytes} [Tue Apr 12 00:07:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Apr 12 00:07:50.534861 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9865b6e-14c6-4aec-96eb-af471bfa431a None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:07:50.614957 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9865b6e-14c6-4aec-96eb-af471bfa431a None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:07:50.619647 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370da4e8-d9e9-4891-b9b3-42f419d12c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:07:50.623418 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370da4e8-d9e9-4891-b9b3-42f419d12c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:50.623418 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370da4e8-d9e9-4891-b9b3-42f419d12c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:50.623418 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370da4e8-d9e9-4891-b9b3-42f419d12c88 admin admin] PATH_INFO: `/v3/users/3bf259203dfd421bbea48b3bb306405a` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:50.623418 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370da4e8-d9e9-4891-b9b3-42f419d12c88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf259203dfd421bbea48b3bb306405a)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:07:50.624216 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370da4e8-d9e9-4891-b9b3-42f419d12c88 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:07:50.806333 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-370da4e8-d9e9-4891-b9b3-42f419d12c88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf259203dfd421bbea48b3bb306405a'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:07:50.818522 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-370da4e8-d9e9-4891-b9b3-42f419d12c88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf259203dfd421bbea48b3bb306405a'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:07:50.899694 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-370da4e8-d9e9-4891-b9b3-42f419d12c88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf259203dfd421bbea48b3bb306405a'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:07:50.903316 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-370da4e8-d9e9-4891-b9b3-42f419d12c88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf259203dfd421bbea48b3bb306405a'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:07:50.921904 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-370da4e8-d9e9-4891-b9b3-42f419d12c88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf259203dfd421bbea48b3bb306405a'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:07:50.930429 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1256/2514] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:07:50 2022] DELETE /identity/v3/users/3bf259203dfd421bbea48b3bb306405a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:07:50.934782 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ea54e-4174-4e5b-a92d-c80f9a0c603f None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:50.935324 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ea54e-4174-4e5b-a92d-c80f9a0c603f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:50.935419 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ea54e-4174-4e5b-a92d-c80f9a0c603f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:50.955119 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-3f3ea54e-4174-4e5b-a92d-c80f9a0c603f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:07:50.956802 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-3f3ea54e-4174-4e5b-a92d-c80f9a0c603f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:07:51.018986 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1259/2515] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:07:51.032375 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370da4e8-d9e9-4891-b9b3-42f419d12c88 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:07:51.033781 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-370da4e8-d9e9-4891-b9b3-42f419d12c88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:07:51.103450 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370da4e8-d9e9-4891-b9b3-42f419d12c88 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:07:51.108031 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bfaa1-be00-45a2-9dd8-7841a1bcde56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:07:51.108687 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bfaa1-be00-45a2-9dd8-7841a1bcde56 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:51.109047 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bfaa1-be00-45a2-9dd8-7841a1bcde56 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:51.109433 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bfaa1-be00-45a2-9dd8-7841a1bcde56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:51.122202 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bfaa1-be00-45a2-9dd8-7841a1bcde56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:07:51.124014 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bfaa1-be00-45a2-9dd8-7841a1bcde56 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:07:51.135163 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1257/2516] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:07:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:07:51.638871 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ea54e-4174-4e5b-a92d-c80f9a0c603f None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:07:51.643687 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-3f3ea54e-4174-4e5b-a92d-c80f9a0c603f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:07:51.665919 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ea54e-4174-4e5b-a92d-c80f9a0c603f None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:07:51.687531 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2ddce-d278-40a0-94b5-8181e9f3ffc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:07:51.688511 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2ddce-d278-40a0-94b5-8181e9f3ffc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:51.688859 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2ddce-d278-40a0-94b5-8181e9f3ffc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:51.689343 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2ddce-d278-40a0-94b5-8181e9f3ffc0 admin admin] PATH_INFO: `/v3/projects/42165e006f0548cb96d381879b8acb6e` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:51.690748 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2ddce-d278-40a0-94b5-8181e9f3ffc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42165e006f0548cb96d381879b8acb6e)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:07:51.694283 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2ddce-d278-40a0-94b5-8181e9f3ffc0 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:07:51.836799 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8ae2ddce-d278-40a0-94b5-8181e9f3ffc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42165e006f0548cb96d381879b8acb6e', 'request_id': 'req-8ae2ddce-d278-40a0-94b5-8181e9f3ffc0'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:07:51.930547 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8ae2ddce-d278-40a0-94b5-8181e9f3ffc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42165e006f0548cb96d381879b8acb6e', 'request_id': 'req-8ae2ddce-d278-40a0-94b5-8181e9f3ffc0'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:07:51.937349 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8ae2ddce-d278-40a0-94b5-8181e9f3ffc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42165e006f0548cb96d381879b8acb6e', 'request_id': 'req-8ae2ddce-d278-40a0-94b5-8181e9f3ffc0'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:07:51.949573 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8ae2ddce-d278-40a0-94b5-8181e9f3ffc0 admin admin] The token cache is being invalidate because project 42165e006f0548cb96d381879b8acb6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:07:51.951105 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8ae2ddce-d278-40a0-94b5-8181e9f3ffc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:07:51.952152 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8ae2ddce-d278-40a0-94b5-8181e9f3ffc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:07:51.954612 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1260/2517] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:07:51 2022] DELETE /identity/v3/projects/42165e006f0548cb96d381879b8acb6e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:07:51.961635 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba54f38-c8c9-43e3-8e5d-10ae8cfe71e9 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:51.962190 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba54f38-c8c9-43e3-8e5d-10ae8cfe71e9 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:51.962190 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba54f38-c8c9-43e3-8e5d-10ae8cfe71e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:51.986514 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-bba54f38-c8c9-43e3-8e5d-10ae8cfe71e9 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:07:51.988039 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-bba54f38-c8c9-43e3-8e5d-10ae8cfe71e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:07:52.090942 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1258/2518] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:07:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:07:52.093216 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8d98d-7c23-4e89-bc92-3223d92cd28e None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:52.093682 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8d98d-7c23-4e89-bc92-3223d92cd28e None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:52.093984 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8d98d-7c23-4e89-bc92-3223d92cd28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:52.123043 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-9cc8d98d-7c23-4e89-bc92-3223d92cd28e None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:07:52.125143 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-9cc8d98d-7c23-4e89-bc92-3223d92cd28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:07:52.136111 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1261/2519] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:07:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:07:52.140199 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba54f38-c8c9-43e3-8e5d-10ae8cfe71e9 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:07:52.150601 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba54f38-c8c9-43e3-8e5d-10ae8cfe71e9 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:07:52.157348 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853949b-e652-4b9b-9ffd-d6052d4cea88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:07:52.158886 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853949b-e652-4b9b-9ffd-d6052d4cea88 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:52.158886 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853949b-e652-4b9b-9ffd-d6052d4cea88 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:52.158886 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853949b-e652-4b9b-9ffd-d6052d4cea88 admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:52.161661 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853949b-e652-4b9b-9ffd-d6052d4cea88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:07:52.161661 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853949b-e652-4b9b-9ffd-d6052d4cea88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:07:52.161959 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853949b-e652-4b9b-9ffd-d6052d4cea88 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:07:52.174409 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1259/2520] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:07:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:07:52.178715 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8d98d-7c23-4e89-bc92-3223d92cd28e None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:07:52.188045 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8d98d-7c23-4e89-bc92-3223d92cd28e None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:07:52.192716 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bf2b5-7cfb-4ff4-856a-4a0d0de589c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:07:52.193593 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bf2b5-7cfb-4ff4-856a-4a0d0de589c1 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:52.194032 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bf2b5-7cfb-4ff4-856a-4a0d0de589c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:52.195449 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bf2b5-7cfb-4ff4-856a-4a0d0de589c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:52.195652 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bf2b5-7cfb-4ff4-856a-4a0d0de589c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:07:52.197682 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bf2b5-7cfb-4ff4-856a-4a0d0de589c1 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:07:52.310925 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1262/2521] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:07:52 2022] POST /identity/v3/projects => generated 391 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:07:52.314982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853949b-e652-4b9b-9ffd-d6052d4cea88 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:07:52.329022 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853949b-e652-4b9b-9ffd-d6052d4cea88 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:07:52.414248 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7c6c8-be51-4cf3-80ab-6e95d76e28a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:07:52.415578 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7c6c8-be51-4cf3-80ab-6e95d76e28a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:52.416074 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7c6c8-be51-4cf3-80ab-6e95d76e28a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:52.416723 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7c6c8-be51-4cf3-80ab-6e95d76e28a3 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:52.417592 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7c6c8-be51-4cf3-80ab-6e95d76e28a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:07:52.419787 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7c6c8-be51-4cf3-80ab-6e95d76e28a3 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:07:52.500150 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1260/2522] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:07:52 2022] POST /identity/v3/users => generated 296 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:07:52.504226 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bf2b5-7cfb-4ff4-856a-4a0d0de589c1 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:07:52.516247 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bf2b5-7cfb-4ff4-856a-4a0d0de589c1 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:07:52.521682 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d117d-8bde-49fe-8c11-05342a34fa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:07:52.522589 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d117d-8bde-49fe-8c11-05342a34fa61 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:52.523110 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d117d-8bde-49fe-8c11-05342a34fa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:52.523571 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d117d-8bde-49fe-8c11-05342a34fa61 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:52.524314 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d117d-8bde-49fe-8c11-05342a34fa61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:07:52.525927 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d117d-8bde-49fe-8c11-05342a34fa61 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:07:52.536562 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1263/2523] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:07:52.540517 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7c6c8-be51-4cf3-80ab-6e95d76e28a3 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:07:52.550788 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7c6c8-be51-4cf3-80ab-6e95d76e28a3 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:07:52.556317 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edea35d-73a9-44d8-ba66-d57d4aa850c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:07:52.557080 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edea35d-73a9-44d8-ba66-d57d4aa850c8 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:52.557429 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edea35d-73a9-44d8-ba66-d57d4aa850c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:52.557774 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edea35d-73a9-44d8-ba66-d57d4aa850c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:52.558548 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edea35d-73a9-44d8-ba66-d57d4aa850c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:07:52.560211 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edea35d-73a9-44d8-ba66-d57d4aa850c8 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:07:52.575843 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1261/2524] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:07:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:07:52.580099 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d117d-8bde-49fe-8c11-05342a34fa61 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:07:52.590133 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d117d-8bde-49fe-8c11-05342a34fa61 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:07:52.595310 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bb190-844c-462a-84d6-b6abb84688ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:07:52.596155 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bb190-844c-462a-84d6-b6abb84688ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:52.596439 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bb190-844c-462a-84d6-b6abb84688ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:52.596715 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bb190-844c-462a-84d6-b6abb84688ce admin admin] PATH_INFO: `/v3/projects/accb5a03dd614130808e9dd6eb437733/users/32132298ce5544fc9b056e8a67a3b7aa/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:52.612471 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bb190-844c-462a-84d6-b6abb84688ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=accb5a03dd614130808e9dd6eb437733, user_id=32132298ce5544fc9b056e8a67a3b7aa, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:07:52.615167 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328bb190-844c-462a-84d6-b6abb84688ce admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:07:52.680344 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1264/2525] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:07:52 2022] PUT /identity/v3/projects/accb5a03dd614130808e9dd6eb437733/users/32132298ce5544fc9b056e8a67a3b7aa/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:07:52.704657 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f4639-2771-4272-a25a-12bff0b31fa1 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:52.710088 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f4639-2771-4272-a25a-12bff0b31fa1 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:52.710625 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897f4639-2771-4272-a25a-12bff0b31fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:52.754788 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-897f4639-2771-4272-a25a-12bff0b31fa1 None None] MFA Rules not processed for user `32132298ce5544fc9b056e8a67a3b7aa`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:07:52.756596 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-897f4639-2771-4272-a25a-12bff0b31fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:07:52.850199 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1262/2526] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:07:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:07:52.861958 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bb190-844c-462a-84d6-b6abb84688ce admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:07:52.863865 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-328bb190-844c-462a-84d6-b6abb84688ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:07:52.950553 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328bb190-844c-462a-84d6-b6abb84688ce admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:07:52.952809 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfb81d-1930-44f1-b38d-ab1559ee73c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:07:52.953628 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfb81d-1930-44f1-b38d-ab1559ee73c2 service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:07:52.953909 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfb81d-1930-44f1-b38d-ab1559ee73c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:07:52.954176 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfb81d-1930-44f1-b38d-ab1559ee73c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:07:52.963965 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfb81d-1930-44f1-b38d-ab1559ee73c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:07:52.965408 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcfb81d-1930-44f1-b38d-ab1559ee73c2 service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:07:52.975263 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1265/2527] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:07:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:08:05.790317 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f4639-2771-4272-a25a-12bff0b31fa1 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:05.794779 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-897f4639-2771-4272-a25a-12bff0b31fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:05.870092 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897f4639-2771-4272-a25a-12bff0b31fa1 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:05.874565 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5447a-8c00-43f8-a5d9-9dfa6d336211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:05.875473 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5447a-8c00-43f8-a5d9-9dfa6d336211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:05.875745 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5447a-8c00-43f8-a5d9-9dfa6d336211 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:05.876013 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5447a-8c00-43f8-a5d9-9dfa6d336211 admin admin] PATH_INFO: `/v3/users/0cc30086244243e09118bbd25fae7539` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:05.877219 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5447a-8c00-43f8-a5d9-9dfa6d336211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc30086244243e09118bbd25fae7539)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:05.879155 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5447a-8c00-43f8-a5d9-9dfa6d336211 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:06.071170 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-4db5447a-8c00-43f8-a5d9-9dfa6d336211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc30086244243e09118bbd25fae7539'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:06.078684 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-4db5447a-8c00-43f8-a5d9-9dfa6d336211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc30086244243e09118bbd25fae7539'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:06.135846 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-4db5447a-8c00-43f8-a5d9-9dfa6d336211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc30086244243e09118bbd25fae7539'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:06.136477 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-4db5447a-8c00-43f8-a5d9-9dfa6d336211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc30086244243e09118bbd25fae7539'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:06.149143 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-4db5447a-8c00-43f8-a5d9-9dfa6d336211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc30086244243e09118bbd25fae7539'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:06.155111 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1263/2528] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:08:05 2022] DELETE /identity/v3/users/0cc30086244243e09118bbd25fae7539 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:06.389169 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfb81d-1930-44f1-b38d-ab1559ee73c2 service cinder] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:06.400365 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfb81d-1930-44f1-b38d-ab1559ee73c2 service cinder] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:06.454073 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501057f-570a-4d1e-a2d1-04f3ed9ec7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:06.454962 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501057f-570a-4d1e-a2d1-04f3ed9ec7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:06.455235 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501057f-570a-4d1e-a2d1-04f3ed9ec7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:06.455508 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501057f-570a-4d1e-a2d1-04f3ed9ec7b9 admin admin] PATH_INFO: `/v3/projects/77d13e16c2694f939137be1ca2e55b6c` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:06.456668 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501057f-570a-4d1e-a2d1-04f3ed9ec7b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77d13e16c2694f939137be1ca2e55b6c)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:06.458547 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501057f-570a-4d1e-a2d1-04f3ed9ec7b9 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:06.573402 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3501057f-570a-4d1e-a2d1-04f3ed9ec7b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77d13e16c2694f939137be1ca2e55b6c', 'request_id': 'req-3501057f-570a-4d1e-a2d1-04f3ed9ec7b9'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:06.636682 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3501057f-570a-4d1e-a2d1-04f3ed9ec7b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77d13e16c2694f939137be1ca2e55b6c', 'request_id': 'req-3501057f-570a-4d1e-a2d1-04f3ed9ec7b9'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:06.642012 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3501057f-570a-4d1e-a2d1-04f3ed9ec7b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77d13e16c2694f939137be1ca2e55b6c', 'request_id': 'req-3501057f-570a-4d1e-a2d1-04f3ed9ec7b9'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:06.653382 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3501057f-570a-4d1e-a2d1-04f3ed9ec7b9 admin admin] The token cache is being invalidate because project 77d13e16c2694f939137be1ca2e55b6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:08:06.661647 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3501057f-570a-4d1e-a2d1-04f3ed9ec7b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:06.661647 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3501057f-570a-4d1e-a2d1-04f3ed9ec7b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:06.661647 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1266/2529] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:08:06 2022] DELETE /identity/v3/projects/77d13e16c2694f939137be1ca2e55b6c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:09.898853 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ad019-ddac-4a85-8fdb-93f9a5f5be7e None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:09.899306 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ad019-ddac-4a85-8fdb-93f9a5f5be7e None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:09.899421 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ad019-ddac-4a85-8fdb-93f9a5f5be7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:09.917233 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-d53ad019-ddac-4a85-8fdb-93f9a5f5be7e None None] MFA Rules not processed for user `5c7b25e0e29143d783553859a0583d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:09.918890 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d53ad019-ddac-4a85-8fdb-93f9a5f5be7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:09.973693 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1264/2530] 10.222.0.24 () {58 vars in 967 bytes} [Tue Apr 12 00:08:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:09.986759 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501057f-570a-4d1e-a2d1-04f3ed9ec7b9 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:09.988205 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-3501057f-570a-4d1e-a2d1-04f3ed9ec7b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:10.060665 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501057f-570a-4d1e-a2d1-04f3ed9ec7b9 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:10.065565 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7c91a-bb9f-4e20-a752-e51f2a4f7a05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d616b38304d91bf1c7aded81205e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:10.066195 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7c91a-bb9f-4e20-a752-e51f2a4f7a05 service swift] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:10.066472 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7c91a-bb9f-4e20-a752-e51f2a4f7a05 service swift] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:10.066743 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7c91a-bb9f-4e20-a752-e51f2a4f7a05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:10.074670 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7c91a-bb9f-4e20-a752-e51f2a4f7a05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:10.076277 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7c91a-bb9f-4e20-a752-e51f2a4f7a05 service swift] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:10.084035 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1267/2531] 10.222.0.24 () {60 vars in 1384 bytes} [Tue Apr 12 00:08:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:08:11.704464 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ad019-ddac-4a85-8fdb-93f9a5f5be7e None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:11.705877 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d53ad019-ddac-4a85-8fdb-93f9a5f5be7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:11.760288 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ad019-ddac-4a85-8fdb-93f9a5f5be7e None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:11.763815 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe851c9-60c5-4fe5-a3ca-be8bc17b06de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:11.764446 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe851c9-60c5-4fe5-a3ca-be8bc17b06de service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:11.764758 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe851c9-60c5-4fe5-a3ca-be8bc17b06de service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:11.765028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe851c9-60c5-4fe5-a3ca-be8bc17b06de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:11.767176 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-dfe851c9-60c5-4fe5-a3ca-be8bc17b06de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:11.826393 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe851c9-60c5-4fe5-a3ca-be8bc17b06de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:11.827847 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe851c9-60c5-4fe5-a3ca-be8bc17b06de service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:11.838401 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1265/2532] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:08:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:08:14.667210 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7c91a-bb9f-4e20-a752-e51f2a4f7a05 service swift] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:14.668658 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-b9d7c91a-bb9f-4e20-a752-e51f2a4f7a05 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:14.684154 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7c91a-bb9f-4e20-a752-e51f2a4f7a05 service swift] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:14.692691 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267aac9-9044-435b-bed8-e9abb6350f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:14.692691 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267aac9-9044-435b-bed8-e9abb6350f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:14.692691 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267aac9-9044-435b-bed8-e9abb6350f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:14.692691 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267aac9-9044-435b-bed8-e9abb6350f3e admin admin] PATH_INFO: `/v3/users/32132298ce5544fc9b056e8a67a3b7aa` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:14.693078 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267aac9-9044-435b-bed8-e9abb6350f3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=32132298ce5544fc9b056e8a67a3b7aa)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:14.695560 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267aac9-9044-435b-bed8-e9abb6350f3e admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:14.875708 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f267aac9-9044-435b-bed8-e9abb6350f3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32132298ce5544fc9b056e8a67a3b7aa'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:14.931315 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f267aac9-9044-435b-bed8-e9abb6350f3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32132298ce5544fc9b056e8a67a3b7aa'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:14.932904 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f267aac9-9044-435b-bed8-e9abb6350f3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32132298ce5544fc9b056e8a67a3b7aa'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:14.942510 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f267aac9-9044-435b-bed8-e9abb6350f3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32132298ce5544fc9b056e8a67a3b7aa'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:14.959291 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f267aac9-9044-435b-bed8-e9abb6350f3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32132298ce5544fc9b056e8a67a3b7aa'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:14.967699 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1268/2533] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:08:14 2022] DELETE /identity/v3/users/32132298ce5544fc9b056e8a67a3b7aa => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:14.972030 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009625c-c817-44f1-9469-88306e5c4363 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:14.972541 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009625c-c817-44f1-9469-88306e5c4363 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:14.972637 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009625c-c817-44f1-9469-88306e5c4363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:14.991555 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-1009625c-c817-44f1-9469-88306e5c4363 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:14.993687 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1009625c-c817-44f1-9469-88306e5c4363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:15.075210 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1266/2534] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:15.084909 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267aac9-9044-435b-bed8-e9abb6350f3e admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:15.086400 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-f267aac9-9044-435b-bed8-e9abb6350f3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:15.148756 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267aac9-9044-435b-bed8-e9abb6350f3e admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:15.152751 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b77172-1b22-4f11-83dc-80135403cee0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:15.153467 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b77172-1b22-4f11-83dc-80135403cee0 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:15.153817 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b77172-1b22-4f11-83dc-80135403cee0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:15.154159 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b77172-1b22-4f11-83dc-80135403cee0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:15.163675 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b77172-1b22-4f11-83dc-80135403cee0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:15.165183 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b77172-1b22-4f11-83dc-80135403cee0 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:15.175415 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1269/2535] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:08:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:08:15.656552 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009625c-c817-44f1-9469-88306e5c4363 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:15.658051 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1009625c-c817-44f1-9469-88306e5c4363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:15.672047 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009625c-c817-44f1-9469-88306e5c4363 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:15.677579 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26ee68-b5ec-446f-bace-e0cc38571cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:15.677790 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b77172-1b22-4f11-83dc-80135403cee0 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:15.678521 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26ee68-b5ec-446f-bace-e0cc38571cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:15.678808 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26ee68-b5ec-446f-bace-e0cc38571cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:15.679124 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26ee68-b5ec-446f-bace-e0cc38571cb6 admin admin] PATH_INFO: `/v3/users/f03a84381dae444a907bf9624d2fefaa` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:15.680369 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26ee68-b5ec-446f-bace-e0cc38571cb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f03a84381dae444a907bf9624d2fefaa)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:15.680649 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-c5b77172-1b22-4f11-83dc-80135403cee0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:15.682586 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26ee68-b5ec-446f-bace-e0cc38571cb6 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:15.704507 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b77172-1b22-4f11-83dc-80135403cee0 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:15.711123 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0966223-a533-4e5f-838b-4441287c01e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:15.713694 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0966223-a533-4e5f-838b-4441287c01e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:15.713694 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0966223-a533-4e5f-838b-4441287c01e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:15.713694 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0966223-a533-4e5f-838b-4441287c01e7 admin admin] PATH_INFO: `/v3/projects/accb5a03dd614130808e9dd6eb437733` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:15.714063 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0966223-a533-4e5f-838b-4441287c01e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=accb5a03dd614130808e9dd6eb437733)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:15.717822 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0966223-a533-4e5f-838b-4441287c01e7 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:15.853677 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-0c26ee68-b5ec-446f-bace-e0cc38571cb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f03a84381dae444a907bf9624d2fefaa'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:15.860665 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-0c26ee68-b5ec-446f-bace-e0cc38571cb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f03a84381dae444a907bf9624d2fefaa'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:15.941641 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-0c26ee68-b5ec-446f-bace-e0cc38571cb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f03a84381dae444a907bf9624d2fefaa'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:15.941641 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-0c26ee68-b5ec-446f-bace-e0cc38571cb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f03a84381dae444a907bf9624d2fefaa'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:15.949654 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-0c26ee68-b5ec-446f-bace-e0cc38571cb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f03a84381dae444a907bf9624d2fefaa'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:15.955724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1267/2536] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:08:15 2022] DELETE /identity/v3/users/f03a84381dae444a907bf9624d2fefaa => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:15.990782 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b0966223-a533-4e5f-838b-4441287c01e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'accb5a03dd614130808e9dd6eb437733', 'request_id': 'req-b0966223-a533-4e5f-838b-4441287c01e7'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:16.039534 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b0966223-a533-4e5f-838b-4441287c01e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'accb5a03dd614130808e9dd6eb437733', 'request_id': 'req-b0966223-a533-4e5f-838b-4441287c01e7'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:16.045378 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b0966223-a533-4e5f-838b-4441287c01e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'accb5a03dd614130808e9dd6eb437733', 'request_id': 'req-b0966223-a533-4e5f-838b-4441287c01e7'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:16.056969 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b0966223-a533-4e5f-838b-4441287c01e7 admin admin] The token cache is being invalidate because project accb5a03dd614130808e9dd6eb437733 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:08:16.057258 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b0966223-a533-4e5f-838b-4441287c01e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:16.057918 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-b0966223-a533-4e5f-838b-4441287c01e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:16.059542 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1270/2537] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:08:15 2022] DELETE /identity/v3/projects/accb5a03dd614130808e9dd6eb437733 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:08:16.064706 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c07896-b6ea-44cf-a17a-ae2dd6b9f7d9 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:16.065190 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c07896-b6ea-44cf-a17a-ae2dd6b9f7d9 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:16.065404 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c07896-b6ea-44cf-a17a-ae2dd6b9f7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:16.083235 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-76c07896-b6ea-44cf-a17a-ae2dd6b9f7d9 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:16.084399 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-76c07896-b6ea-44cf-a17a-ae2dd6b9f7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:16.143346 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1268/2538] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:16.151806 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06261c-62e4-4e3d-96b5-be9c72c87a31 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:16.152089 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06261c-62e4-4e3d-96b5-be9c72c87a31 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:16.152361 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06261c-62e4-4e3d-96b5-be9c72c87a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:16.170143 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-cf06261c-62e4-4e3d-96b5-be9c72c87a31 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:16.171479 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-cf06261c-62e4-4e3d-96b5-be9c72c87a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:16.179431 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1271/2539] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:16.183616 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c07896-b6ea-44cf-a17a-ae2dd6b9f7d9 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:16.189293 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06261c-62e4-4e3d-96b5-be9c72c87a31 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:16.190946 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-cf06261c-62e4-4e3d-96b5-be9c72c87a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:16.193772 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c07896-b6ea-44cf-a17a-ae2dd6b9f7d9 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:16.199418 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df316805-9c32-403b-b722-b0eeedcfaab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:16.200142 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df316805-9c32-403b-b722-b0eeedcfaab9 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:16.200424 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df316805-9c32-403b-b722-b0eeedcfaab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:16.200695 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df316805-9c32-403b-b722-b0eeedcfaab9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:16.201422 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df316805-9c32-403b-b722-b0eeedcfaab9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:08:16.201725 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df316805-9c32-403b-b722-b0eeedcfaab9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:16.203352 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df316805-9c32-403b-b722-b0eeedcfaab9 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:16.208276 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06261c-62e4-4e3d-96b5-be9c72c87a31 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:16.216780 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1269/2540] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:08:16.216938 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c4bb0b-716e-4cbb-a9b9-d559c5f31fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:16.218070 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4bb0b-716e-4cbb-a9b9-d559c5f31fdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:16.218497 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4bb0b-716e-4cbb-a9b9-d559c5f31fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:16.218787 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c4bb0b-716e-4cbb-a9b9-d559c5f31fdd admin admin] PATH_INFO: `/v3/projects/8e10126821844f4cb497402dbb6c86c3` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:16.220302 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4bb0b-716e-4cbb-a9b9-d559c5f31fdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e10126821844f4cb497402dbb6c86c3)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:16.221128 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df316805-9c32-403b-b722-b0eeedcfaab9 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:16.222738 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c4bb0b-716e-4cbb-a9b9-d559c5f31fdd admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:16.233256 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df316805-9c32-403b-b722-b0eeedcfaab9 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:16.238362 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5b2e1-9cc0-4634-b190-bab8bc6cba7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:16.239041 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5b2e1-9cc0-4634-b190-bab8bc6cba7e admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:16.239322 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5b2e1-9cc0-4634-b190-bab8bc6cba7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:16.239624 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5b2e1-9cc0-4634-b190-bab8bc6cba7e admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:16.240318 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5b2e1-9cc0-4634-b190-bab8bc6cba7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:16.242252 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe5b2e1-9cc0-4634-b190-bab8bc6cba7e admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:16.317518 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-09c4bb0b-716e-4cbb-a9b9-d559c5f31fdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e10126821844f4cb497402dbb6c86c3', 'request_id': 'req-09c4bb0b-716e-4cbb-a9b9-d559c5f31fdd'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:16.348876 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1270/2541] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:08:16 2022] POST /identity/v3/projects => generated 399 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:08:16.353170 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5b2e1-9cc0-4634-b190-bab8bc6cba7e admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:16.358595 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-09c4bb0b-716e-4cbb-a9b9-d559c5f31fdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e10126821844f4cb497402dbb6c86c3', 'request_id': 'req-09c4bb0b-716e-4cbb-a9b9-d559c5f31fdd'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:16.365069 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-09c4bb0b-716e-4cbb-a9b9-d559c5f31fdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e10126821844f4cb497402dbb6c86c3', 'request_id': 'req-09c4bb0b-716e-4cbb-a9b9-d559c5f31fdd'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:16.377190 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-09c4bb0b-716e-4cbb-a9b9-d559c5f31fdd admin admin] The token cache is being invalidate because project 8e10126821844f4cb497402dbb6c86c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:08:16.377472 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-09c4bb0b-716e-4cbb-a9b9-d559c5f31fdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:16.378135 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-09c4bb0b-716e-4cbb-a9b9-d559c5f31fdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:16.379705 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1272/2542] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:08:16 2022] DELETE /identity/v3/projects/8e10126821844f4cb497402dbb6c86c3 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:08:16.386598 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a6d66-2738-4c22-9311-cfb967060c7f None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:16.386891 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a6d66-2738-4c22-9311-cfb967060c7f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:16.387165 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273a6d66-2738-4c22-9311-cfb967060c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:16.404196 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-273a6d66-2738-4c22-9311-cfb967060c7f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:16.405399 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-273a6d66-2738-4c22-9311-cfb967060c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:16.423381 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5b2e1-9cc0-4634-b190-bab8bc6cba7e admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:16.428117 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d3410-f20d-4fb7-b728-23af055e0bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:16.429288 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d3410-f20d-4fb7-b728-23af055e0bca admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:16.429563 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d3410-f20d-4fb7-b728-23af055e0bca admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:16.429831 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d3410-f20d-4fb7-b728-23af055e0bca admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:16.430508 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d3410-f20d-4fb7-b728-23af055e0bca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:16.432439 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d3410-f20d-4fb7-b728-23af055e0bca admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:16.462413 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1273/2543] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:08:16.470044 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be8ca-974a-4279-b034-6f5ce316f9ce None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:16.470330 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be8ca-974a-4279-b034-6f5ce316f9ce None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:16.470603 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be8ca-974a-4279-b034-6f5ce316f9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:16.487806 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-ec9be8ca-974a-4279-b034-6f5ce316f9ce None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:16.488971 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ec9be8ca-974a-4279-b034-6f5ce316f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:16.496246 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1271/2544] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:08:16 2022] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:08:16.497281 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1274/2545] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:08:16.501392 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d3410-f20d-4fb7-b728-23af055e0bca admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:16.504285 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9be8ca-974a-4279-b034-6f5ce316f9ce None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:16.505546 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ec9be8ca-974a-4279-b034-6f5ce316f9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:16.511950 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d3410-f20d-4fb7-b728-23af055e0bca admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:16.516731 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73583cb1-5f45-4b91-9734-107771199e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:16.517371 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73583cb1-5f45-4b91-9734-107771199e0f admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:16.517476 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9be8ca-974a-4279-b034-6f5ce316f9ce None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:16.517652 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73583cb1-5f45-4b91-9734-107771199e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:16.517926 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73583cb1-5f45-4b91-9734-107771199e0f admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:16.518644 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73583cb1-5f45-4b91-9734-107771199e0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:08:16.518989 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73583cb1-5f45-4b91-9734-107771199e0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:16.520569 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73583cb1-5f45-4b91-9734-107771199e0f admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:16.522046 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb6c64-54e3-43f2-a33c-37eb518a51ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:16.522684 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb6c64-54e3-43f2-a33c-37eb518a51ad admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:16.522986 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb6c64-54e3-43f2-a33c-37eb518a51ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:16.523251 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eb6c64-54e3-43f2-a33c-37eb518a51ad admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:16.523963 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb6c64-54e3-43f2-a33c-37eb518a51ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:16.525542 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eb6c64-54e3-43f2-a33c-37eb518a51ad admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:16.532039 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1272/2546] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:08:16.538903 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1275/2547] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:08:16.539082 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73583cb1-5f45-4b91-9734-107771199e0f admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:16.539837 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb6c64-54e3-43f2-a33c-37eb518a51ad admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:16.546336 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73583cb1-5f45-4b91-9734-107771199e0f admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:16.549310 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eb6c64-54e3-43f2-a33c-37eb518a51ad admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:16.551160 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bebad7-4e09-4fe7-a15c-2817460c6106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:16.551794 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bebad7-4e09-4fe7-a15c-2817460c6106 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:16.552066 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bebad7-4e09-4fe7-a15c-2817460c6106 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:16.552330 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bebad7-4e09-4fe7-a15c-2817460c6106 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:16.553028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bebad7-4e09-4fe7-a15c-2817460c6106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:16.554481 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4b4d4-c1f3-4712-a285-973c2d288c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:16.555146 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4b4d4-c1f3-4712-a285-973c2d288c8e admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:16.555428 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4b4d4-c1f3-4712-a285-973c2d288c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:16.555540 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bebad7-4e09-4fe7-a15c-2817460c6106 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:16.555705 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4b4d4-c1f3-4712-a285-973c2d288c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:16.556420 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4b4d4-c1f3-4712-a285-973c2d288c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:16.557964 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4b4d4-c1f3-4712-a285-973c2d288c8e admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:16.568290 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1276/2548] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:08:16.572659 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4b4d4-c1f3-4712-a285-973c2d288c8e admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:16.581948 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4b4d4-c1f3-4712-a285-973c2d288c8e admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:16.586686 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cf9ca-01d3-4ad2-892e-96d9a55d30c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:16.587548 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cf9ca-01d3-4ad2-892e-96d9a55d30c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:16.587830 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cf9ca-01d3-4ad2-892e-96d9a55d30c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:16.588103 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cf9ca-01d3-4ad2-892e-96d9a55d30c5 admin admin] PATH_INFO: `/v3/projects/135f60730aeb46d3a60f0d98ac824634/users/7c1f89154436444fba562154bfe4981d/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:16.601979 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cf9ca-01d3-4ad2-892e-96d9a55d30c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=135f60730aeb46d3a60f0d98ac824634, user_id=7c1f89154436444fba562154bfe4981d, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:16.605465 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cf9ca-01d3-4ad2-892e-96d9a55d30c5 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:16.637956 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1273/2549] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:08:16 2022] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:08:16.641920 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bebad7-4e09-4fe7-a15c-2817460c6106 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:16.700758 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bebad7-4e09-4fe7-a15c-2817460c6106 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:16.705368 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c1288-2608-44c9-98c5-ef7777b78fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:16.706022 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c1288-2608-44c9-98c5-ef7777b78fac admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:16.706297 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c1288-2608-44c9-98c5-ef7777b78fac admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:16.706565 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c1288-2608-44c9-98c5-ef7777b78fac admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:16.707286 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c1288-2608-44c9-98c5-ef7777b78fac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:16.709165 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c1288-2608-44c9-98c5-ef7777b78fac admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:16.720131 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1277/2550] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:08:16 2022] PUT /identity/v3/projects/135f60730aeb46d3a60f0d98ac824634/users/7c1f89154436444fba562154bfe4981d/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:08:16.727971 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080109df-527b-451b-9439-837d031443ce None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:16.728261 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080109df-527b-451b-9439-837d031443ce None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:16.728540 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080109df-527b-451b-9439-837d031443ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:16.754950 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-080109df-527b-451b-9439-837d031443ce None None] MFA Rules not processed for user `7c1f89154436444fba562154bfe4981d`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:16.756179 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-080109df-527b-451b-9439-837d031443ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:16.802376 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1274/2551] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:08:16 2022] POST /identity/v3/users => generated 303 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:08:16.806943 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c1288-2608-44c9-98c5-ef7777b78fac admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:16.816279 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c1288-2608-44c9-98c5-ef7777b78fac admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:16.818432 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1278/2552] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:16 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:16.829686 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080109df-527b-451b-9439-837d031443ce None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:16.831059 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-080109df-527b-451b-9439-837d031443ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:16.872143 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8b898-ef66-4297-acbf-07661ec89b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:16.872814 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8b898-ef66-4297-acbf-07661ec89b5f admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:16.873091 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8b898-ef66-4297-acbf-07661ec89b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:16.873361 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8b898-ef66-4297-acbf-07661ec89b5f admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:16.874085 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8b898-ef66-4297-acbf-07661ec89b5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:16.875701 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8b898-ef66-4297-acbf-07661ec89b5f admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:16.885279 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1275/2553] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:08:16.885964 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080109df-527b-451b-9439-837d031443ce None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:16.889124 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8b898-ef66-4297-acbf-07661ec89b5f admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:16.889858 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb97d79-d9f5-4546-8aa9-6d1a04dda57c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:16.890483 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb97d79-d9f5-4546-8aa9-6d1a04dda57c service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:16.890758 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb97d79-d9f5-4546-8aa9-6d1a04dda57c service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:16.891125 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb97d79-d9f5-4546-8aa9-6d1a04dda57c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:16.898337 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8b898-ef66-4297-acbf-07661ec89b5f admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:16.899765 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb97d79-d9f5-4546-8aa9-6d1a04dda57c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:16.901189 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb97d79-d9f5-4546-8aa9-6d1a04dda57c service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:16.902907 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb414214-2cc6-4aa4-a74e-2c594c95f51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:16.903525 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb414214-2cc6-4aa4-a74e-2c594c95f51d admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:16.903804 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb414214-2cc6-4aa4-a74e-2c594c95f51d admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:16.904074 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb414214-2cc6-4aa4-a74e-2c594c95f51d admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:16.904776 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb414214-2cc6-4aa4-a74e-2c594c95f51d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:16.906314 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb414214-2cc6-4aa4-a74e-2c594c95f51d admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:16.910248 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1279/2554] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:08:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:08:16.916408 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1276/2555] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:08:16.920486 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb97d79-d9f5-4546-8aa9-6d1a04dda57c service cinder] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:16.933187 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb97d79-d9f5-4546-8aa9-6d1a04dda57c service cinder] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:16.937924 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88089a1e-4ac4-487b-8960-30081fdc960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:16.938798 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88089a1e-4ac4-487b-8960-30081fdc960a admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:16.939116 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88089a1e-4ac4-487b-8960-30081fdc960a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:16.939493 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88089a1e-4ac4-487b-8960-30081fdc960a admin admin] PATH_INFO: `/v3/projects/188074fb832945a3bddc423c53c00ffc/users/839d42b59d7f4243be2ca45e619d8784/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:16.954931 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88089a1e-4ac4-487b-8960-30081fdc960a admin admin] RBAC: Authorizing `identity:create_grant(project_id=188074fb832945a3bddc423c53c00ffc, user_id=839d42b59d7f4243be2ca45e619d8784, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:16.957557 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88089a1e-4ac4-487b-8960-30081fdc960a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:17.044150 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1280/2556] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:08:16 2022] PUT /identity/v3/projects/188074fb832945a3bddc423c53c00ffc/users/839d42b59d7f4243be2ca45e619d8784/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:17.055476 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053e84c-399f-41d7-a98e-8898d189a22d None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:17.055764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053e84c-399f-41d7-a98e-8898d189a22d None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:17.056041 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8053e84c-399f-41d7-a98e-8898d189a22d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:17.082345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-8053e84c-399f-41d7-a98e-8898d189a22d None None] MFA Rules not processed for user `839d42b59d7f4243be2ca45e619d8784`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:17.083601 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-8053e84c-399f-41d7-a98e-8898d189a22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:17.146389 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1277/2557] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:17 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:08:17.151391 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88089a1e-4ac4-487b-8960-30081fdc960a admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:17.210162 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88089a1e-4ac4-487b-8960-30081fdc960a admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:17.214807 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a61f3-620d-40cf-8f68-11ae9365b552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:17.215477 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a61f3-620d-40cf-8f68-11ae9365b552 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:17.215755 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a61f3-620d-40cf-8f68-11ae9365b552 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:17.216024 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98a61f3-620d-40cf-8f68-11ae9365b552 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:17.216700 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a61f3-620d-40cf-8f68-11ae9365b552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:17.218638 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98a61f3-620d-40cf-8f68-11ae9365b552 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:17.300312 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1281/2558] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:08:17 2022] POST /identity/v3/projects => generated 403 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:08:17.304262 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053e84c-399f-41d7-a98e-8898d189a22d None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:17.314916 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8053e84c-399f-41d7-a98e-8898d189a22d None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:17.369417 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58065f-f690-4d8f-a27e-da24895fe840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:17.370077 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58065f-f690-4d8f-a27e-da24895fe840 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:17.370358 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58065f-f690-4d8f-a27e-da24895fe840 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:17.370631 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58065f-f690-4d8f-a27e-da24895fe840 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:17.371359 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58065f-f690-4d8f-a27e-da24895fe840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:17.373261 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58065f-f690-4d8f-a27e-da24895fe840 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:17.438678 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1278/2559] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:08:17 2022] POST /identity/v3/users => generated 308 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:08:17.442637 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a61f3-620d-40cf-8f68-11ae9365b552 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:17.453071 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98a61f3-620d-40cf-8f68-11ae9365b552 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:17.457826 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640177bf-02a3-41e5-9f83-84c4d82114e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:17.458401 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640177bf-02a3-41e5-9f83-84c4d82114e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:17.458674 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640177bf-02a3-41e5-9f83-84c4d82114e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:17.459000 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640177bf-02a3-41e5-9f83-84c4d82114e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:17.459716 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640177bf-02a3-41e5-9f83-84c4d82114e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:17.464698 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640177bf-02a3-41e5-9f83-84c4d82114e8 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:17.471924 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1282/2560] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:08:17.475926 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58065f-f690-4d8f-a27e-da24895fe840 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:17.486028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58065f-f690-4d8f-a27e-da24895fe840 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:17.490652 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2031b-cffa-4aa0-80de-1970edc22ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:17.491543 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2031b-cffa-4aa0-80de-1970edc22ff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:17.491818 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2031b-cffa-4aa0-80de-1970edc22ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:17.492086 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2031b-cffa-4aa0-80de-1970edc22ff6 admin admin] PATH_INFO: `/v3/projects/5b9ce13719f24c098ad67b7cef96d7a0/users/984888ff2f7c4ead9fa4d3523ed013da/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:17.506267 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2031b-cffa-4aa0-80de-1970edc22ff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b9ce13719f24c098ad67b7cef96d7a0, user_id=984888ff2f7c4ead9fa4d3523ed013da, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:17.509449 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2031b-cffa-4aa0-80de-1970edc22ff6 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:17.593803 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1279/2561] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:08:17 2022] PUT /identity/v3/projects/5b9ce13719f24c098ad67b7cef96d7a0/users/984888ff2f7c4ead9fa4d3523ed013da/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:17.597679 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640177bf-02a3-41e5-9f83-84c4d82114e8 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:17.607408 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640177bf-02a3-41e5-9f83-84c4d82114e8 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:17.663325 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766abac-4149-4efb-b9fe-c90c61d97194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:17.663939 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766abac-4149-4efb-b9fe-c90c61d97194 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:17.664219 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766abac-4149-4efb-b9fe-c90c61d97194 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:17.664492 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766abac-4149-4efb-b9fe-c90c61d97194 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:17.665213 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766abac-4149-4efb-b9fe-c90c61d97194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:17.666860 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766abac-4149-4efb-b9fe-c90c61d97194 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:17.677154 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1283/2562] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:08:17.681477 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2031b-cffa-4aa0-80de-1970edc22ff6 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:17.692104 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2031b-cffa-4aa0-80de-1970edc22ff6 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:17.697388 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2eda60-10b3-4c37-9640-cd73674ba39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:17.698266 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2eda60-10b3-4c37-9640-cd73674ba39c admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:17.698545 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2eda60-10b3-4c37-9640-cd73674ba39c admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:17.698913 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2eda60-10b3-4c37-9640-cd73674ba39c admin admin] PATH_INFO: `/v3/projects/5b9ce13719f24c098ad67b7cef96d7a0/users/984888ff2f7c4ead9fa4d3523ed013da/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:17.701539 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2eda60-10b3-4c37-9640-cd73674ba39c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b9ce13719f24c098ad67b7cef96d7a0, user_id=984888ff2f7c4ead9fa4d3523ed013da, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:17.703592 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2eda60-10b3-4c37-9640-cd73674ba39c admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:17.714307 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1280/2563] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:08:17 2022] PUT /identity/v3/projects/5b9ce13719f24c098ad67b7cef96d7a0/users/984888ff2f7c4ead9fa4d3523ed013da/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:17.724590 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed049d7e-863f-420e-a958-81bb03e5cbac None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:17.725120 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed049d7e-863f-420e-a958-81bb03e5cbac None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:17.725227 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed049d7e-863f-420e-a958-81bb03e5cbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:17.750709 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-ed049d7e-863f-420e-a958-81bb03e5cbac None None] MFA Rules not processed for user `984888ff2f7c4ead9fa4d3523ed013da`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:17.751943 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ed049d7e-863f-420e-a958-81bb03e5cbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:17.818650 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1284/2564] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:17 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:17.830304 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2eda60-10b3-4c37-9640-cd73674ba39c admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:17.832017 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-df2eda60-10b3-4c37-9640-cd73674ba39c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:17.891394 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2eda60-10b3-4c37-9640-cd73674ba39c admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:17.895167 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e65d3-a66f-4486-b8b1-400c15489fba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:17.895814 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e65d3-a66f-4486-b8b1-400c15489fba service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:17.896116 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e65d3-a66f-4486-b8b1-400c15489fba service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:17.896397 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e65d3-a66f-4486-b8b1-400c15489fba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:17.906035 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e65d3-a66f-4486-b8b1-400c15489fba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:17.907585 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e65d3-a66f-4486-b8b1-400c15489fba service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:17.917061 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1281/2565] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:08:17 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:08:18.042604 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed049d7e-863f-420e-a958-81bb03e5cbac None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:18.102358 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed049d7e-863f-420e-a958-81bb03e5cbac None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:18.106909 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9cdb9-d1fd-4be2-98fb-4b2b93ce7452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:18.107734 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9cdb9-d1fd-4be2-98fb-4b2b93ce7452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:18.108014 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9cdb9-d1fd-4be2-98fb-4b2b93ce7452 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:18.108289 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9cdb9-d1fd-4be2-98fb-4b2b93ce7452 admin admin] PATH_INFO: `/v3/users/839d42b59d7f4243be2ca45e619d8784` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:18.109469 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9cdb9-d1fd-4be2-98fb-4b2b93ce7452 admin admin] RBAC: Authorizing `identity:delete_user(user_id=839d42b59d7f4243be2ca45e619d8784)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:18.111686 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9cdb9-d1fd-4be2-98fb-4b2b93ce7452 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:18.340956 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4da9cdb9-d1fd-4be2-98fb-4b2b93ce7452 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '839d42b59d7f4243be2ca45e619d8784'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:18.441902 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4da9cdb9-d1fd-4be2-98fb-4b2b93ce7452 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '839d42b59d7f4243be2ca45e619d8784'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:18.442465 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4da9cdb9-d1fd-4be2-98fb-4b2b93ce7452 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '839d42b59d7f4243be2ca45e619d8784'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:18.449284 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4da9cdb9-d1fd-4be2-98fb-4b2b93ce7452 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '839d42b59d7f4243be2ca45e619d8784'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:18.460689 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4da9cdb9-d1fd-4be2-98fb-4b2b93ce7452 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '839d42b59d7f4243be2ca45e619d8784'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:18.466653 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1285/2566] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:08:18 2022] DELETE /identity/v3/users/839d42b59d7f4243be2ca45e619d8784 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:18.471361 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff5ad7-8dd4-45c8-a065-0a5b63dabd87 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:18.471841 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff5ad7-8dd4-45c8-a065-0a5b63dabd87 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:18.471938 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bff5ad7-8dd4-45c8-a065-0a5b63dabd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:18.489808 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-8bff5ad7-8dd4-45c8-a065-0a5b63dabd87 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:18.491027 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-8bff5ad7-8dd4-45c8-a065-0a5b63dabd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:18.547218 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1282/2567] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:18.557399 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9cdb9-d1fd-4be2-98fb-4b2b93ce7452 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:18.558780 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-4da9cdb9-d1fd-4be2-98fb-4b2b93ce7452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:18.618031 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9cdb9-d1fd-4be2-98fb-4b2b93ce7452 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:18.621636 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a3eb9-3d10-4598-b05b-faa0e169f6e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:18.622264 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a3eb9-3d10-4598-b05b-faa0e169f6e1 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:18.622544 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a3eb9-3d10-4598-b05b-faa0e169f6e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:18.622815 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a3eb9-3d10-4598-b05b-faa0e169f6e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:18.631910 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a3eb9-3d10-4598-b05b-faa0e169f6e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:18.633332 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923a3eb9-3d10-4598-b05b-faa0e169f6e1 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:18.643097 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1286/2568] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:08:19.055516 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff5ad7-8dd4-45c8-a065-0a5b63dabd87 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:19.056958 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-8bff5ad7-8dd4-45c8-a065-0a5b63dabd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:19.071233 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bff5ad7-8dd4-45c8-a065-0a5b63dabd87 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:19.076258 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9b859-951a-4906-9d39-358ae0ffc32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:19.077448 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9b859-951a-4906-9d39-358ae0ffc32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:19.077724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9b859-951a-4906-9d39-358ae0ffc32d admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:19.077891 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d9b859-951a-4906-9d39-358ae0ffc32d admin admin] PATH_INFO: `/v3/projects/188074fb832945a3bddc423c53c00ffc` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:19.079078 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9b859-951a-4906-9d39-358ae0ffc32d admin admin] RBAC: Authorizing `identity:delete_project(project_id=188074fb832945a3bddc423c53c00ffc)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:19.080985 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d9b859-951a-4906-9d39-358ae0ffc32d admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:19.251502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-61d9b859-951a-4906-9d39-358ae0ffc32d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188074fb832945a3bddc423c53c00ffc', 'request_id': 'req-61d9b859-951a-4906-9d39-358ae0ffc32d'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:19.257391 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-61d9b859-951a-4906-9d39-358ae0ffc32d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188074fb832945a3bddc423c53c00ffc', 'request_id': 'req-61d9b859-951a-4906-9d39-358ae0ffc32d'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:19.345375 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-61d9b859-951a-4906-9d39-358ae0ffc32d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188074fb832945a3bddc423c53c00ffc', 'request_id': 'req-61d9b859-951a-4906-9d39-358ae0ffc32d'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:19.356589 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-61d9b859-951a-4906-9d39-358ae0ffc32d admin admin] The token cache is being invalidate because project 188074fb832945a3bddc423c53c00ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:08:19.356875 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-61d9b859-951a-4906-9d39-358ae0ffc32d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:19.357552 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-61d9b859-951a-4906-9d39-358ae0ffc32d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:19.359153 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1283/2569] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:08:19 2022] DELETE /identity/v3/projects/188074fb832945a3bddc423c53c00ffc => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:19.363446 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a3eb9-3d10-4598-b05b-faa0e169f6e1 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:19.373513 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a3eb9-3d10-4598-b05b-faa0e169f6e1 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:19.426186 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb51aa9-7b14-4b81-8f1a-35223ee3a725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:19.427059 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb51aa9-7b14-4b81-8f1a-35223ee3a725 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:19.427339 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb51aa9-7b14-4b81-8f1a-35223ee3a725 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:19.427610 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb51aa9-7b14-4b81-8f1a-35223ee3a725 admin admin] PATH_INFO: `/v3/users/984888ff2f7c4ead9fa4d3523ed013da` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:19.428785 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb51aa9-7b14-4b81-8f1a-35223ee3a725 admin admin] RBAC: Authorizing `identity:delete_user(user_id=984888ff2f7c4ead9fa4d3523ed013da)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:19.431237 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb51aa9-7b14-4b81-8f1a-35223ee3a725 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:19.627277 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-dbb51aa9-7b14-4b81-8f1a-35223ee3a725 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '984888ff2f7c4ead9fa4d3523ed013da'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:19.695779 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-dbb51aa9-7b14-4b81-8f1a-35223ee3a725 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '984888ff2f7c4ead9fa4d3523ed013da'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:19.696398 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-dbb51aa9-7b14-4b81-8f1a-35223ee3a725 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '984888ff2f7c4ead9fa4d3523ed013da'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:19.703850 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-dbb51aa9-7b14-4b81-8f1a-35223ee3a725 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '984888ff2f7c4ead9fa4d3523ed013da'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:19.715049 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-dbb51aa9-7b14-4b81-8f1a-35223ee3a725 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '984888ff2f7c4ead9fa4d3523ed013da'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:19.720988 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1287/2570] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:08:19 2022] DELETE /identity/v3/users/984888ff2f7c4ead9fa4d3523ed013da => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:20.114227 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9b859-951a-4906-9d39-358ae0ffc32d admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:20.115751 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-61d9b859-951a-4906-9d39-358ae0ffc32d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:20.130640 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d9b859-951a-4906-9d39-358ae0ffc32d admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:20.191796 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a9f45-8d5a-4599-a20d-8784a6d02d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:20.192790 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a9f45-8d5a-4599-a20d-8784a6d02d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:20.193174 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a9f45-8d5a-4599-a20d-8784a6d02d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:20.193551 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a9f45-8d5a-4599-a20d-8784a6d02d22 admin admin] PATH_INFO: `/v3/projects/5b9ce13719f24c098ad67b7cef96d7a0` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:20.195289 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a9f45-8d5a-4599-a20d-8784a6d02d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b9ce13719f24c098ad67b7cef96d7a0)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:20.197309 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a9f45-8d5a-4599-a20d-8784a6d02d22 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:20.299521 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-de5a9f45-8d5a-4599-a20d-8784a6d02d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b9ce13719f24c098ad67b7cef96d7a0', 'request_id': 'req-de5a9f45-8d5a-4599-a20d-8784a6d02d22'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:20.305353 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-de5a9f45-8d5a-4599-a20d-8784a6d02d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b9ce13719f24c098ad67b7cef96d7a0', 'request_id': 'req-de5a9f45-8d5a-4599-a20d-8784a6d02d22'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:20.385633 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-de5a9f45-8d5a-4599-a20d-8784a6d02d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b9ce13719f24c098ad67b7cef96d7a0', 'request_id': 'req-de5a9f45-8d5a-4599-a20d-8784a6d02d22'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:20.396829 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-de5a9f45-8d5a-4599-a20d-8784a6d02d22 admin admin] The token cache is being invalidate because project 5b9ce13719f24c098ad67b7cef96d7a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:08:20.397112 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-de5a9f45-8d5a-4599-a20d-8784a6d02d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:20.397738 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-de5a9f45-8d5a-4599-a20d-8784a6d02d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:20.399852 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1284/2571] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:08:20 2022] DELETE /identity/v3/projects/5b9ce13719f24c098ad67b7cef96d7a0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:20.404718 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fc14f-d124-4ef7-81c1-ae5fa394286a None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:20.405749 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fc14f-d124-4ef7-81c1-ae5fa394286a None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:20.405749 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fc14f-d124-4ef7-81c1-ae5fa394286a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:20.423618 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-379fc14f-d124-4ef7-81c1-ae5fa394286a None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:20.424802 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-379fc14f-d124-4ef7-81c1-ae5fa394286a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:20.481677 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1288/2572] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:20.489538 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203afbc9-b75c-4c5f-b5b8-38e1878e2738 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:20.489823 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203afbc9-b75c-4c5f-b5b8-38e1878e2738 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:20.490094 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203afbc9-b75c-4c5f-b5b8-38e1878e2738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:20.507607 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-203afbc9-b75c-4c5f-b5b8-38e1878e2738 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:20.509305 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-203afbc9-b75c-4c5f-b5b8-38e1878e2738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:20.517018 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1285/2573] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:20.520933 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fc14f-d124-4ef7-81c1-ae5fa394286a None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:20.530763 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fc14f-d124-4ef7-81c1-ae5fa394286a None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:20.535283 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40c455-d047-42fa-9948-d7aa806c96fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:20.535916 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40c455-d047-42fa-9948-d7aa806c96fd admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:20.536272 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40c455-d047-42fa-9948-d7aa806c96fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:20.536539 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca40c455-d047-42fa-9948-d7aa806c96fd admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:20.537256 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40c455-d047-42fa-9948-d7aa806c96fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:08:20.537555 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40c455-d047-42fa-9948-d7aa806c96fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:20.539179 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca40c455-d047-42fa-9948-d7aa806c96fd admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:20.550465 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1289/2574] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:08:20.554405 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203afbc9-b75c-4c5f-b5b8-38e1878e2738 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:20.563293 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203afbc9-b75c-4c5f-b5b8-38e1878e2738 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:20.567818 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ec44c-f241-4741-b6d8-8dd00834924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:20.568446 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ec44c-f241-4741-b6d8-8dd00834924d admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:20.568721 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ec44c-f241-4741-b6d8-8dd00834924d admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:20.568989 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ec44c-f241-4741-b6d8-8dd00834924d admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:20.569666 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ec44c-f241-4741-b6d8-8dd00834924d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:20.572202 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ec44c-f241-4741-b6d8-8dd00834924d admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:20.660331 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1286/2575] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:08:20 2022] POST /identity/v3/projects => generated 405 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:08:20.664516 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40c455-d047-42fa-9948-d7aa806c96fd admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:20.674126 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca40c455-d047-42fa-9948-d7aa806c96fd admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:20.727897 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ddb6d-bbf5-411a-b726-2372c49448a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:20.728555 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ddb6d-bbf5-411a-b726-2372c49448a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:20.728835 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ddb6d-bbf5-411a-b726-2372c49448a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:20.729109 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ddb6d-bbf5-411a-b726-2372c49448a4 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:20.729799 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ddb6d-bbf5-411a-b726-2372c49448a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:20.731736 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1ddb6d-bbf5-411a-b726-2372c49448a4 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:20.819333 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1290/2576] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:08:20 2022] POST /identity/v3/users => generated 303 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:08:20.824061 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ec44c-f241-4741-b6d8-8dd00834924d admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:20.834280 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ec44c-f241-4741-b6d8-8dd00834924d admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:20.838994 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d49cd7-6b8a-4eb5-ab3f-eac9e72700fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:20.839636 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d49cd7-6b8a-4eb5-ab3f-eac9e72700fa admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:20.839915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d49cd7-6b8a-4eb5-ab3f-eac9e72700fa admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:20.840185 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d49cd7-6b8a-4eb5-ab3f-eac9e72700fa admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:20.841001 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d49cd7-6b8a-4eb5-ab3f-eac9e72700fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:20.842650 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d49cd7-6b8a-4eb5-ab3f-eac9e72700fa admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:20.852855 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1287/2577] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:08:20.856672 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ddb6d-bbf5-411a-b726-2372c49448a4 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:20.866636 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1ddb6d-bbf5-411a-b726-2372c49448a4 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:20.871660 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c255b04-f9a6-4e51-afb0-c4543fbc9680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:20.872294 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c255b04-f9a6-4e51-afb0-c4543fbc9680 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:20.872568 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c255b04-f9a6-4e51-afb0-c4543fbc9680 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:20.872837 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c255b04-f9a6-4e51-afb0-c4543fbc9680 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:20.873553 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c255b04-f9a6-4e51-afb0-c4543fbc9680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:20.875145 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c255b04-f9a6-4e51-afb0-c4543fbc9680 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:20.885213 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1291/2578] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:08:20.889219 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d49cd7-6b8a-4eb5-ab3f-eac9e72700fa admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:20.898768 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d49cd7-6b8a-4eb5-ab3f-eac9e72700fa admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:20.903373 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12980588-ab3e-4e22-93d2-0201f32130cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:20.904224 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12980588-ab3e-4e22-93d2-0201f32130cf admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:20.904497 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12980588-ab3e-4e22-93d2-0201f32130cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:20.904761 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12980588-ab3e-4e22-93d2-0201f32130cf admin admin] PATH_INFO: `/v3/projects/54832b1e6c2947c28ec827fff99fdb30/users/e096e255ea964f79af2389c62b872402/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:20.918480 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12980588-ab3e-4e22-93d2-0201f32130cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=54832b1e6c2947c28ec827fff99fdb30, user_id=e096e255ea964f79af2389c62b872402, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:20.921073 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12980588-ab3e-4e22-93d2-0201f32130cf admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:20.973169 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1288/2579] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:08:20 2022] PUT /identity/v3/projects/54832b1e6c2947c28ec827fff99fdb30/users/e096e255ea964f79af2389c62b872402/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:20.978237 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71498efb-b88c-4620-997b-47c79065e2c6 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:20.978525 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71498efb-b88c-4620-997b-47c79065e2c6 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:20.978796 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71498efb-b88c-4620-997b-47c79065e2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:20.996671 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-71498efb-b88c-4620-997b-47c79065e2c6 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:20.997845 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-71498efb-b88c-4620-997b-47c79065e2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:21.053397 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1292/2580] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:08:21.063507 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12980588-ab3e-4e22-93d2-0201f32130cf admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:21.065222 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-12980588-ab3e-4e22-93d2-0201f32130cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:21.119615 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12980588-ab3e-4e22-93d2-0201f32130cf admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:21.123382 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c02f8-80ce-4183-a6c7-daba47b9f87d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:21.124055 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c02f8-80ce-4183-a6c7-daba47b9f87d service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:21.124333 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c02f8-80ce-4183-a6c7-daba47b9f87d service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:21.124603 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c02f8-80ce-4183-a6c7-daba47b9f87d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:21.134125 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c02f8-80ce-4183-a6c7-daba47b9f87d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:21.135592 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c02f8-80ce-4183-a6c7-daba47b9f87d service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:21.144752 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1289/2581] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:08:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:08:22.307704 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fb263-8631-4c81-addd-c77354a6a272 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:22.308230 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fb263-8631-4c81-addd-c77354a6a272 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:22.308384 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315fb263-8631-4c81-addd-c77354a6a272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:22.335133 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-315fb263-8631-4c81-addd-c77354a6a272 None None] MFA Rules not processed for user `e096e255ea964f79af2389c62b872402`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:22.339208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-315fb263-8631-4c81-addd-c77354a6a272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:22.398283 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1293/2582] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:22 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:08:22.402744 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c02f8-80ce-4183-a6c7-daba47b9f87d service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:22.412124 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c02f8-80ce-4183-a6c7-daba47b9f87d service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:22.416631 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4791268-2ab1-4344-9778-8c0ee3510260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:22.417266 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4791268-2ab1-4344-9778-8c0ee3510260 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:22.417547 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4791268-2ab1-4344-9778-8c0ee3510260 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:22.417819 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4791268-2ab1-4344-9778-8c0ee3510260 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:22.418500 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4791268-2ab1-4344-9778-8c0ee3510260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:22.420409 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4791268-2ab1-4344-9778-8c0ee3510260 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:22.506256 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1290/2583] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:08:22 2022] POST /identity/v3/projects => generated 403 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:08:22.510877 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fb263-8631-4c81-addd-c77354a6a272 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:22.521432 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315fb263-8631-4c81-addd-c77354a6a272 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:22.574543 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717ff1c-33eb-43c3-b601-ca4d7933850f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:22.575162 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717ff1c-33eb-43c3-b601-ca4d7933850f admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:22.575443 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717ff1c-33eb-43c3-b601-ca4d7933850f admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:22.575717 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717ff1c-33eb-43c3-b601-ca4d7933850f admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:22.576409 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717ff1c-33eb-43c3-b601-ca4d7933850f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:22.578297 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5717ff1c-33eb-43c3-b601-ca4d7933850f admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:22.694729 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1294/2584] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:08:22 2022] POST /identity/v3/users => generated 308 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:08:22.698681 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4791268-2ab1-4344-9778-8c0ee3510260 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:22.709279 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4791268-2ab1-4344-9778-8c0ee3510260 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:22.713888 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ab367-e519-44d2-b225-d9181a9cd44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:22.714572 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ab367-e519-44d2-b225-d9181a9cd44a admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:22.714876 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ab367-e519-44d2-b225-d9181a9cd44a admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:22.717098 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ab367-e519-44d2-b225-d9181a9cd44a admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:22.717098 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ab367-e519-44d2-b225-d9181a9cd44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:22.717528 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ab367-e519-44d2-b225-d9181a9cd44a admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:22.728894 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1291/2585] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:08:22.733214 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717ff1c-33eb-43c3-b601-ca4d7933850f admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:22.744548 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717ff1c-33eb-43c3-b601-ca4d7933850f admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:22.749367 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16e163-7966-45de-804f-c2199f4c690d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:22.750265 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16e163-7966-45de-804f-c2199f4c690d admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:22.750542 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16e163-7966-45de-804f-c2199f4c690d admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:22.750811 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d16e163-7966-45de-804f-c2199f4c690d admin admin] PATH_INFO: `/v3/projects/53aed79747a5439baed00cbf241488e8/users/6ee3a6fe30654343aea4016bc19417eb/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:22.766993 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16e163-7966-45de-804f-c2199f4c690d admin admin] RBAC: Authorizing `identity:create_grant(project_id=53aed79747a5439baed00cbf241488e8, user_id=6ee3a6fe30654343aea4016bc19417eb, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:22.769666 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d16e163-7966-45de-804f-c2199f4c690d admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:22.851490 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1295/2586] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:08:22 2022] PUT /identity/v3/projects/53aed79747a5439baed00cbf241488e8/users/6ee3a6fe30654343aea4016bc19417eb/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:22.853276 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ab367-e519-44d2-b225-d9181a9cd44a admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:22.863812 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ab367-e519-44d2-b225-d9181a9cd44a admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:22.918144 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280b3792-1416-41e8-82fe-83677a403d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:22.918809 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b3792-1416-41e8-82fe-83677a403d14 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:22.919121 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b3792-1416-41e8-82fe-83677a403d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:22.919424 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280b3792-1416-41e8-82fe-83677a403d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:22.920148 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b3792-1416-41e8-82fe-83677a403d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:22.921726 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280b3792-1416-41e8-82fe-83677a403d14 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:22.931529 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1292/2587] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:08:22.936739 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16e163-7966-45de-804f-c2199f4c690d admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:22.946815 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d16e163-7966-45de-804f-c2199f4c690d admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:22.951348 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67424d40-e860-4734-8dd2-55e91deaf699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:22.952245 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67424d40-e860-4734-8dd2-55e91deaf699 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:22.952530 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67424d40-e860-4734-8dd2-55e91deaf699 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:22.952786 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67424d40-e860-4734-8dd2-55e91deaf699 admin admin] PATH_INFO: `/v3/projects/53aed79747a5439baed00cbf241488e8/users/6ee3a6fe30654343aea4016bc19417eb/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:22.954739 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67424d40-e860-4734-8dd2-55e91deaf699 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53aed79747a5439baed00cbf241488e8, user_id=6ee3a6fe30654343aea4016bc19417eb, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:22.957341 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67424d40-e860-4734-8dd2-55e91deaf699 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:22.968194 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1296/2588] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:08:22 2022] PUT /identity/v3/projects/53aed79747a5439baed00cbf241488e8/users/6ee3a6fe30654343aea4016bc19417eb/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:24.170909 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c0dd0-02bb-481f-b230-a25f1751358f None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:24.171407 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c0dd0-02bb-481f-b230-a25f1751358f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:24.171501 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c0dd0-02bb-481f-b230-a25f1751358f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:24.200815 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-597c0dd0-02bb-481f-b230-a25f1751358f None None] MFA Rules not processed for user `6ee3a6fe30654343aea4016bc19417eb`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:24.202209 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-597c0dd0-02bb-481f-b230-a25f1751358f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:24.270145 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1293/2589] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:24 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:25.534364 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67424d40-e860-4734-8dd2-55e91deaf699 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:25.594381 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67424d40-e860-4734-8dd2-55e91deaf699 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:25.598913 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6946b-b275-4f66-8f63-3c7735bd4dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:25.599757 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6946b-b275-4f66-8f63-3c7735bd4dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:25.600032 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6946b-b275-4f66-8f63-3c7735bd4dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:25.600296 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6946b-b275-4f66-8f63-3c7735bd4dcf admin admin] PATH_INFO: `/v3/users/e096e255ea964f79af2389c62b872402` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:25.601453 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6946b-b275-4f66-8f63-3c7735bd4dcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e096e255ea964f79af2389c62b872402)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:25.603391 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6946b-b275-4f66-8f63-3c7735bd4dcf admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:25.768782 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c0dd0-02bb-481f-b230-a25f1751358f None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:25.770210 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-597c0dd0-02bb-481f-b230-a25f1751358f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:25.783854 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c0dd0-02bb-481f-b230-a25f1751358f None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:25.788257 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf7d5d-1dea-4e9e-8b70-af62b273a121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:25.789107 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf7d5d-1dea-4e9e-8b70-af62b273a121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:25.789382 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf7d5d-1dea-4e9e-8b70-af62b273a121 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:25.789651 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bf7d5d-1dea-4e9e-8b70-af62b273a121 admin admin] PATH_INFO: `/v3/users/7c1f89154436444fba562154bfe4981d` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:25.790847 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf7d5d-1dea-4e9e-8b70-af62b273a121 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c1f89154436444fba562154bfe4981d)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:25.792728 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bf7d5d-1dea-4e9e-8b70-af62b273a121 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:25.834662 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f5c6946b-b275-4f66-8f63-3c7735bd4dcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e096e255ea964f79af2389c62b872402'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:25.910486 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f5c6946b-b275-4f66-8f63-3c7735bd4dcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e096e255ea964f79af2389c62b872402'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:25.911129 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f5c6946b-b275-4f66-8f63-3c7735bd4dcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e096e255ea964f79af2389c62b872402'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:25.918100 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f5c6946b-b275-4f66-8f63-3c7735bd4dcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e096e255ea964f79af2389c62b872402'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:25.929295 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f5c6946b-b275-4f66-8f63-3c7735bd4dcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e096e255ea964f79af2389c62b872402'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:25.935021 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1297/2590] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:08:25 2022] DELETE /identity/v3/users/e096e255ea964f79af2389c62b872402 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:08:25.995975 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-15bf7d5d-1dea-4e9e-8b70-af62b273a121 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c1f89154436444fba562154bfe4981d'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:26.002632 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-15bf7d5d-1dea-4e9e-8b70-af62b273a121 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c1f89154436444fba562154bfe4981d'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:26.169838 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-15bf7d5d-1dea-4e9e-8b70-af62b273a121 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c1f89154436444fba562154bfe4981d'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:26.170531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-15bf7d5d-1dea-4e9e-8b70-af62b273a121 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c1f89154436444fba562154bfe4981d'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:26.183211 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-15bf7d5d-1dea-4e9e-8b70-af62b273a121 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c1f89154436444fba562154bfe4981d'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:26.189041 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1294/2591] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:08:25 2022] DELETE /identity/v3/users/7c1f89154436444fba562154bfe4981d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:08:26.193553 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f37ea9-b5bd-441b-a88e-890b16d432e1 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:26.193839 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f37ea9-b5bd-441b-a88e-890b16d432e1 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:26.194115 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f37ea9-b5bd-441b-a88e-890b16d432e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:26.211682 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf7d5d-1dea-4e9e-8b70-af62b273a121 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:26.212236 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-a0f37ea9-b5bd-441b-a88e-890b16d432e1 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:26.213227 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-15bf7d5d-1dea-4e9e-8b70-af62b273a121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:26.213632 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-a0f37ea9-b5bd-441b-a88e-890b16d432e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:26.273707 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1298/2592] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:26.283148 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f37ea9-b5bd-441b-a88e-890b16d432e1 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:26.284443 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-a0f37ea9-b5bd-441b-a88e-890b16d432e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:26.286516 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bf7d5d-1dea-4e9e-8b70-af62b273a121 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:26.291144 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2740eb-17a2-4b31-aa9e-11d4a52cb0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:26.291939 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2740eb-17a2-4b31-aa9e-11d4a52cb0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:26.292215 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2740eb-17a2-4b31-aa9e-11d4a52cb0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:26.292483 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2740eb-17a2-4b31-aa9e-11d4a52cb0f2 admin admin] PATH_INFO: `/v3/projects/54832b1e6c2947c28ec827fff99fdb30` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:26.293712 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2740eb-17a2-4b31-aa9e-11d4a52cb0f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54832b1e6c2947c28ec827fff99fdb30)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:26.295631 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2740eb-17a2-4b31-aa9e-11d4a52cb0f2 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:26.341090 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f37ea9-b5bd-441b-a88e-890b16d432e1 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:26.344815 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa48103-2a12-4427-8320-5bbfcf8ba3f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:26.345468 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa48103-2a12-4427-8320-5bbfcf8ba3f0 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:26.345752 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa48103-2a12-4427-8320-5bbfcf8ba3f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:26.346020 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa48103-2a12-4427-8320-5bbfcf8ba3f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:26.354940 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa48103-2a12-4427-8320-5bbfcf8ba3f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:26.356478 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa48103-2a12-4427-8320-5bbfcf8ba3f0 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:26.366258 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1299/2593] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:08:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:08:26.423063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6c2740eb-17a2-4b31-aa9e-11d4a52cb0f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54832b1e6c2947c28ec827fff99fdb30', 'request_id': 'req-6c2740eb-17a2-4b31-aa9e-11d4a52cb0f2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:26.432278 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6c2740eb-17a2-4b31-aa9e-11d4a52cb0f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54832b1e6c2947c28ec827fff99fdb30', 'request_id': 'req-6c2740eb-17a2-4b31-aa9e-11d4a52cb0f2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:26.493597 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6c2740eb-17a2-4b31-aa9e-11d4a52cb0f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54832b1e6c2947c28ec827fff99fdb30', 'request_id': 'req-6c2740eb-17a2-4b31-aa9e-11d4a52cb0f2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:26.505236 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6c2740eb-17a2-4b31-aa9e-11d4a52cb0f2 admin admin] The token cache is being invalidate because project 54832b1e6c2947c28ec827fff99fdb30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:08:26.505522 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6c2740eb-17a2-4b31-aa9e-11d4a52cb0f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:26.506174 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6c2740eb-17a2-4b31-aa9e-11d4a52cb0f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:26.507732 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1295/2594] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:08:26 2022] DELETE /identity/v3/projects/54832b1e6c2947c28ec827fff99fdb30 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:08:26.511685 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa48103-2a12-4427-8320-5bbfcf8ba3f0 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:26.521291 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa48103-2a12-4427-8320-5bbfcf8ba3f0 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:26.580093 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3675e5-ad9e-472b-b9fa-a27961c3af38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:26.580992 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3675e5-ad9e-472b-b9fa-a27961c3af38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:26.581290 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3675e5-ad9e-472b-b9fa-a27961c3af38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:26.581563 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3675e5-ad9e-472b-b9fa-a27961c3af38 admin admin] PATH_INFO: `/v3/users/6ee3a6fe30654343aea4016bc19417eb` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:26.582804 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3675e5-ad9e-472b-b9fa-a27961c3af38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee3a6fe30654343aea4016bc19417eb)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:26.584764 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3675e5-ad9e-472b-b9fa-a27961c3af38 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:26.751120 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2740eb-17a2-4b31-aa9e-11d4a52cb0f2 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:26.752298 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-6c2740eb-17a2-4b31-aa9e-11d4a52cb0f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:26.771917 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2740eb-17a2-4b31-aa9e-11d4a52cb0f2 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:26.779903 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0256c87-72c0-43db-b83a-5d4618084fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:26.786783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0256c87-72c0-43db-b83a-5d4618084fe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:26.786783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0256c87-72c0-43db-b83a-5d4618084fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:26.786783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0256c87-72c0-43db-b83a-5d4618084fe4 admin admin] PATH_INFO: `/v3/projects/135f60730aeb46d3a60f0d98ac824634` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:26.786783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0256c87-72c0-43db-b83a-5d4618084fe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=135f60730aeb46d3a60f0d98ac824634)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:26.786783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0256c87-72c0-43db-b83a-5d4618084fe4 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:26.821115 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8c3675e5-ad9e-472b-b9fa-a27961c3af38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee3a6fe30654343aea4016bc19417eb'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:26.905445 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8c3675e5-ad9e-472b-b9fa-a27961c3af38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee3a6fe30654343aea4016bc19417eb'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:26.906220 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8c3675e5-ad9e-472b-b9fa-a27961c3af38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee3a6fe30654343aea4016bc19417eb'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:26.914119 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8c3675e5-ad9e-472b-b9fa-a27961c3af38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee3a6fe30654343aea4016bc19417eb'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:26.916967 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c0256c87-72c0-43db-b83a-5d4618084fe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '135f60730aeb46d3a60f0d98ac824634', 'request_id': 'req-c0256c87-72c0-43db-b83a-5d4618084fe4'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:26.922324 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c0256c87-72c0-43db-b83a-5d4618084fe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '135f60730aeb46d3a60f0d98ac824634', 'request_id': 'req-c0256c87-72c0-43db-b83a-5d4618084fe4'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:26.926482 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8c3675e5-ad9e-472b-b9fa-a27961c3af38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee3a6fe30654343aea4016bc19417eb'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:26.932320 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1300/2595] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:08:26 2022] DELETE /identity/v3/users/6ee3a6fe30654343aea4016bc19417eb => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:26.981054 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c0256c87-72c0-43db-b83a-5d4618084fe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '135f60730aeb46d3a60f0d98ac824634', 'request_id': 'req-c0256c87-72c0-43db-b83a-5d4618084fe4'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:26.992705 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c0256c87-72c0-43db-b83a-5d4618084fe4 admin admin] The token cache is being invalidate because project 135f60730aeb46d3a60f0d98ac824634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:08:26.992908 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c0256c87-72c0-43db-b83a-5d4618084fe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:26.998345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c0256c87-72c0-43db-b83a-5d4618084fe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:26.998345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1296/2596] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:08:26 2022] DELETE /identity/v3/projects/135f60730aeb46d3a60f0d98ac824634 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:27.183886 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3675e5-ad9e-472b-b9fa-a27961c3af38 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:27.186686 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-8c3675e5-ad9e-472b-b9fa-a27961c3af38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:27.267410 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3675e5-ad9e-472b-b9fa-a27961c3af38 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:27.271937 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e99de2e-a2f1-4ca9-9ba9-ce9c0ab124b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:27.272816 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99de2e-a2f1-4ca9-9ba9-ce9c0ab124b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:27.273088 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99de2e-a2f1-4ca9-9ba9-ce9c0ab124b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:27.273355 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e99de2e-a2f1-4ca9-9ba9-ce9c0ab124b4 admin admin] PATH_INFO: `/v3/projects/53aed79747a5439baed00cbf241488e8` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:27.274517 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99de2e-a2f1-4ca9-9ba9-ce9c0ab124b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53aed79747a5439baed00cbf241488e8)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:27.277082 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e99de2e-a2f1-4ca9-9ba9-ce9c0ab124b4 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:27.370883 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3e99de2e-a2f1-4ca9-9ba9-ce9c0ab124b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53aed79747a5439baed00cbf241488e8', 'request_id': 'req-3e99de2e-a2f1-4ca9-9ba9-ce9c0ab124b4'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:27.415069 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3e99de2e-a2f1-4ca9-9ba9-ce9c0ab124b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53aed79747a5439baed00cbf241488e8', 'request_id': 'req-3e99de2e-a2f1-4ca9-9ba9-ce9c0ab124b4'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:27.420416 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3e99de2e-a2f1-4ca9-9ba9-ce9c0ab124b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53aed79747a5439baed00cbf241488e8', 'request_id': 'req-3e99de2e-a2f1-4ca9-9ba9-ce9c0ab124b4'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:27.431290 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3e99de2e-a2f1-4ca9-9ba9-ce9c0ab124b4 admin admin] The token cache is being invalidate because project 53aed79747a5439baed00cbf241488e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:08:27.431577 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3e99de2e-a2f1-4ca9-9ba9-ce9c0ab124b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:27.432217 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3e99de2e-a2f1-4ca9-9ba9-ce9c0ab124b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:27.433850 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1301/2597] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:08:27 2022] DELETE /identity/v3/projects/53aed79747a5439baed00cbf241488e8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:27.438824 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac0d3-b91d-4b6a-a03b-5dbe68dcdb79 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:27.443368 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac0d3-b91d-4b6a-a03b-5dbe68dcdb79 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:27.443368 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aac0d3-b91d-4b6a-a03b-5dbe68dcdb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:27.457731 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-81aac0d3-b91d-4b6a-a03b-5dbe68dcdb79 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:27.459019 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-81aac0d3-b91d-4b6a-a03b-5dbe68dcdb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:27.515353 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1297/2598] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:27.522900 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8a858-0acb-4220-8e1a-c97d5b48390a None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:27.523186 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8a858-0acb-4220-8e1a-c97d5b48390a None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:27.523457 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8a858-0acb-4220-8e1a-c97d5b48390a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:27.540954 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-20d8a858-0acb-4220-8e1a-c97d5b48390a None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:27.542120 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-20d8a858-0acb-4220-8e1a-c97d5b48390a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:27.550041 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1302/2599] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:27.553984 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac0d3-b91d-4b6a-a03b-5dbe68dcdb79 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:27.563918 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aac0d3-b91d-4b6a-a03b-5dbe68dcdb79 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:27.568549 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21e5ce-1552-4379-82e8-8d5c96d8fc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:27.569192 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21e5ce-1552-4379-82e8-8d5c96d8fc81 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:27.569469 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21e5ce-1552-4379-82e8-8d5c96d8fc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:27.569739 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f21e5ce-1552-4379-82e8-8d5c96d8fc81 admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:27.570485 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21e5ce-1552-4379-82e8-8d5c96d8fc81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:08:27.570786 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21e5ce-1552-4379-82e8-8d5c96d8fc81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:27.573083 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f21e5ce-1552-4379-82e8-8d5c96d8fc81 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:27.584191 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1298/2600] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:08:27.588279 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8a858-0acb-4220-8e1a-c97d5b48390a None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:27.597324 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8a858-0acb-4220-8e1a-c97d5b48390a None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:27.601903 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce8d87-0a8c-46ed-ab0f-0ce51642705a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:27.602530 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce8d87-0a8c-46ed-ab0f-0ce51642705a admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:27.603005 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce8d87-0a8c-46ed-ab0f-0ce51642705a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:27.603281 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce8d87-0a8c-46ed-ab0f-0ce51642705a admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:27.603968 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce8d87-0a8c-46ed-ab0f-0ce51642705a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:27.605820 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce8d87-0a8c-46ed-ab0f-0ce51642705a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:27.690800 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1303/2601] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:08:27 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:08:27.694982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21e5ce-1552-4379-82e8-8d5c96d8fc81 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:27.705796 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f21e5ce-1552-4379-82e8-8d5c96d8fc81 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:27.759502 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2560c38-a5c1-4fdd-8430-0c93d58c71af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:27.760835 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2560c38-a5c1-4fdd-8430-0c93d58c71af admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:27.761111 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2560c38-a5c1-4fdd-8430-0c93d58c71af admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:27.761379 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2560c38-a5c1-4fdd-8430-0c93d58c71af admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:27.762074 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2560c38-a5c1-4fdd-8430-0c93d58c71af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:27.764003 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2560c38-a5c1-4fdd-8430-0c93d58c71af admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:27.827220 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1299/2602] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:08:27 2022] POST /identity/v3/users => generated 285 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:08:27.831414 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce8d87-0a8c-46ed-ab0f-0ce51642705a admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:27.841747 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce8d87-0a8c-46ed-ab0f-0ce51642705a admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:27.846357 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e5e64-7ce2-4f8e-9b01-eddc2a6efa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:27.847040 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e5e64-7ce2-4f8e-9b01-eddc2a6efa1d admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:27.847320 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e5e64-7ce2-4f8e-9b01-eddc2a6efa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:27.847594 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e5e64-7ce2-4f8e-9b01-eddc2a6efa1d admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:27.848344 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e5e64-7ce2-4f8e-9b01-eddc2a6efa1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:27.849968 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e5e64-7ce2-4f8e-9b01-eddc2a6efa1d admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:27.860228 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1304/2603] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:08:27.864396 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2560c38-a5c1-4fdd-8430-0c93d58c71af admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:27.874628 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2560c38-a5c1-4fdd-8430-0c93d58c71af admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:27.879242 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e168b68-f8c4-4061-bdc3-8dfc417f7b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:27.879878 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e168b68-f8c4-4061-bdc3-8dfc417f7b67 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:27.880156 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e168b68-f8c4-4061-bdc3-8dfc417f7b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:27.880427 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e168b68-f8c4-4061-bdc3-8dfc417f7b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:27.881147 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e168b68-f8c4-4061-bdc3-8dfc417f7b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:27.882698 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e168b68-f8c4-4061-bdc3-8dfc417f7b67 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:27.892754 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1300/2604] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:08:27.896612 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e5e64-7ce2-4f8e-9b01-eddc2a6efa1d admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:27.906332 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e5e64-7ce2-4f8e-9b01-eddc2a6efa1d admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:27.911066 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66f9e0-10fb-48ed-b1e8-423e239b4bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:27.911916 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66f9e0-10fb-48ed-b1e8-423e239b4bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:27.912194 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66f9e0-10fb-48ed-b1e8-423e239b4bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:27.912459 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66f9e0-10fb-48ed-b1e8-423e239b4bb6 admin admin] PATH_INFO: `/v3/projects/a930c634701949209d48235a263bccbc/users/22dee0e3ef574f6c82c7daaa12a0dcb2/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:27.926917 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66f9e0-10fb-48ed-b1e8-423e239b4bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a930c634701949209d48235a263bccbc, user_id=22dee0e3ef574f6c82c7daaa12a0dcb2, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:27.929514 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c66f9e0-10fb-48ed-b1e8-423e239b4bb6 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:27.997944 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1305/2605] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:08:27 2022] PUT /identity/v3/projects/a930c634701949209d48235a263bccbc/users/22dee0e3ef574f6c82c7daaa12a0dcb2/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:28.008836 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596b6bf-5c25-47bc-ab76-cc58f4928aff None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:28.009127 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596b6bf-5c25-47bc-ab76-cc58f4928aff None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:28.009430 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7596b6bf-5c25-47bc-ab76-cc58f4928aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:28.035065 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-7596b6bf-5c25-47bc-ab76-cc58f4928aff None None] MFA Rules not processed for user `22dee0e3ef574f6c82c7daaa12a0dcb2`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:28.038613 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-7596b6bf-5c25-47bc-ab76-cc58f4928aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:28.097703 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1301/2606] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:28 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:28.102158 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66f9e0-10fb-48ed-b1e8-423e239b4bb6 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:28.161471 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66f9e0-10fb-48ed-b1e8-423e239b4bb6 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:28.166245 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab879d0-7f30-420c-9334-545c3ae4fe54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:28.167018 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab879d0-7f30-420c-9334-545c3ae4fe54 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:28.167302 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab879d0-7f30-420c-9334-545c3ae4fe54 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:28.167603 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab879d0-7f30-420c-9334-545c3ae4fe54 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:28.168328 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab879d0-7f30-420c-9334-545c3ae4fe54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:28.170219 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab879d0-7f30-420c-9334-545c3ae4fe54 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:28.261592 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1306/2607] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:08:28 2022] POST /identity/v3/projects => generated 369 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:08:28.265723 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596b6bf-5c25-47bc-ab76-cc58f4928aff None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:28.276527 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7596b6bf-5c25-47bc-ab76-cc58f4928aff None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:28.331621 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94893ea1-74a3-4afe-9750-fdf4d27a7abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:28.332281 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94893ea1-74a3-4afe-9750-fdf4d27a7abf admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:28.332561 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94893ea1-74a3-4afe-9750-fdf4d27a7abf admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:28.332837 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94893ea1-74a3-4afe-9750-fdf4d27a7abf admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:28.333585 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94893ea1-74a3-4afe-9750-fdf4d27a7abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:28.335574 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94893ea1-74a3-4afe-9750-fdf4d27a7abf admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:28.419039 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1302/2608] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:08:28 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:08:28.422852 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab879d0-7f30-420c-9334-545c3ae4fe54 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:28.433639 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab879d0-7f30-420c-9334-545c3ae4fe54 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:28.438220 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773e54c-8791-49de-b94e-56f516ca46b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:28.438887 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773e54c-8791-49de-b94e-56f516ca46b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:28.439168 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773e54c-8791-49de-b94e-56f516ca46b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:28.439438 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773e54c-8791-49de-b94e-56f516ca46b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:28.440154 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773e54c-8791-49de-b94e-56f516ca46b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:28.441757 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773e54c-8791-49de-b94e-56f516ca46b4 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:28.453070 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1307/2609] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:08:28.456810 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94893ea1-74a3-4afe-9750-fdf4d27a7abf admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:28.466566 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94893ea1-74a3-4afe-9750-fdf4d27a7abf admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:28.471376 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c0485-98af-479c-875c-468da0093152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:28.472251 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c0485-98af-479c-875c-468da0093152 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:28.472532 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c0485-98af-479c-875c-468da0093152 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:28.472809 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0c0485-98af-479c-875c-468da0093152 admin admin] PATH_INFO: `/v3/projects/a7fcba0422bc43a782959d97bebe72af/users/1d7aed1f7f1d425e9dbd9f7d58403129/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:28.487404 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c0485-98af-479c-875c-468da0093152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7fcba0422bc43a782959d97bebe72af, user_id=1d7aed1f7f1d425e9dbd9f7d58403129, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:28.490060 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0c0485-98af-479c-875c-468da0093152 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:28.558280 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1303/2610] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:08:28 2022] PUT /identity/v3/projects/a7fcba0422bc43a782959d97bebe72af/users/1d7aed1f7f1d425e9dbd9f7d58403129/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:28.562006 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773e54c-8791-49de-b94e-56f516ca46b4 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:28.571714 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773e54c-8791-49de-b94e-56f516ca46b4 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:28.625691 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee399b59-93ee-4785-bff0-3b3ff6752d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:28.626326 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee399b59-93ee-4785-bff0-3b3ff6752d24 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:28.626614 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee399b59-93ee-4785-bff0-3b3ff6752d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:28.626919 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee399b59-93ee-4785-bff0-3b3ff6752d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:28.627640 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee399b59-93ee-4785-bff0-3b3ff6752d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:28.629231 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee399b59-93ee-4785-bff0-3b3ff6752d24 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:28.639249 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1308/2611] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:08:28.643547 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c0485-98af-479c-875c-468da0093152 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:28.653956 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0c0485-98af-479c-875c-468da0093152 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:28.658626 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffe6e8-f88f-4db5-ac81-633953d1c162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:28.659530 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffe6e8-f88f-4db5-ac81-633953d1c162 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:28.659806 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffe6e8-f88f-4db5-ac81-633953d1c162 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:28.660073 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffe6e8-f88f-4db5-ac81-633953d1c162 admin admin] PATH_INFO: `/v3/projects/a7fcba0422bc43a782959d97bebe72af/users/1d7aed1f7f1d425e9dbd9f7d58403129/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:28.662021 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffe6e8-f88f-4db5-ac81-633953d1c162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7fcba0422bc43a782959d97bebe72af, user_id=1d7aed1f7f1d425e9dbd9f7d58403129, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:28.664698 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffe6e8-f88f-4db5-ac81-633953d1c162 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:28.675076 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1304/2612] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:08:28 2022] PUT /identity/v3/projects/a7fcba0422bc43a782959d97bebe72af/users/1d7aed1f7f1d425e9dbd9f7d58403129/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:08:28.685462 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead4d55-4f49-4f80-9c15-ee3821a8f735 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:28.685744 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead4d55-4f49-4f80-9c15-ee3821a8f735 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:28.686015 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead4d55-4f49-4f80-9c15-ee3821a8f735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:28.710853 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-eead4d55-4f49-4f80-9c15-ee3821a8f735 None None] MFA Rules not processed for user `1d7aed1f7f1d425e9dbd9f7d58403129`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:28.712031 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-eead4d55-4f49-4f80-9c15-ee3821a8f735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:28.776768 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1309/2613] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:28 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:28.788068 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffe6e8-f88f-4db5-ac81-633953d1c162 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:28.789766 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-16ffe6e8-f88f-4db5-ac81-633953d1c162 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:28.843633 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffe6e8-f88f-4db5-ac81-633953d1c162 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:28.847277 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad9436-c52d-4e65-bc1b-5789e0aa5dcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:28.847908 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad9436-c52d-4e65-bc1b-5789e0aa5dcb service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:28.848213 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad9436-c52d-4e65-bc1b-5789e0aa5dcb service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:28.848517 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad9436-c52d-4e65-bc1b-5789e0aa5dcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:28.857879 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad9436-c52d-4e65-bc1b-5789e0aa5dcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:28.859396 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ad9436-c52d-4e65-bc1b-5789e0aa5dcb service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:28.868922 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1305/2614] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:08:28 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:08:29.017888 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead4d55-4f49-4f80-9c15-ee3821a8f735 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:29.023181 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-eead4d55-4f49-4f80-9c15-ee3821a8f735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:29.031440 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead4d55-4f49-4f80-9c15-ee3821a8f735 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:29.035023 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6d1007-7a69-432f-8e21-765425e51dea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:29.035682 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d1007-7a69-432f-8e21-765425e51dea service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:29.035967 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d1007-7a69-432f-8e21-765425e51dea service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:29.036239 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6d1007-7a69-432f-8e21-765425e51dea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:29.092301 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d1007-7a69-432f-8e21-765425e51dea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:29.093794 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6d1007-7a69-432f-8e21-765425e51dea service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:29.102243 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1310/2615] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:08:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:08:33.547280 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad9436-c52d-4e65-bc1b-5789e0aa5dcb service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:33.606465 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad9436-c52d-4e65-bc1b-5789e0aa5dcb service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:33.611233 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a9986-f665-4aa2-8dfa-e4402284fb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:33.612126 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a9986-f665-4aa2-8dfa-e4402284fb26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:33.612407 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a9986-f665-4aa2-8dfa-e4402284fb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:33.612680 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154a9986-f665-4aa2-8dfa-e4402284fb26 admin admin] PATH_INFO: `/v3/users/22dee0e3ef574f6c82c7daaa12a0dcb2` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:33.613856 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a9986-f665-4aa2-8dfa-e4402284fb26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22dee0e3ef574f6c82c7daaa12a0dcb2)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:33.615791 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154a9986-f665-4aa2-8dfa-e4402284fb26 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:33.777807 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-154a9986-f665-4aa2-8dfa-e4402284fb26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22dee0e3ef574f6c82c7daaa12a0dcb2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:33.784385 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-154a9986-f665-4aa2-8dfa-e4402284fb26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22dee0e3ef574f6c82c7daaa12a0dcb2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:33.853582 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-154a9986-f665-4aa2-8dfa-e4402284fb26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22dee0e3ef574f6c82c7daaa12a0dcb2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:33.854847 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-154a9986-f665-4aa2-8dfa-e4402284fb26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22dee0e3ef574f6c82c7daaa12a0dcb2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:33.867120 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-154a9986-f665-4aa2-8dfa-e4402284fb26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22dee0e3ef574f6c82c7daaa12a0dcb2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:33.872876 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1306/2616] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:08:33 2022] DELETE /identity/v3/users/22dee0e3ef574f6c82c7daaa12a0dcb2 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:33.877352 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8f3ca-f04c-4330-abb2-b99303c1445a None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:33.877827 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8f3ca-f04c-4330-abb2-b99303c1445a None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:33.877923 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a8f3ca-f04c-4330-abb2-b99303c1445a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:33.895331 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-b0a8f3ca-f04c-4330-abb2-b99303c1445a None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:33.896521 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-b0a8f3ca-f04c-4330-abb2-b99303c1445a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:33.953435 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1311/2617] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:08:33.962965 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a9986-f665-4aa2-8dfa-e4402284fb26 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:33.964963 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-154a9986-f665-4aa2-8dfa-e4402284fb26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:34.026759 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154a9986-f665-4aa2-8dfa-e4402284fb26 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:34.030277 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb9eac-cccf-4288-a80b-1f26f2e540a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:34.030939 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb9eac-cccf-4288-a80b-1f26f2e540a3 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:34.031240 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb9eac-cccf-4288-a80b-1f26f2e540a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:34.031508 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb9eac-cccf-4288-a80b-1f26f2e540a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:34.040242 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb9eac-cccf-4288-a80b-1f26f2e540a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:34.042140 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb9eac-cccf-4288-a80b-1f26f2e540a3 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:34.051213 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1307/2618] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:08:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:08:34.415776 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8f3ca-f04c-4330-abb2-b99303c1445a None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:34.417415 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-b0a8f3ca-f04c-4330-abb2-b99303c1445a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:34.429450 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a8f3ca-f04c-4330-abb2-b99303c1445a None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:34.434741 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a395c8-8624-4195-b6e1-443da8d7b17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:34.435624 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a395c8-8624-4195-b6e1-443da8d7b17d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:34.435897 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a395c8-8624-4195-b6e1-443da8d7b17d admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:34.436167 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a395c8-8624-4195-b6e1-443da8d7b17d admin admin] PATH_INFO: `/v3/projects/a930c634701949209d48235a263bccbc` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:34.437353 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a395c8-8624-4195-b6e1-443da8d7b17d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a930c634701949209d48235a263bccbc)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:34.439278 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a395c8-8624-4195-b6e1-443da8d7b17d admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:34.541344 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-a3a395c8-8624-4195-b6e1-443da8d7b17d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a930c634701949209d48235a263bccbc', 'request_id': 'req-a3a395c8-8624-4195-b6e1-443da8d7b17d'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:34.598252 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-a3a395c8-8624-4195-b6e1-443da8d7b17d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a930c634701949209d48235a263bccbc', 'request_id': 'req-a3a395c8-8624-4195-b6e1-443da8d7b17d'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:34.604566 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-a3a395c8-8624-4195-b6e1-443da8d7b17d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a930c634701949209d48235a263bccbc', 'request_id': 'req-a3a395c8-8624-4195-b6e1-443da8d7b17d'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:34.615637 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-a3a395c8-8624-4195-b6e1-443da8d7b17d admin admin] The token cache is being invalidate because project a930c634701949209d48235a263bccbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:08:34.615904 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-a3a395c8-8624-4195-b6e1-443da8d7b17d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:34.616533 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-a3a395c8-8624-4195-b6e1-443da8d7b17d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:34.618056 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1312/2619] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:08:34 2022] DELETE /identity/v3/projects/a930c634701949209d48235a263bccbc => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:34.622066 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb9eac-cccf-4288-a80b-1f26f2e540a3 service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:34.631669 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb9eac-cccf-4288-a80b-1f26f2e540a3 service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:34.685833 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757e14fe-de16-40b9-985f-cfe0491fb49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:34.686683 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e14fe-de16-40b9-985f-cfe0491fb49b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:34.686992 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e14fe-de16-40b9-985f-cfe0491fb49b admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:34.687266 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757e14fe-de16-40b9-985f-cfe0491fb49b admin admin] PATH_INFO: `/v3/users/1d7aed1f7f1d425e9dbd9f7d58403129` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:34.688511 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e14fe-de16-40b9-985f-cfe0491fb49b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d7aed1f7f1d425e9dbd9f7d58403129)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:34.690395 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757e14fe-de16-40b9-985f-cfe0491fb49b admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:34.862630 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-757e14fe-de16-40b9-985f-cfe0491fb49b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d7aed1f7f1d425e9dbd9f7d58403129'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:34.869208 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-757e14fe-de16-40b9-985f-cfe0491fb49b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d7aed1f7f1d425e9dbd9f7d58403129'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:34.941123 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-757e14fe-de16-40b9-985f-cfe0491fb49b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d7aed1f7f1d425e9dbd9f7d58403129'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:34.941816 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-757e14fe-de16-40b9-985f-cfe0491fb49b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d7aed1f7f1d425e9dbd9f7d58403129'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:34.954036 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-757e14fe-de16-40b9-985f-cfe0491fb49b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d7aed1f7f1d425e9dbd9f7d58403129'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:34.959969 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1308/2620] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:08:34 2022] DELETE /identity/v3/users/1d7aed1f7f1d425e9dbd9f7d58403129 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:35.348092 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a395c8-8624-4195-b6e1-443da8d7b17d admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:35.349608 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-a3a395c8-8624-4195-b6e1-443da8d7b17d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:35.363280 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a395c8-8624-4195-b6e1-443da8d7b17d admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:35.419482 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da7ef7-7b16-4e3a-a40e-611a069700b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:35.420254 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da7ef7-7b16-4e3a-a40e-611a069700b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:35.420527 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da7ef7-7b16-4e3a-a40e-611a069700b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:35.420794 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da7ef7-7b16-4e3a-a40e-611a069700b8 admin admin] PATH_INFO: `/v3/projects/a7fcba0422bc43a782959d97bebe72af` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:35.421949 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da7ef7-7b16-4e3a-a40e-611a069700b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7fcba0422bc43a782959d97bebe72af)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:35.423894 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da7ef7-7b16-4e3a-a40e-611a069700b8 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:35.517821 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f0da7ef7-7b16-4e3a-a40e-611a069700b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7fcba0422bc43a782959d97bebe72af', 'request_id': 'req-f0da7ef7-7b16-4e3a-a40e-611a069700b8'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:35.557807 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f0da7ef7-7b16-4e3a-a40e-611a069700b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7fcba0422bc43a782959d97bebe72af', 'request_id': 'req-f0da7ef7-7b16-4e3a-a40e-611a069700b8'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:35.563099 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f0da7ef7-7b16-4e3a-a40e-611a069700b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7fcba0422bc43a782959d97bebe72af', 'request_id': 'req-f0da7ef7-7b16-4e3a-a40e-611a069700b8'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:35.574169 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f0da7ef7-7b16-4e3a-a40e-611a069700b8 admin admin] The token cache is being invalidate because project a7fcba0422bc43a782959d97bebe72af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:08:35.574449 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f0da7ef7-7b16-4e3a-a40e-611a069700b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:35.575113 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f0da7ef7-7b16-4e3a-a40e-611a069700b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:35.576617 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1313/2621] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:08:35 2022] DELETE /identity/v3/projects/a7fcba0422bc43a782959d97bebe72af => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:35.581471 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297aed72-8de5-45d8-b84c-a97c3c0260ec None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:35.581758 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297aed72-8de5-45d8-b84c-a97c3c0260ec None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:35.582060 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297aed72-8de5-45d8-b84c-a97c3c0260ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:35.599665 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-297aed72-8de5-45d8-b84c-a97c3c0260ec None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:35.600854 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-297aed72-8de5-45d8-b84c-a97c3c0260ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:35.657698 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1309/2622] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:35.666813 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48be1ca-b4da-4e8d-a606-80dcbdcec847 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:35.667132 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48be1ca-b4da-4e8d-a606-80dcbdcec847 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:35.667409 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48be1ca-b4da-4e8d-a606-80dcbdcec847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:35.685582 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-a48be1ca-b4da-4e8d-a606-80dcbdcec847 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:35.686703 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-a48be1ca-b4da-4e8d-a606-80dcbdcec847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:35.694611 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1314/2623] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:35.699327 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297aed72-8de5-45d8-b84c-a97c3c0260ec None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:35.708816 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297aed72-8de5-45d8-b84c-a97c3c0260ec None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:35.713458 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5f402-cbd7-4b9d-9107-65f17b42bf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:35.714588 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5f402-cbd7-4b9d-9107-65f17b42bf18 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:35.714896 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5f402-cbd7-4b9d-9107-65f17b42bf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:35.715173 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e5f402-cbd7-4b9d-9107-65f17b42bf18 admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:35.715892 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5f402-cbd7-4b9d-9107-65f17b42bf18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:08:35.716195 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5f402-cbd7-4b9d-9107-65f17b42bf18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:35.717808 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e5f402-cbd7-4b9d-9107-65f17b42bf18 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:35.728877 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1310/2624] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:08:35.732887 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48be1ca-b4da-4e8d-a606-80dcbdcec847 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:35.742187 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48be1ca-b4da-4e8d-a606-80dcbdcec847 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:35.747359 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829285e6-756e-48bb-96b0-ad79c16d6ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:35.747995 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829285e6-756e-48bb-96b0-ad79c16d6ddb admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:35.748275 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829285e6-756e-48bb-96b0-ad79c16d6ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:35.748548 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829285e6-756e-48bb-96b0-ad79c16d6ddb admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:35.749236 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829285e6-756e-48bb-96b0-ad79c16d6ddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:35.751149 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829285e6-756e-48bb-96b0-ad79c16d6ddb admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:35.850886 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1315/2625] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:08:35 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:08:35.855092 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5f402-cbd7-4b9d-9107-65f17b42bf18 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:35.865274 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e5f402-cbd7-4b9d-9107-65f17b42bf18 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:35.918820 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad18c52-0082-4a0b-99f3-4d4c37f6e680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:35.919501 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad18c52-0082-4a0b-99f3-4d4c37f6e680 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:35.919781 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad18c52-0082-4a0b-99f3-4d4c37f6e680 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:35.920053 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad18c52-0082-4a0b-99f3-4d4c37f6e680 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:35.920736 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad18c52-0082-4a0b-99f3-4d4c37f6e680 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:35.922617 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad18c52-0082-4a0b-99f3-4d4c37f6e680 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:35.992682 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1311/2626] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:08:35 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:08:35.997172 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829285e6-756e-48bb-96b0-ad79c16d6ddb admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:36.007437 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829285e6-756e-48bb-96b0-ad79c16d6ddb admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:36.013664 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3dbd9-92e6-4ddd-bb64-f3dfd6b6514c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:36.014329 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3dbd9-92e6-4ddd-bb64-f3dfd6b6514c admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:36.014594 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3dbd9-92e6-4ddd-bb64-f3dfd6b6514c admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:36.014891 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3dbd9-92e6-4ddd-bb64-f3dfd6b6514c admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:36.015626 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3dbd9-92e6-4ddd-bb64-f3dfd6b6514c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:36.017211 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3dbd9-92e6-4ddd-bb64-f3dfd6b6514c admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:36.028104 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1316/2627] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:08:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:08:36.032209 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad18c52-0082-4a0b-99f3-4d4c37f6e680 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:36.041979 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad18c52-0082-4a0b-99f3-4d4c37f6e680 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:36.046546 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13097361-18eb-46f8-ab6d-155b4da5b746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:36.047220 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13097361-18eb-46f8-ab6d-155b4da5b746 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:36.047497 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13097361-18eb-46f8-ab6d-155b4da5b746 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:36.047766 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13097361-18eb-46f8-ab6d-155b4da5b746 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:36.048485 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13097361-18eb-46f8-ab6d-155b4da5b746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:36.050037 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13097361-18eb-46f8-ab6d-155b4da5b746 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:36.060392 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1312/2628] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:08:36.064190 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3dbd9-92e6-4ddd-bb64-f3dfd6b6514c admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:36.074475 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3dbd9-92e6-4ddd-bb64-f3dfd6b6514c admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:36.079037 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a110e-09bf-4acd-83f8-7726080baaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:36.079890 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a110e-09bf-4acd-83f8-7726080baaf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:36.080168 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a110e-09bf-4acd-83f8-7726080baaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:36.080441 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a110e-09bf-4acd-83f8-7726080baaf0 admin admin] PATH_INFO: `/v3/projects/270cca84f2654bb08ad6884107949b8f/users/3210f58dff1b4c21a93c061313b78f0c/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:36.094257 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a110e-09bf-4acd-83f8-7726080baaf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=270cca84f2654bb08ad6884107949b8f, user_id=3210f58dff1b4c21a93c061313b78f0c, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:36.096886 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a110e-09bf-4acd-83f8-7726080baaf0 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:36.174907 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1317/2629] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:08:36 2022] PUT /identity/v3/projects/270cca84f2654bb08ad6884107949b8f/users/3210f58dff1b4c21a93c061313b78f0c/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:36.185703 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebe979-384e-42f1-ae1b-201500940e0b None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:36.185989 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebe979-384e-42f1-ae1b-201500940e0b None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:36.186257 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebe979-384e-42f1-ae1b-201500940e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:36.211875 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-a2ebe979-384e-42f1-ae1b-201500940e0b None None] MFA Rules not processed for user `3210f58dff1b4c21a93c061313b78f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:36.213074 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a2ebe979-384e-42f1-ae1b-201500940e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:36.274267 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1313/2630] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:36.278692 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a110e-09bf-4acd-83f8-7726080baaf0 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:36.338059 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a110e-09bf-4acd-83f8-7726080baaf0 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:36.342896 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea384e04-5e88-40d1-aa46-1807092f1356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:36.343545 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea384e04-5e88-40d1-aa46-1807092f1356 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:36.343825 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea384e04-5e88-40d1-aa46-1807092f1356 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:36.344101 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea384e04-5e88-40d1-aa46-1807092f1356 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:36.344796 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea384e04-5e88-40d1-aa46-1807092f1356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:36.346721 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea384e04-5e88-40d1-aa46-1807092f1356 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:36.451062 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1318/2631] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:08:36 2022] POST /identity/v3/projects => generated 381 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:08:36.455217 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebe979-384e-42f1-ae1b-201500940e0b None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:36.466171 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebe979-384e-42f1-ae1b-201500940e0b None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:36.519358 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b9602-e8db-42c8-87a8-744f8a260832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:36.520010 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b9602-e8db-42c8-87a8-744f8a260832 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:36.520286 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b9602-e8db-42c8-87a8-744f8a260832 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:36.520552 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b9602-e8db-42c8-87a8-744f8a260832 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:36.521225 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b9602-e8db-42c8-87a8-744f8a260832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:36.523123 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b9602-e8db-42c8-87a8-744f8a260832 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:36.593191 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1314/2632] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:08:36 2022] POST /identity/v3/users => generated 297 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:08:36.596904 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea384e04-5e88-40d1-aa46-1807092f1356 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:36.607927 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea384e04-5e88-40d1-aa46-1807092f1356 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:36.612786 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e26ea-a5ef-4e6c-a9bd-758fd4603f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:36.613425 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e26ea-a5ef-4e6c-a9bd-758fd4603f2b admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:36.613704 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e26ea-a5ef-4e6c-a9bd-758fd4603f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:36.613976 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e26ea-a5ef-4e6c-a9bd-758fd4603f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:36.614695 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e26ea-a5ef-4e6c-a9bd-758fd4603f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:36.616372 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e26ea-a5ef-4e6c-a9bd-758fd4603f2b admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:36.626588 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1319/2633] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:08:36.630396 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b9602-e8db-42c8-87a8-744f8a260832 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:36.640111 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b9602-e8db-42c8-87a8-744f8a260832 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:36.644777 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed626afc-9483-4010-82bd-2c3e43bae5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:36.645639 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed626afc-9483-4010-82bd-2c3e43bae5b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:36.645915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed626afc-9483-4010-82bd-2c3e43bae5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:36.646187 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed626afc-9483-4010-82bd-2c3e43bae5b0 admin admin] PATH_INFO: `/v3/projects/bbf949de833240068c1152ba7cbb0b35/users/71da52ddc5e74ba9b2c30aa95ad2500a/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:36.660712 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed626afc-9483-4010-82bd-2c3e43bae5b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf949de833240068c1152ba7cbb0b35, user_id=71da52ddc5e74ba9b2c30aa95ad2500a, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:36.663364 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed626afc-9483-4010-82bd-2c3e43bae5b0 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:36.750343 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1315/2634] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:08:36 2022] PUT /identity/v3/projects/bbf949de833240068c1152ba7cbb0b35/users/71da52ddc5e74ba9b2c30aa95ad2500a/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:36.754329 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e26ea-a5ef-4e6c-a9bd-758fd4603f2b admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:36.764461 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e26ea-a5ef-4e6c-a9bd-758fd4603f2b admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:36.820124 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716141ec-4670-4da6-bb26-80e3bf5dcbcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:36.820812 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716141ec-4670-4da6-bb26-80e3bf5dcbcd admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:36.821093 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716141ec-4670-4da6-bb26-80e3bf5dcbcd admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:36.821364 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716141ec-4670-4da6-bb26-80e3bf5dcbcd admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:36.822074 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716141ec-4670-4da6-bb26-80e3bf5dcbcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:36.823692 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716141ec-4670-4da6-bb26-80e3bf5dcbcd admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:36.833046 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1320/2635] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:08:36 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:08:36.837365 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed626afc-9483-4010-82bd-2c3e43bae5b0 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:36.848174 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed626afc-9483-4010-82bd-2c3e43bae5b0 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:36.852640 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbf629-93f3-45cb-b794-32381df78592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:36.853501 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbf629-93f3-45cb-b794-32381df78592 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:36.853776 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbf629-93f3-45cb-b794-32381df78592 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:36.854042 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbf629-93f3-45cb-b794-32381df78592 admin admin] PATH_INFO: `/v3/projects/bbf949de833240068c1152ba7cbb0b35/users/71da52ddc5e74ba9b2c30aa95ad2500a/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:36.856585 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbf629-93f3-45cb-b794-32381df78592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf949de833240068c1152ba7cbb0b35, user_id=71da52ddc5e74ba9b2c30aa95ad2500a, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:36.859307 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bbf629-93f3-45cb-b794-32381df78592 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:36.869652 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1316/2636] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:08:36 2022] PUT /identity/v3/projects/bbf949de833240068c1152ba7cbb0b35/users/71da52ddc5e74ba9b2c30aa95ad2500a/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:36.879818 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0adc55-27c0-4746-ac12-89290cd024f4 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:36.880102 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0adc55-27c0-4746-ac12-89290cd024f4 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:36.880372 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0adc55-27c0-4746-ac12-89290cd024f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:36.906308 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-9f0adc55-27c0-4746-ac12-89290cd024f4 None None] MFA Rules not processed for user `71da52ddc5e74ba9b2c30aa95ad2500a`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:36.907516 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-9f0adc55-27c0-4746-ac12-89290cd024f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:36.971200 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1321/2637] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:36 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:08:36.981788 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbf629-93f3-45cb-b794-32381df78592 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:36.983438 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-91bbf629-93f3-45cb-b794-32381df78592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:37.036868 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbf629-93f3-45cb-b794-32381df78592 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:37.040435 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd8647-4415-4a4f-a105-bd42ecad8f34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:37.041061 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd8647-4415-4a4f-a105-bd42ecad8f34 service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:37.041335 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd8647-4415-4a4f-a105-bd42ecad8f34 service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:37.041625 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd8647-4415-4a4f-a105-bd42ecad8f34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:37.050130 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd8647-4415-4a4f-a105-bd42ecad8f34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:37.051559 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd8647-4415-4a4f-a105-bd42ecad8f34 service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:37.060582 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1317/2638] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:08:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:08:37.156869 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0adc55-27c0-4746-ac12-89290cd024f4 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:37.166126 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0adc55-27c0-4746-ac12-89290cd024f4 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:37.169702 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e74ae-89fd-4ea9-94c4-e475458ea45d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:37.170345 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e74ae-89fd-4ea9-94c4-e475458ea45d service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:37.170606 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e74ae-89fd-4ea9-94c4-e475458ea45d service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:37.170907 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e74ae-89fd-4ea9-94c4-e475458ea45d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:37.224181 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e74ae-89fd-4ea9-94c4-e475458ea45d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:37.225600 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e74ae-89fd-4ea9-94c4-e475458ea45d service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:37.234288 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1322/2639] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:08:37 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:08:40.280421 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd8647-4415-4a4f-a105-bd42ecad8f34 service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:40.340617 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd8647-4415-4a4f-a105-bd42ecad8f34 service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:40.345134 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661183a-78b7-406e-b54f-3c93022fd843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:40.345988 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661183a-78b7-406e-b54f-3c93022fd843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:40.346271 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661183a-78b7-406e-b54f-3c93022fd843 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:40.346549 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661183a-78b7-406e-b54f-3c93022fd843 admin admin] PATH_INFO: `/v3/users/3210f58dff1b4c21a93c061313b78f0c` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:40.347743 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661183a-78b7-406e-b54f-3c93022fd843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3210f58dff1b4c21a93c061313b78f0c)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:40.349649 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b661183a-78b7-406e-b54f-3c93022fd843 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:40.491033 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-b661183a-78b7-406e-b54f-3c93022fd843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3210f58dff1b4c21a93c061313b78f0c'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:40.498194 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-b661183a-78b7-406e-b54f-3c93022fd843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3210f58dff1b4c21a93c061313b78f0c'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:40.552319 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-b661183a-78b7-406e-b54f-3c93022fd843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3210f58dff1b4c21a93c061313b78f0c'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:40.552858 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-b661183a-78b7-406e-b54f-3c93022fd843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3210f58dff1b4c21a93c061313b78f0c'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:40.564824 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-b661183a-78b7-406e-b54f-3c93022fd843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3210f58dff1b4c21a93c061313b78f0c'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:40.570615 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1318/2640] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:08:40 2022] DELETE /identity/v3/users/3210f58dff1b4c21a93c061313b78f0c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:40.575777 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b1859-c1c7-415a-baca-b0a793a86e6b None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:40.576246 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b1859-c1c7-415a-baca-b0a793a86e6b None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:40.576363 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b1859-c1c7-415a-baca-b0a793a86e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:40.592794 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-161b1859-c1c7-415a-baca-b0a793a86e6b None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:40.594013 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-161b1859-c1c7-415a-baca-b0a793a86e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:40.650352 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1323/2641] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:40.660004 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661183a-78b7-406e-b54f-3c93022fd843 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:40.661391 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-b661183a-78b7-406e-b54f-3c93022fd843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:40.717479 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661183a-78b7-406e-b54f-3c93022fd843 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:40.721053 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa886436-f5b0-4d1a-899c-6716faf56480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:40.721682 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa886436-f5b0-4d1a-899c-6716faf56480 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:40.721954 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa886436-f5b0-4d1a-899c-6716faf56480 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:40.722218 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa886436-f5b0-4d1a-899c-6716faf56480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:40.731320 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa886436-f5b0-4d1a-899c-6716faf56480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:40.732752 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa886436-f5b0-4d1a-899c-6716faf56480 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:40.742220 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1319/2642] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:08:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:08:41.091657 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b1859-c1c7-415a-baca-b0a793a86e6b None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:41.096405 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-161b1859-c1c7-415a-baca-b0a793a86e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:41.104957 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b1859-c1c7-415a-baca-b0a793a86e6b None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:41.110136 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0409fa-b7ad-4698-b49b-18d54e8a5d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:41.111017 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0409fa-b7ad-4698-b49b-18d54e8a5d90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:41.111548 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0409fa-b7ad-4698-b49b-18d54e8a5d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:41.111814 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0409fa-b7ad-4698-b49b-18d54e8a5d90 admin admin] PATH_INFO: `/v3/projects/270cca84f2654bb08ad6884107949b8f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:41.113005 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0409fa-b7ad-4698-b49b-18d54e8a5d90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=270cca84f2654bb08ad6884107949b8f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:41.114897 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0409fa-b7ad-4698-b49b-18d54e8a5d90 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:41.202693 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ce0409fa-b7ad-4698-b49b-18d54e8a5d90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '270cca84f2654bb08ad6884107949b8f', 'request_id': 'req-ce0409fa-b7ad-4698-b49b-18d54e8a5d90'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:41.266869 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ce0409fa-b7ad-4698-b49b-18d54e8a5d90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '270cca84f2654bb08ad6884107949b8f', 'request_id': 'req-ce0409fa-b7ad-4698-b49b-18d54e8a5d90'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:41.272544 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ce0409fa-b7ad-4698-b49b-18d54e8a5d90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '270cca84f2654bb08ad6884107949b8f', 'request_id': 'req-ce0409fa-b7ad-4698-b49b-18d54e8a5d90'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:41.283250 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ce0409fa-b7ad-4698-b49b-18d54e8a5d90 admin admin] The token cache is being invalidate because project 270cca84f2654bb08ad6884107949b8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:08:41.283535 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ce0409fa-b7ad-4698-b49b-18d54e8a5d90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:41.284150 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ce0409fa-b7ad-4698-b49b-18d54e8a5d90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:41.285661 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1324/2643] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:08:41 2022] DELETE /identity/v3/projects/270cca84f2654bb08ad6884107949b8f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:41.290102 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa886436-f5b0-4d1a-899c-6716faf56480 service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:41.299657 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa886436-f5b0-4d1a-899c-6716faf56480 service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:41.351773 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d0fcf-1115-405b-8761-c53511f12981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:41.352615 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d0fcf-1115-405b-8761-c53511f12981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:41.352892 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d0fcf-1115-405b-8761-c53511f12981 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:41.353157 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d0fcf-1115-405b-8761-c53511f12981 admin admin] PATH_INFO: `/v3/users/71da52ddc5e74ba9b2c30aa95ad2500a` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:41.354400 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d0fcf-1115-405b-8761-c53511f12981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71da52ddc5e74ba9b2c30aa95ad2500a)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:41.356936 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d0fcf-1115-405b-8761-c53511f12981 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:41.502817 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a17d0fcf-1115-405b-8761-c53511f12981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71da52ddc5e74ba9b2c30aa95ad2500a'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:41.509571 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a17d0fcf-1115-405b-8761-c53511f12981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71da52ddc5e74ba9b2c30aa95ad2500a'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:41.563723 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a17d0fcf-1115-405b-8761-c53511f12981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71da52ddc5e74ba9b2c30aa95ad2500a'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:41.564346 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a17d0fcf-1115-405b-8761-c53511f12981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71da52ddc5e74ba9b2c30aa95ad2500a'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:41.576332 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a17d0fcf-1115-405b-8761-c53511f12981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71da52ddc5e74ba9b2c30aa95ad2500a'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:41.582164 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1320/2644] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:08:41 2022] DELETE /identity/v3/users/71da52ddc5e74ba9b2c30aa95ad2500a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:42.005483 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0409fa-b7ad-4698-b49b-18d54e8a5d90 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:42.007005 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ce0409fa-b7ad-4698-b49b-18d54e8a5d90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:42.023880 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0409fa-b7ad-4698-b49b-18d54e8a5d90 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:42.083234 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c1a508-235f-4b7b-8611-4d6b17e212a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:42.084074 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1a508-235f-4b7b-8611-4d6b17e212a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:42.084358 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1a508-235f-4b7b-8611-4d6b17e212a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:42.084629 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c1a508-235f-4b7b-8611-4d6b17e212a5 admin admin] PATH_INFO: `/v3/projects/bbf949de833240068c1152ba7cbb0b35` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:42.085813 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1a508-235f-4b7b-8611-4d6b17e212a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbf949de833240068c1152ba7cbb0b35)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:42.087740 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c1a508-235f-4b7b-8611-4d6b17e212a5 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:42.168624 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-07c1a508-235f-4b7b-8611-4d6b17e212a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbf949de833240068c1152ba7cbb0b35', 'request_id': 'req-07c1a508-235f-4b7b-8611-4d6b17e212a5'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:42.230897 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-07c1a508-235f-4b7b-8611-4d6b17e212a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbf949de833240068c1152ba7cbb0b35', 'request_id': 'req-07c1a508-235f-4b7b-8611-4d6b17e212a5'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:42.236656 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-07c1a508-235f-4b7b-8611-4d6b17e212a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbf949de833240068c1152ba7cbb0b35', 'request_id': 'req-07c1a508-235f-4b7b-8611-4d6b17e212a5'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:42.248117 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-07c1a508-235f-4b7b-8611-4d6b17e212a5 admin admin] The token cache is being invalidate because project bbf949de833240068c1152ba7cbb0b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:08:42.248454 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-07c1a508-235f-4b7b-8611-4d6b17e212a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:42.249031 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-07c1a508-235f-4b7b-8611-4d6b17e212a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:42.250543 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1325/2645] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:08:42 2022] DELETE /identity/v3/projects/bbf949de833240068c1152ba7cbb0b35 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:42.255373 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef62f0b-7239-4702-bdc7-6372c5430d88 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:42.255658 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef62f0b-7239-4702-bdc7-6372c5430d88 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:42.255931 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef62f0b-7239-4702-bdc7-6372c5430d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:42.273781 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-5ef62f0b-7239-4702-bdc7-6372c5430d88 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:42.275008 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-5ef62f0b-7239-4702-bdc7-6372c5430d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:42.331558 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1321/2646] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:42.340730 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c938f5-5e68-4b73-b42c-1f4cfdb092d6 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:42.341011 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c938f5-5e68-4b73-b42c-1f4cfdb092d6 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:42.341287 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c938f5-5e68-4b73-b42c-1f4cfdb092d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:42.359015 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-10c938f5-5e68-4b73-b42c-1f4cfdb092d6 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:42.360207 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-10c938f5-5e68-4b73-b42c-1f4cfdb092d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:42.368281 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1326/2647] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:42.372221 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef62f0b-7239-4702-bdc7-6372c5430d88 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:42.381626 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef62f0b-7239-4702-bdc7-6372c5430d88 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:42.386308 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a7d6c-a1c2-4cd8-9d38-c013258391e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:42.387476 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a7d6c-a1c2-4cd8-9d38-c013258391e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:42.387798 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a7d6c-a1c2-4cd8-9d38-c013258391e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:42.388067 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a7d6c-a1c2-4cd8-9d38-c013258391e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:42.388778 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a7d6c-a1c2-4cd8-9d38-c013258391e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:08:42.389076 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a7d6c-a1c2-4cd8-9d38-c013258391e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:42.390666 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a7d6c-a1c2-4cd8-9d38-c013258391e7 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:42.401824 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1322/2648] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:08:42.406492 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c938f5-5e68-4b73-b42c-1f4cfdb092d6 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:42.416032 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c938f5-5e68-4b73-b42c-1f4cfdb092d6 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:42.420745 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875fea8-bf80-49ad-830a-6167af69384c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:42.421400 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875fea8-bf80-49ad-830a-6167af69384c admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:42.421677 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875fea8-bf80-49ad-830a-6167af69384c admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:42.421947 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875fea8-bf80-49ad-830a-6167af69384c admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:42.422652 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875fea8-bf80-49ad-830a-6167af69384c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:42.424573 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875fea8-bf80-49ad-830a-6167af69384c admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:42.519941 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1327/2649] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:08:42 2022] POST /identity/v3/projects => generated 377 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:08:42.524163 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a7d6c-a1c2-4cd8-9d38-c013258391e7 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:42.533842 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a7d6c-a1c2-4cd8-9d38-c013258391e7 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:42.591499 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4c737-2270-4bfa-888f-f9c659fe3925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:42.592181 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4c737-2270-4bfa-888f-f9c659fe3925 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:42.592454 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4c737-2270-4bfa-888f-f9c659fe3925 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:42.592724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4c737-2270-4bfa-888f-f9c659fe3925 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:42.593399 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4c737-2270-4bfa-888f-f9c659fe3925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:42.595308 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4c737-2270-4bfa-888f-f9c659fe3925 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:42.684164 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1323/2650] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:08:42 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:08:42.688357 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875fea8-bf80-49ad-830a-6167af69384c admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:42.698354 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875fea8-bf80-49ad-830a-6167af69384c admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:42.703473 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d7495-5b21-4df0-b90e-681a32883ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:42.704116 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d7495-5b21-4df0-b90e-681a32883ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:42.704393 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d7495-5b21-4df0-b90e-681a32883ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:42.704664 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d7495-5b21-4df0-b90e-681a32883ee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:42.705598 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d7495-5b21-4df0-b90e-681a32883ee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:42.707631 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d7495-5b21-4df0-b90e-681a32883ee7 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:42.719968 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1328/2651] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:08:42.724015 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4c737-2270-4bfa-888f-f9c659fe3925 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:42.733993 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4c737-2270-4bfa-888f-f9c659fe3925 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:42.739023 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7826ab4-50f3-46bc-9980-7cc2b6cab7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:42.739675 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7826ab4-50f3-46bc-9980-7cc2b6cab7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:42.739994 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7826ab4-50f3-46bc-9980-7cc2b6cab7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:42.740276 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7826ab4-50f3-46bc-9980-7cc2b6cab7e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:42.741023 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7826ab4-50f3-46bc-9980-7cc2b6cab7e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:42.742605 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7826ab4-50f3-46bc-9980-7cc2b6cab7e5 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:42.753055 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1324/2652] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:08:42.757162 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d7495-5b21-4df0-b90e-681a32883ee7 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:42.767850 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d7495-5b21-4df0-b90e-681a32883ee7 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:42.772629 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f3f8e-c6c4-4727-a097-e988e8dbfb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:42.773503 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f3f8e-c6c4-4727-a097-e988e8dbfb39 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:42.773780 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f3f8e-c6c4-4727-a097-e988e8dbfb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:42.774052 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f3f8e-c6c4-4727-a097-e988e8dbfb39 admin admin] PATH_INFO: `/v3/projects/30bed69afa6e41b8856b9b5da4a7ff85/users/e0d64e418a63408798f047b1ccea7dd3/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:42.788176 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f3f8e-c6c4-4727-a097-e988e8dbfb39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30bed69afa6e41b8856b9b5da4a7ff85, user_id=e0d64e418a63408798f047b1ccea7dd3, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:42.790783 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f3f8e-c6c4-4727-a097-e988e8dbfb39 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:42.849014 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1329/2653] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:08:42 2022] PUT /identity/v3/projects/30bed69afa6e41b8856b9b5da4a7ff85/users/e0d64e418a63408798f047b1ccea7dd3/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:42.863595 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ee0b2-1b7c-467d-a4ea-22e7c05ca131 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:42.864049 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ee0b2-1b7c-467d-a4ea-22e7c05ca131 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:42.864340 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ee0b2-1b7c-467d-a4ea-22e7c05ca131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:42.890817 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-5b4ee0b2-1b7c-467d-a4ea-22e7c05ca131 None None] MFA Rules not processed for user `e0d64e418a63408798f047b1ccea7dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:42.892064 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-5b4ee0b2-1b7c-467d-a4ea-22e7c05ca131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:42.952545 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1325/2654] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:42.963358 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f3f8e-c6c4-4727-a097-e988e8dbfb39 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:42.965052 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-0b2f3f8e-c6c4-4727-a097-e988e8dbfb39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:43.020364 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f3f8e-c6c4-4727-a097-e988e8dbfb39 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:43.024195 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df60d0-e14f-4485-91cf-f92d04e1325f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2ad9c7f930e426bb908237f72c04a2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:43.024768 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df60d0-e14f-4485-91cf-f92d04e1325f service glance] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:43.025047 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df60d0-e14f-4485-91cf-f92d04e1325f service glance] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:43.025321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05df60d0-e14f-4485-91cf-f92d04e1325f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:43.033375 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df60d0-e14f-4485-91cf-f92d04e1325f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:43.034777 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05df60d0-e14f-4485-91cf-f92d04e1325f service glance] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:43.043903 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1330/2655] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:08:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:08:53.588155 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ee0b2-1b7c-467d-a4ea-22e7c05ca131 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:53.589683 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-5b4ee0b2-1b7c-467d-a4ea-22e7c05ca131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:53.644183 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ee0b2-1b7c-467d-a4ea-22e7c05ca131 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:53.647953 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349da36b-22b8-4de7-b2e5-4e943c3a5f96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:53.648699 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349da36b-22b8-4de7-b2e5-4e943c3a5f96 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:53.648981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349da36b-22b8-4de7-b2e5-4e943c3a5f96 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:53.649256 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349da36b-22b8-4de7-b2e5-4e943c3a5f96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:53.651297 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-349da36b-22b8-4de7-b2e5-4e943c3a5f96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:53.716276 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349da36b-22b8-4de7-b2e5-4e943c3a5f96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:53.717734 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349da36b-22b8-4de7-b2e5-4e943c3a5f96 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:53.728028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1326/2656] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:08:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:08:57.448659 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df60d0-e14f-4485-91cf-f92d04e1325f service glance] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:57.450792 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-05df60d0-e14f-4485-91cf-f92d04e1325f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:57.466955 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05df60d0-e14f-4485-91cf-f92d04e1325f service glance] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:57.471693 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a9b62-0c17-4676-9aae-c1ae9b43570b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:57.472544 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a9b62-0c17-4676-9aae-c1ae9b43570b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:57.472816 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a9b62-0c17-4676-9aae-c1ae9b43570b admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:57.473089 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a9b62-0c17-4676-9aae-c1ae9b43570b admin admin] PATH_INFO: `/v3/users/1da750621eb94e5db8e50dddb008602c` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:57.474254 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a9b62-0c17-4676-9aae-c1ae9b43570b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da750621eb94e5db8e50dddb008602c)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:57.476175 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a9b62-0c17-4676-9aae-c1ae9b43570b admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:57.633362 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-126a9b62-0c17-4676-9aae-c1ae9b43570b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da750621eb94e5db8e50dddb008602c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:57.683473 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-126a9b62-0c17-4676-9aae-c1ae9b43570b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da750621eb94e5db8e50dddb008602c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:57.684098 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-126a9b62-0c17-4676-9aae-c1ae9b43570b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da750621eb94e5db8e50dddb008602c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:57.691441 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-126a9b62-0c17-4676-9aae-c1ae9b43570b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da750621eb94e5db8e50dddb008602c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:57.702812 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-126a9b62-0c17-4676-9aae-c1ae9b43570b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da750621eb94e5db8e50dddb008602c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:57.708726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1331/2657] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:08:57 2022] DELETE /identity/v3/users/1da750621eb94e5db8e50dddb008602c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:57.934812 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349da36b-22b8-4de7-b2e5-4e943c3a5f96 service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:57.944947 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349da36b-22b8-4de7-b2e5-4e943c3a5f96 service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:58.004199 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17720c3f-5711-41dc-811e-2efdb0bdcf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:58.005051 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17720c3f-5711-41dc-811e-2efdb0bdcf1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:58.005330 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17720c3f-5711-41dc-811e-2efdb0bdcf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:58.005601 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17720c3f-5711-41dc-811e-2efdb0bdcf1b admin admin] PATH_INFO: `/v3/projects/f86f93d46d394081b4da1693c28e9c7e` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:58.006794 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17720c3f-5711-41dc-811e-2efdb0bdcf1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f86f93d46d394081b4da1693c28e9c7e)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:58.009040 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17720c3f-5711-41dc-811e-2efdb0bdcf1b admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:58.123850 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-17720c3f-5711-41dc-811e-2efdb0bdcf1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f86f93d46d394081b4da1693c28e9c7e', 'request_id': 'req-17720c3f-5711-41dc-811e-2efdb0bdcf1b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:58.129617 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-17720c3f-5711-41dc-811e-2efdb0bdcf1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f86f93d46d394081b4da1693c28e9c7e', 'request_id': 'req-17720c3f-5711-41dc-811e-2efdb0bdcf1b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:58.249291 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-17720c3f-5711-41dc-811e-2efdb0bdcf1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f86f93d46d394081b4da1693c28e9c7e', 'request_id': 'req-17720c3f-5711-41dc-811e-2efdb0bdcf1b'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:58.260689 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-17720c3f-5711-41dc-811e-2efdb0bdcf1b admin admin] The token cache is being invalidate because project f86f93d46d394081b4da1693c28e9c7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:08:58.260977 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-17720c3f-5711-41dc-811e-2efdb0bdcf1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:58.261591 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-17720c3f-5711-41dc-811e-2efdb0bdcf1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:08:58.263773 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1327/2658] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:08:57 2022] DELETE /identity/v3/projects/f86f93d46d394081b4da1693c28e9c7e => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:08:58.268711 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42777915-a64b-44dd-8db3-d979feba491a None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:58.268999 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42777915-a64b-44dd-8db3-d979feba491a None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:58.269275 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42777915-a64b-44dd-8db3-d979feba491a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:58.287478 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-42777915-a64b-44dd-8db3-d979feba491a None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:58.288656 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-42777915-a64b-44dd-8db3-d979feba491a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:58.344770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1332/2659] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:58.352368 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24418bb8-2ff1-4cc9-8975-80922bb96434 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:58.352661 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24418bb8-2ff1-4cc9-8975-80922bb96434 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:58.352943 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24418bb8-2ff1-4cc9-8975-80922bb96434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:58.371052 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-24418bb8-2ff1-4cc9-8975-80922bb96434 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:58.372251 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-24418bb8-2ff1-4cc9-8975-80922bb96434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:58.380144 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1328/2660] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:08:58.384145 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42777915-a64b-44dd-8db3-d979feba491a None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:58.394073 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42777915-a64b-44dd-8db3-d979feba491a None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:58.398566 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e10c3-6f6a-497d-9c9e-92d9766482a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:58.399244 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e10c3-6f6a-497d-9c9e-92d9766482a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:58.399523 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e10c3-6f6a-497d-9c9e-92d9766482a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:58.399791 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e10c3-6f6a-497d-9c9e-92d9766482a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:58.400511 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e10c3-6f6a-497d-9c9e-92d9766482a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:08:58.400862 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e10c3-6f6a-497d-9c9e-92d9766482a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:58.402423 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e10c3-6f6a-497d-9c9e-92d9766482a5 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:58.414814 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1333/2661] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:08:58.418981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24418bb8-2ff1-4cc9-8975-80922bb96434 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:58.428252 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24418bb8-2ff1-4cc9-8975-80922bb96434 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:58.433134 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c0b01-ce70-4481-93b8-3d6168bc031a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:58.433781 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c0b01-ce70-4481-93b8-3d6168bc031a admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:58.434065 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c0b01-ce70-4481-93b8-3d6168bc031a admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:58.434342 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c0b01-ce70-4481-93b8-3d6168bc031a admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:58.435090 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c0b01-ce70-4481-93b8-3d6168bc031a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:58.437031 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c0b01-ce70-4481-93b8-3d6168bc031a admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:58.553741 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1329/2662] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:08:58 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:08:58.560345 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e10c3-6f6a-497d-9c9e-92d9766482a5 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:58.570273 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e10c3-6f6a-497d-9c9e-92d9766482a5 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:58.623577 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbcc94-db2b-4212-8074-e981e27ed59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:58.627456 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbcc94-db2b-4212-8074-e981e27ed59a admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:58.627456 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbcc94-db2b-4212-8074-e981e27ed59a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:58.627456 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbcc94-db2b-4212-8074-e981e27ed59a admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:58.627456 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbcc94-db2b-4212-8074-e981e27ed59a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:58.627834 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcbcc94-db2b-4212-8074-e981e27ed59a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:58.701124 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1334/2663] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:08:58 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:08:58.705325 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c0b01-ce70-4481-93b8-3d6168bc031a admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:58.715415 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c0b01-ce70-4481-93b8-3d6168bc031a admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:58.720002 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c786e-ddfc-4104-9317-bc1633ffef62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:58.720700 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c786e-ddfc-4104-9317-bc1633ffef62 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:58.720980 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c786e-ddfc-4104-9317-bc1633ffef62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:58.721250 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c786e-ddfc-4104-9317-bc1633ffef62 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:58.721984 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c786e-ddfc-4104-9317-bc1633ffef62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:58.723584 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c786e-ddfc-4104-9317-bc1633ffef62 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:58.734747 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1330/2664] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:08:58.738939 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbcc94-db2b-4212-8074-e981e27ed59a admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:58.749229 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbcc94-db2b-4212-8074-e981e27ed59a admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:58.753812 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d67ec1-5954-4067-9ccb-60a109e77ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:58.754459 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d67ec1-5954-4067-9ccb-60a109e77ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:58.754735 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d67ec1-5954-4067-9ccb-60a109e77ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:58.755269 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d67ec1-5954-4067-9ccb-60a109e77ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:58.755998 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d67ec1-5954-4067-9ccb-60a109e77ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:58.757564 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d67ec1-5954-4067-9ccb-60a109e77ab2 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:58.768254 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1335/2665] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:08:58.772464 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c786e-ddfc-4104-9317-bc1633ffef62 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:58.782140 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c786e-ddfc-4104-9317-bc1633ffef62 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:58.786697 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92842117-380b-4e86-8260-697a601894e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:58.787591 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92842117-380b-4e86-8260-697a601894e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:58.787869 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92842117-380b-4e86-8260-697a601894e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:58.788137 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92842117-380b-4e86-8260-697a601894e3 admin admin] PATH_INFO: `/v3/projects/dffec5ef81d44b04937250eaeeceeac4/users/6fcf06e5e37b4ef9a103c81955190362/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:58.801992 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92842117-380b-4e86-8260-697a601894e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dffec5ef81d44b04937250eaeeceeac4, user_id=6fcf06e5e37b4ef9a103c81955190362, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:58.804699 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92842117-380b-4e86-8260-697a601894e3 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:58.871342 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1331/2666] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:08:58 2022] PUT /identity/v3/projects/dffec5ef81d44b04937250eaeeceeac4/users/6fcf06e5e37b4ef9a103c81955190362/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:08:58.876909 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb773bd-1451-4b39-963d-363d1623c0cd None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:58.879498 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb773bd-1451-4b39-963d-363d1623c0cd None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:58.879498 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb773bd-1451-4b39-963d-363d1623c0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:58.895172 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-1cb773bd-1451-4b39-963d-363d1623c0cd None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:08:58.896346 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-1cb773bd-1451-4b39-963d-363d1623c0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:58.951957 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1336/2667] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:08:58.961267 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92842117-380b-4e86-8260-697a601894e3 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:08:58.962981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-92842117-380b-4e86-8260-697a601894e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:08:59.016908 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92842117-380b-4e86-8260-697a601894e3 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:08:59.020466 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea4e09-845d-4d3d-a43a-e9316d697b28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:08:59.021098 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea4e09-845d-4d3d-a43a-e9316d697b28 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:08:59.021375 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea4e09-845d-4d3d-a43a-e9316d697b28 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:08:59.021647 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea4e09-845d-4d3d-a43a-e9316d697b28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:08:59.030388 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea4e09-845d-4d3d-a43a-e9316d697b28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:08:59.031820 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea4e09-845d-4d3d-a43a-e9316d697b28 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:08:59.041195 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1332/2668] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:08:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:09:02.227688 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb773bd-1451-4b39-963d-363d1623c0cd None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:02.229670 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-1cb773bd-1451-4b39-963d-363d1623c0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:02.242893 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb773bd-1451-4b39-963d-363d1623c0cd None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:02.250019 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99822b-86de-4ddb-8021-50cbade5bb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:02.251166 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99822b-86de-4ddb-8021-50cbade5bb1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:02.251556 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99822b-86de-4ddb-8021-50cbade5bb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:02.251829 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99822b-86de-4ddb-8021-50cbade5bb1a admin admin] PATH_INFO: `/v3/users/e0d64e418a63408798f047b1ccea7dd3` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:02.253389 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99822b-86de-4ddb-8021-50cbade5bb1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d64e418a63408798f047b1ccea7dd3)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:02.263151 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99822b-86de-4ddb-8021-50cbade5bb1a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:02.461818 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-cb99822b-86de-4ddb-8021-50cbade5bb1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d64e418a63408798f047b1ccea7dd3'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:02.545558 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-cb99822b-86de-4ddb-8021-50cbade5bb1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d64e418a63408798f047b1ccea7dd3'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:02.547773 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-cb99822b-86de-4ddb-8021-50cbade5bb1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d64e418a63408798f047b1ccea7dd3'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:02.571625 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-cb99822b-86de-4ddb-8021-50cbade5bb1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d64e418a63408798f047b1ccea7dd3'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:02.596892 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-cb99822b-86de-4ddb-8021-50cbade5bb1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d64e418a63408798f047b1ccea7dd3'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:02.609575 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1337/2669] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:09:02 2022] DELETE /identity/v3/users/e0d64e418a63408798f047b1ccea7dd3 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:09:02.614928 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eebd47-df9e-4187-aaf6-7fab7d158e7d None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:02.615425 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eebd47-df9e-4187-aaf6-7fab7d158e7d None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:02.615665 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eebd47-df9e-4187-aaf6-7fab7d158e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:02.633989 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-d9eebd47-df9e-4187-aaf6-7fab7d158e7d None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:09:02.635251 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d9eebd47-df9e-4187-aaf6-7fab7d158e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:02.696103 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1333/2670] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:09:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:09:02.706210 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99822b-86de-4ddb-8021-50cbade5bb1a admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:02.707652 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-cb99822b-86de-4ddb-8021-50cbade5bb1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:02.781427 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99822b-86de-4ddb-8021-50cbade5bb1a admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:02.785041 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3c6fd9-da97-44e6-b91e-59a1b89ada43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:02.785672 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c6fd9-da97-44e6-b91e-59a1b89ada43 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:02.785950 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c6fd9-da97-44e6-b91e-59a1b89ada43 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:02.786217 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3c6fd9-da97-44e6-b91e-59a1b89ada43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:02.797036 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c6fd9-da97-44e6-b91e-59a1b89ada43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:02.798471 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3c6fd9-da97-44e6-b91e-59a1b89ada43 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:02.808335 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1338/2671] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:09:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:09:03.210727 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eebd47-df9e-4187-aaf6-7fab7d158e7d None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:03.213046 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d9eebd47-df9e-4187-aaf6-7fab7d158e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:03.234740 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eebd47-df9e-4187-aaf6-7fab7d158e7d None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:03.242290 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce653f-4bb9-4846-aee8-71909f9107ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:03.242290 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce653f-4bb9-4846-aee8-71909f9107ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:03.242290 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce653f-4bb9-4846-aee8-71909f9107ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:03.242290 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce653f-4bb9-4846-aee8-71909f9107ca admin admin] PATH_INFO: `/v3/projects/30bed69afa6e41b8856b9b5da4a7ff85` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:03.243494 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce653f-4bb9-4846-aee8-71909f9107ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=30bed69afa6e41b8856b9b5da4a7ff85)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:03.245408 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce653f-4bb9-4846-aee8-71909f9107ca admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:03.389986 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6dce653f-4bb9-4846-aee8-71909f9107ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30bed69afa6e41b8856b9b5da4a7ff85', 'request_id': 'req-6dce653f-4bb9-4846-aee8-71909f9107ca'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:03.395534 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6dce653f-4bb9-4846-aee8-71909f9107ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30bed69afa6e41b8856b9b5da4a7ff85', 'request_id': 'req-6dce653f-4bb9-4846-aee8-71909f9107ca'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:03.472361 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6dce653f-4bb9-4846-aee8-71909f9107ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30bed69afa6e41b8856b9b5da4a7ff85', 'request_id': 'req-6dce653f-4bb9-4846-aee8-71909f9107ca'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:03.487072 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6dce653f-4bb9-4846-aee8-71909f9107ca admin admin] The token cache is being invalidate because project 30bed69afa6e41b8856b9b5da4a7ff85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:09:03.487820 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6dce653f-4bb9-4846-aee8-71909f9107ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:03.488690 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6dce653f-4bb9-4846-aee8-71909f9107ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:03.490535 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1334/2672] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:09:03 2022] DELETE /identity/v3/projects/30bed69afa6e41b8856b9b5da4a7ff85 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:09:03.498268 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3681d-79d8-4646-ae45-d8af2f717176 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:03.498268 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3681d-79d8-4646-ae45-d8af2f717176 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:03.498268 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d3681d-79d8-4646-ae45-d8af2f717176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:03.530407 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-c2d3681d-79d8-4646-ae45-d8af2f717176 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:09:03.532182 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-c2d3681d-79d8-4646-ae45-d8af2f717176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:03.603095 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1339/2673] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:09:03.610458 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cee3b-fd70-42c0-a7b6-b92f3276528f None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:03.612679 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cee3b-fd70-42c0-a7b6-b92f3276528f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:03.612679 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100cee3b-fd70-42c0-a7b6-b92f3276528f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:03.631398 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-100cee3b-fd70-42c0-a7b6-b92f3276528f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:09:03.633565 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-100cee3b-fd70-42c0-a7b6-b92f3276528f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:03.646189 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1335/2674] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:09:03.647122 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3681d-79d8-4646-ae45-d8af2f717176 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:03.658634 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d3681d-79d8-4646-ae45-d8af2f717176 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:03.666010 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612860f1-bf1d-45d2-acb6-77d20b598cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:03.670265 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612860f1-bf1d-45d2-acb6-77d20b598cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:03.670265 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612860f1-bf1d-45d2-acb6-77d20b598cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:03.670265 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612860f1-bf1d-45d2-acb6-77d20b598cf0 admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:03.671059 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612860f1-bf1d-45d2-acb6-77d20b598cf0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:09:03.671643 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612860f1-bf1d-45d2-acb6-77d20b598cf0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:03.673433 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612860f1-bf1d-45d2-acb6-77d20b598cf0 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:03.686424 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1340/2675] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:09:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:09:03.690804 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cee3b-fd70-42c0-a7b6-b92f3276528f None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:03.701349 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100cee3b-fd70-42c0-a7b6-b92f3276528f None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:03.706735 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc571370-172a-4c7c-a0fa-a8b458cd682f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:03.707681 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc571370-172a-4c7c-a0fa-a8b458cd682f admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:03.708169 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc571370-172a-4c7c-a0fa-a8b458cd682f admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:03.709926 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc571370-172a-4c7c-a0fa-a8b458cd682f admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:03.710795 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc571370-172a-4c7c-a0fa-a8b458cd682f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:03.712786 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc571370-172a-4c7c-a0fa-a8b458cd682f admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:03.805930 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1336/2676] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:09:03 2022] POST /identity/v3/projects => generated 359 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:09:03.810763 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612860f1-bf1d-45d2-acb6-77d20b598cf0 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:03.821907 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612860f1-bf1d-45d2-acb6-77d20b598cf0 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:03.881420 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acf170-2f30-4590-997e-398caa576e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:03.882304 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acf170-2f30-4590-997e-398caa576e44 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:03.883552 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acf170-2f30-4590-997e-398caa576e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:03.883552 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8acf170-2f30-4590-997e-398caa576e44 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:03.884225 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acf170-2f30-4590-997e-398caa576e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:03.886316 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8acf170-2f30-4590-997e-398caa576e44 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:03.969470 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1341/2677] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:09:03 2022] POST /identity/v3/users => generated 280 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:09:03.970816 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc571370-172a-4c7c-a0fa-a8b458cd682f admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:03.982753 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc571370-172a-4c7c-a0fa-a8b458cd682f admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:03.988315 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1e9bb-db7a-49ec-a45d-ec1fc6f41c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:03.988983 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1e9bb-db7a-49ec-a45d-ec1fc6f41c51 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:03.989261 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1e9bb-db7a-49ec-a45d-ec1fc6f41c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:03.989531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb1e9bb-db7a-49ec-a45d-ec1fc6f41c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:03.990263 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1e9bb-db7a-49ec-a45d-ec1fc6f41c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:03.991923 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb1e9bb-db7a-49ec-a45d-ec1fc6f41c51 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:04.006911 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1337/2678] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:09:04.008923 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acf170-2f30-4590-997e-398caa576e44 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:04.022291 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8acf170-2f30-4590-997e-398caa576e44 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:04.031652 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34159b01-3e6a-498d-808a-353bd2d5c677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:04.032589 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34159b01-3e6a-498d-808a-353bd2d5c677 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:04.033055 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34159b01-3e6a-498d-808a-353bd2d5c677 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:04.033485 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34159b01-3e6a-498d-808a-353bd2d5c677 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:04.034611 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34159b01-3e6a-498d-808a-353bd2d5c677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:04.036422 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34159b01-3e6a-498d-808a-353bd2d5c677 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:04.050782 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1342/2679] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:09:04.052662 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1e9bb-db7a-49ec-a45d-ec1fc6f41c51 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:04.067332 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb1e9bb-db7a-49ec-a45d-ec1fc6f41c51 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:04.073063 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc8731-0743-40e3-bf14-db2ebc414f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:04.074539 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc8731-0743-40e3-bf14-db2ebc414f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:04.076189 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc8731-0743-40e3-bf14-db2ebc414f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:04.076640 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc8731-0743-40e3-bf14-db2ebc414f5d admin admin] PATH_INFO: `/v3/projects/d82d880725d24b119502e5d3ea46f622/users/08c0f6db4a2e4fda8aea9ae70fe6a4ad/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:04.117395 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc8731-0743-40e3-bf14-db2ebc414f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d82d880725d24b119502e5d3ea46f622, user_id=08c0f6db4a2e4fda8aea9ae70fe6a4ad, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:04.122557 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cc8731-0743-40e3-bf14-db2ebc414f5d admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:04.248335 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1338/2680] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:09:04 2022] PUT /identity/v3/projects/d82d880725d24b119502e5d3ea46f622/users/08c0f6db4a2e4fda8aea9ae70fe6a4ad/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:09:04.260270 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0f53e-a2b8-4eb5-83d9-e72466daeee9 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:04.260558 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0f53e-a2b8-4eb5-83d9-e72466daeee9 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:04.260843 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0f53e-a2b8-4eb5-83d9-e72466daeee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:04.292718 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-85c0f53e-a2b8-4eb5-83d9-e72466daeee9 None None] MFA Rules not processed for user `08c0f6db4a2e4fda8aea9ae70fe6a4ad`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:09:04.294602 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-85c0f53e-a2b8-4eb5-83d9-e72466daeee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:04.380679 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1343/2681] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:09:04 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:09:04.421807 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc8731-0743-40e3-bf14-db2ebc414f5d admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:04.423762 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-90cc8731-0743-40e3-bf14-db2ebc414f5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:04.498757 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc8731-0743-40e3-bf14-db2ebc414f5d admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:04.502460 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c79f57e-0bfc-4ada-80ab-35cc594c70d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:04.503103 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79f57e-0bfc-4ada-80ab-35cc594c70d7 service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:04.503665 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79f57e-0bfc-4ada-80ab-35cc594c70d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:04.503665 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c79f57e-0bfc-4ada-80ab-35cc594c70d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:04.513519 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79f57e-0bfc-4ada-80ab-35cc594c70d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:04.514981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c79f57e-0bfc-4ada-80ab-35cc594c70d7 service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:04.524820 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1339/2682] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:09:04 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:09:04.539918 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0f53e-a2b8-4eb5-83d9-e72466daeee9 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:04.608225 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0f53e-a2b8-4eb5-83d9-e72466daeee9 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:04.617266 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f8b66-16a3-47e0-afc5-87f176619ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:04.618247 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f8b66-16a3-47e0-afc5-87f176619ed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:04.619201 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f8b66-16a3-47e0-afc5-87f176619ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:04.619661 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77f8b66-16a3-47e0-afc5-87f176619ed2 admin admin] PATH_INFO: `/v3/users/08c0f6db4a2e4fda8aea9ae70fe6a4ad` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:04.621344 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f8b66-16a3-47e0-afc5-87f176619ed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08c0f6db4a2e4fda8aea9ae70fe6a4ad)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:04.623723 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77f8b66-16a3-47e0-afc5-87f176619ed2 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:04.632537 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8716092-9cce-43f6-9dc6-e69ee46f15ee None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:04.639957 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8716092-9cce-43f6-9dc6-e69ee46f15ee None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:04.639957 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8716092-9cce-43f6-9dc6-e69ee46f15ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:04.672934 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-c8716092-9cce-43f6-9dc6-e69ee46f15ee None None] MFA Rules not processed for user `6fcf06e5e37b4ef9a103c81955190362`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:09:04.674388 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-c8716092-9cce-43f6-9dc6-e69ee46f15ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:04.740756 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1340/2683] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:09:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:09:04.759620 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8716092-9cce-43f6-9dc6-e69ee46f15ee None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:04.761121 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-c8716092-9cce-43f6-9dc6-e69ee46f15ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:04.835849 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8716092-9cce-43f6-9dc6-e69ee46f15ee None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:04.848776 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150b66c-9819-4ad4-8f38-d1e90429c32f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:04.848776 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150b66c-9819-4ad4-8f38-d1e90429c32f service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:04.848776 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150b66c-9819-4ad4-8f38-d1e90429c32f service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:04.848776 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150b66c-9819-4ad4-8f38-d1e90429c32f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:04.855205 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e77f8b66-16a3-47e0-afc5-87f176619ed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08c0f6db4a2e4fda8aea9ae70fe6a4ad'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:04.855632 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150b66c-9819-4ad4-8f38-d1e90429c32f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:04.857886 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150b66c-9819-4ad4-8f38-d1e90429c32f service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:04.867652 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1341/2684] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:09:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:09:04.923316 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e77f8b66-16a3-47e0-afc5-87f176619ed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08c0f6db4a2e4fda8aea9ae70fe6a4ad'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:04.924036 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e77f8b66-16a3-47e0-afc5-87f176619ed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08c0f6db4a2e4fda8aea9ae70fe6a4ad'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:04.931540 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e77f8b66-16a3-47e0-afc5-87f176619ed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08c0f6db4a2e4fda8aea9ae70fe6a4ad'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:04.943365 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-e77f8b66-16a3-47e0-afc5-87f176619ed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08c0f6db4a2e4fda8aea9ae70fe6a4ad'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:04.949338 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1344/2685] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:09:04 2022] DELETE /identity/v3/users/08c0f6db4a2e4fda8aea9ae70fe6a4ad => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:09:04.954514 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65a7b5-845b-4b23-919a-7dd18334d04d None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:04.954805 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65a7b5-845b-4b23-919a-7dd18334d04d None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:04.955158 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65a7b5-845b-4b23-919a-7dd18334d04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:04.972780 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-5f65a7b5-845b-4b23-919a-7dd18334d04d None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:09:04.974053 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-5f65a7b5-845b-4b23-919a-7dd18334d04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:05.031641 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1342/2686] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:09:05.041374 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f8b66-16a3-47e0-afc5-87f176619ed2 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:05.042870 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-e77f8b66-16a3-47e0-afc5-87f176619ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:05.102247 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77f8b66-16a3-47e0-afc5-87f176619ed2 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:05.105886 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7fbc16-db40-4569-961f-75504ac20464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:05.106529 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fbc16-db40-4569-961f-75504ac20464 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:05.106810 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fbc16-db40-4569-961f-75504ac20464 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:05.107113 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fbc16-db40-4569-961f-75504ac20464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:05.117018 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fbc16-db40-4569-961f-75504ac20464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:05.118478 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fbc16-db40-4569-961f-75504ac20464 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:05.128628 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1345/2687] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:09:05.570654 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65a7b5-845b-4b23-919a-7dd18334d04d None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:05.572137 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-5f65a7b5-845b-4b23-919a-7dd18334d04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:05.587692 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65a7b5-845b-4b23-919a-7dd18334d04d None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:05.593033 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263382d-13e0-419d-87d0-520a2bb2e1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:05.593999 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263382d-13e0-419d-87d0-520a2bb2e1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:05.594206 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263382d-13e0-419d-87d0-520a2bb2e1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:05.594469 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263382d-13e0-419d-87d0-520a2bb2e1e8 admin admin] PATH_INFO: `/v3/projects/d82d880725d24b119502e5d3ea46f622` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:05.596267 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263382d-13e0-419d-87d0-520a2bb2e1e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d82d880725d24b119502e5d3ea46f622)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:05.599521 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263382d-13e0-419d-87d0-520a2bb2e1e8 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:05.728876 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6263382d-13e0-419d-87d0-520a2bb2e1e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd82d880725d24b119502e5d3ea46f622', 'request_id': 'req-6263382d-13e0-419d-87d0-520a2bb2e1e8'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:05.735152 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6263382d-13e0-419d-87d0-520a2bb2e1e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd82d880725d24b119502e5d3ea46f622', 'request_id': 'req-6263382d-13e0-419d-87d0-520a2bb2e1e8'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:05.825262 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6263382d-13e0-419d-87d0-520a2bb2e1e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd82d880725d24b119502e5d3ea46f622', 'request_id': 'req-6263382d-13e0-419d-87d0-520a2bb2e1e8'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:05.837058 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6263382d-13e0-419d-87d0-520a2bb2e1e8 admin admin] The token cache is being invalidate because project d82d880725d24b119502e5d3ea46f622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:09:05.837349 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6263382d-13e0-419d-87d0-520a2bb2e1e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:05.838039 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-6263382d-13e0-419d-87d0-520a2bb2e1e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:05.839558 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1343/2688] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:09:05 2022] DELETE /identity/v3/projects/d82d880725d24b119502e5d3ea46f622 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:09:05.844519 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ea266-fbbc-4f89-8212-c38dbb9d842d None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:05.844990 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ea266-fbbc-4f89-8212-c38dbb9d842d None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:05.845073 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ea266-fbbc-4f89-8212-c38dbb9d842d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:05.865034 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-2e0ea266-fbbc-4f89-8212-c38dbb9d842d None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:09:05.866649 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-2e0ea266-fbbc-4f89-8212-c38dbb9d842d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:05.931360 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1346/2689] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:09:05.939747 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cd017-f692-4c64-8eb3-a11810c863e6 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:05.940024 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cd017-f692-4c64-8eb3-a11810c863e6 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:05.940254 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2cd017-f692-4c64-8eb3-a11810c863e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:05.960531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-bc2cd017-f692-4c64-8eb3-a11810c863e6 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:09:05.962011 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-bc2cd017-f692-4c64-8eb3-a11810c863e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:05.985015 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ea266-fbbc-4f89-8212-c38dbb9d842d None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:05.985758 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1344/2690] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:09:06.005506 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ea266-fbbc-4f89-8212-c38dbb9d842d None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:06.023108 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f03d84-50e5-4805-8589-7b56285f4b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:06.024431 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f03d84-50e5-4805-8589-7b56285f4b58 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:06.024431 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f03d84-50e5-4805-8589-7b56285f4b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:06.024431 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f03d84-50e5-4805-8589-7b56285f4b58 admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:06.025027 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f03d84-50e5-4805-8589-7b56285f4b58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:09:06.025325 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f03d84-50e5-4805-8589-7b56285f4b58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:06.026952 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f03d84-50e5-4805-8589-7b56285f4b58 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:06.042884 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1347/2691] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:09:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:09:06.046417 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cd017-f692-4c64-8eb3-a11810c863e6 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:06.060057 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2cd017-f692-4c64-8eb3-a11810c863e6 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:06.065951 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c5e5c-c2c3-48a8-b291-fd5327571bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:06.066616 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c5e5c-c2c3-48a8-b291-fd5327571bba admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:06.066923 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c5e5c-c2c3-48a8-b291-fd5327571bba admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:06.067201 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c5e5c-c2c3-48a8-b291-fd5327571bba admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:06.067903 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c5e5c-c2c3-48a8-b291-fd5327571bba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:06.069865 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c5e5c-c2c3-48a8-b291-fd5327571bba admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:06.199224 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1345/2692] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:09:06 2022] POST /identity/v3/projects => generated 375 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:09:06.203713 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f03d84-50e5-4805-8589-7b56285f4b58 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:06.216658 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f03d84-50e5-4805-8589-7b56285f4b58 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:06.274784 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e078ff5-27a4-4001-8377-359581f73360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:06.275485 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e078ff5-27a4-4001-8377-359581f73360 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:06.275766 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e078ff5-27a4-4001-8377-359581f73360 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:06.276040 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e078ff5-27a4-4001-8377-359581f73360 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:06.276835 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e078ff5-27a4-4001-8377-359581f73360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:06.279306 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e078ff5-27a4-4001-8377-359581f73360 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:06.379529 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1348/2693] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:09:06 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:09:06.381785 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c5e5c-c2c3-48a8-b291-fd5327571bba admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:06.393434 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c5e5c-c2c3-48a8-b291-fd5327571bba admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:06.400882 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bcb6f-e5ec-4223-99ec-fd837ec27e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:06.401912 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bcb6f-e5ec-4223-99ec-fd837ec27e41 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:06.402516 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bcb6f-e5ec-4223-99ec-fd837ec27e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:06.403546 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9bcb6f-e5ec-4223-99ec-fd837ec27e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:06.404492 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9bcb6f-e5ec-4223-99ec-fd837ec27e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:06.406303 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9bcb6f-e5ec-4223-99ec-fd837ec27e41 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:06.424637 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1346/2694] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:09:06.425664 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e078ff5-27a4-4001-8377-359581f73360 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:06.435832 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e078ff5-27a4-4001-8377-359581f73360 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:06.441285 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0701301-8bf4-4fed-aaed-9723ab7f2394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:06.441942 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0701301-8bf4-4fed-aaed-9723ab7f2394 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:06.442218 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0701301-8bf4-4fed-aaed-9723ab7f2394 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:06.442486 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0701301-8bf4-4fed-aaed-9723ab7f2394 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:06.443244 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0701301-8bf4-4fed-aaed-9723ab7f2394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:06.444948 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0701301-8bf4-4fed-aaed-9723ab7f2394 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:06.455639 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1349/2695] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:09:06.460124 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bcb6f-e5ec-4223-99ec-fd837ec27e41 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:06.472548 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9bcb6f-e5ec-4223-99ec-fd837ec27e41 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:06.477548 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf431c-f0e9-4491-9cbb-be1f04160d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:06.478431 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf431c-f0e9-4491-9cbb-be1f04160d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:06.478709 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf431c-f0e9-4491-9cbb-be1f04160d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:06.479018 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf431c-f0e9-4491-9cbb-be1f04160d28 admin admin] PATH_INFO: `/v3/projects/172fb1c206834acd807390ecc62e655c/users/2137ac9b80a94c698149ecc001a92a45/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:06.495137 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf431c-f0e9-4491-9cbb-be1f04160d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=172fb1c206834acd807390ecc62e655c, user_id=2137ac9b80a94c698149ecc001a92a45, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:06.498028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf431c-f0e9-4491-9cbb-be1f04160d28 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:06.569511 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1347/2696] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:09:06 2022] PUT /identity/v3/projects/172fb1c206834acd807390ecc62e655c/users/2137ac9b80a94c698149ecc001a92a45/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:09:06.581049 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bccae3-063e-4763-8261-4beb0986bad3 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:06.581392 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bccae3-063e-4763-8261-4beb0986bad3 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:06.581657 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bccae3-063e-4763-8261-4beb0986bad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:06.612872 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-76bccae3-063e-4763-8261-4beb0986bad3 None None] MFA Rules not processed for user `2137ac9b80a94c698149ecc001a92a45`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:09:06.613980 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-76bccae3-063e-4763-8261-4beb0986bad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:06.686771 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1350/2697] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:09:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:09:06.697787 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf431c-f0e9-4491-9cbb-be1f04160d28 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:06.700350 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-96cf431c-f0e9-4491-9cbb-be1f04160d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:06.763704 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf431c-f0e9-4491-9cbb-be1f04160d28 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:06.767576 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84a6e6-0125-4ddd-a3c1-e2ad384a4650 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:06.768242 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84a6e6-0125-4ddd-a3c1-e2ad384a4650 service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:06.768521 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84a6e6-0125-4ddd-a3c1-e2ad384a4650 service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:06.768793 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84a6e6-0125-4ddd-a3c1-e2ad384a4650 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:06.780930 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84a6e6-0125-4ddd-a3c1-e2ad384a4650 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:06.782447 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84a6e6-0125-4ddd-a3c1-e2ad384a4650 service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:06.792893 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1348/2698] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:09:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:09:07.518620 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edfc08-80c8-4cf1-951f-6aa91f89a1cb None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:07.519075 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edfc08-80c8-4cf1-951f-6aa91f89a1cb None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:07.519354 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edfc08-80c8-4cf1-951f-6aa91f89a1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:07.543138 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-f1edfc08-80c8-4cf1-951f-6aa91f89a1cb None None] MFA Rules not processed for user `6fcf06e5e37b4ef9a103c81955190362`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:09:07.544470 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-f1edfc08-80c8-4cf1-951f-6aa91f89a1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:07.642455 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1351/2699] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:09:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:09:17.969778 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84a6e6-0125-4ddd-a3c1-e2ad384a4650 service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:18.029523 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84a6e6-0125-4ddd-a3c1-e2ad384a4650 service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:18.033996 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2783d3-d55d-4052-8146-8024e59e3314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:18.034861 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2783d3-d55d-4052-8146-8024e59e3314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:18.035152 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2783d3-d55d-4052-8146-8024e59e3314 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:18.035584 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2783d3-d55d-4052-8146-8024e59e3314 admin admin] PATH_INFO: `/v3/users/2137ac9b80a94c698149ecc001a92a45` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:18.036838 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2783d3-d55d-4052-8146-8024e59e3314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2137ac9b80a94c698149ecc001a92a45)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:18.038720 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2783d3-d55d-4052-8146-8024e59e3314 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:18.250823 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-0a2783d3-d55d-4052-8146-8024e59e3314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2137ac9b80a94c698149ecc001a92a45'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:18.257540 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-0a2783d3-d55d-4052-8146-8024e59e3314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2137ac9b80a94c698149ecc001a92a45'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:18.311989 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-0a2783d3-d55d-4052-8146-8024e59e3314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2137ac9b80a94c698149ecc001a92a45'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:18.312597 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-0a2783d3-d55d-4052-8146-8024e59e3314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2137ac9b80a94c698149ecc001a92a45'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:18.325223 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-0a2783d3-d55d-4052-8146-8024e59e3314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2137ac9b80a94c698149ecc001a92a45'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:18.331119 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1349/2700] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:09:17 2022] DELETE /identity/v3/users/2137ac9b80a94c698149ecc001a92a45 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:09:18.338406 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2e7b0-402a-4d69-a853-290302834615 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:18.338910 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2e7b0-402a-4d69-a853-290302834615 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:18.339021 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2e7b0-402a-4d69-a853-290302834615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:18.357202 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-dcf2e7b0-402a-4d69-a853-290302834615 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:09:18.358387 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-dcf2e7b0-402a-4d69-a853-290302834615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:18.416469 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1352/2701] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:09:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:09:18.426996 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2783d3-d55d-4052-8146-8024e59e3314 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:18.428384 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-0a2783d3-d55d-4052-8146-8024e59e3314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:18.484077 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2783d3-d55d-4052-8146-8024e59e3314 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:18.488210 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25199d-d86b-4853-97df-e1164af90624 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:18.488837 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25199d-d86b-4853-97df-e1164af90624 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:18.489113 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25199d-d86b-4853-97df-e1164af90624 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:18.489384 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25199d-d86b-4853-97df-e1164af90624 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:18.498401 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25199d-d86b-4853-97df-e1164af90624 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:18.499883 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac25199d-d86b-4853-97df-e1164af90624 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:18.509221 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1350/2702] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:09:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:09:18.913724 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2e7b0-402a-4d69-a853-290302834615 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:18.915458 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-dcf2e7b0-402a-4d69-a853-290302834615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:18.928478 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2e7b0-402a-4d69-a853-290302834615 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:18.933310 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a313183-8640-4974-80ae-3f20d261c9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:18.936396 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a313183-8640-4974-80ae-3f20d261c9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:18.936396 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a313183-8640-4974-80ae-3f20d261c9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:18.936396 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a313183-8640-4974-80ae-3f20d261c9e3 admin admin] PATH_INFO: `/v3/projects/172fb1c206834acd807390ecc62e655c` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:18.936692 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a313183-8640-4974-80ae-3f20d261c9e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=172fb1c206834acd807390ecc62e655c)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:18.938392 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a313183-8640-4974-80ae-3f20d261c9e3 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:19.047201 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8a313183-8640-4974-80ae-3f20d261c9e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '172fb1c206834acd807390ecc62e655c', 'request_id': 'req-8a313183-8640-4974-80ae-3f20d261c9e3'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:19.122224 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8a313183-8640-4974-80ae-3f20d261c9e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '172fb1c206834acd807390ecc62e655c', 'request_id': 'req-8a313183-8640-4974-80ae-3f20d261c9e3'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:19.128361 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8a313183-8640-4974-80ae-3f20d261c9e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '172fb1c206834acd807390ecc62e655c', 'request_id': 'req-8a313183-8640-4974-80ae-3f20d261c9e3'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:19.140008 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8a313183-8640-4974-80ae-3f20d261c9e3 admin admin] The token cache is being invalidate because project 172fb1c206834acd807390ecc62e655c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:09:19.140295 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8a313183-8640-4974-80ae-3f20d261c9e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:19.140931 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-8a313183-8640-4974-80ae-3f20d261c9e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:09:19.142474 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1353/2703] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:09:18 2022] DELETE /identity/v3/projects/172fb1c206834acd807390ecc62e655c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:09:19.147640 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874c4dd-0e3a-43e0-b7f7-77c2daba939c None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:19.148117 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874c4dd-0e3a-43e0-b7f7-77c2daba939c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:19.148214 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874c4dd-0e3a-43e0-b7f7-77c2daba939c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:19.165190 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-1874c4dd-0e3a-43e0-b7f7-77c2daba939c None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:09:19.166508 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1874c4dd-0e3a-43e0-b7f7-77c2daba939c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:19.224789 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1351/2704] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:09:19.233034 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a7f2e-026d-4132-9e25-6f33f35c1671 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:19.233345 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a7f2e-026d-4132-9e25-6f33f35c1671 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:19.233622 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a7f2e-026d-4132-9e25-6f33f35c1671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:19.252965 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-a10a7f2e-026d-4132-9e25-6f33f35c1671 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:09:19.254177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-a10a7f2e-026d-4132-9e25-6f33f35c1671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:19.263023 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1354/2705] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:09:19.267201 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874c4dd-0e3a-43e0-b7f7-77c2daba939c None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:19.276846 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874c4dd-0e3a-43e0-b7f7-77c2daba939c None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:19.282155 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a8776-72e6-47dd-88e4-2ae34c6442fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:19.282806 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a8776-72e6-47dd-88e4-2ae34c6442fc admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:19.283119 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a8776-72e6-47dd-88e4-2ae34c6442fc admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:19.283395 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a8776-72e6-47dd-88e4-2ae34c6442fc admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:19.284118 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a8776-72e6-47dd-88e4-2ae34c6442fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:09:19.284424 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a8776-72e6-47dd-88e4-2ae34c6442fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:19.286006 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a8776-72e6-47dd-88e4-2ae34c6442fc admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:19.297769 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1352/2706] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:09:19.301888 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a7f2e-026d-4132-9e25-6f33f35c1671 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:19.311303 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a7f2e-026d-4132-9e25-6f33f35c1671 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:19.316085 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452c526-0314-4768-9d0c-19331782780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:19.316733 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452c526-0314-4768-9d0c-19331782780a admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:19.317011 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452c526-0314-4768-9d0c-19331782780a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:19.317290 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452c526-0314-4768-9d0c-19331782780a admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:19.317984 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452c526-0314-4768-9d0c-19331782780a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:19.319910 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452c526-0314-4768-9d0c-19331782780a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:19.397702 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1355/2707] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:09:19 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:09:19.402046 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a8776-72e6-47dd-88e4-2ae34c6442fc admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:19.412208 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a8776-72e6-47dd-88e4-2ae34c6442fc admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:19.466698 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cf523-dc78-4010-98f0-9acdb48ee46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:19.467401 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cf523-dc78-4010-98f0-9acdb48ee46d admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:19.467683 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cf523-dc78-4010-98f0-9acdb48ee46d admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:19.467958 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cf523-dc78-4010-98f0-9acdb48ee46d admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:19.468642 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cf523-dc78-4010-98f0-9acdb48ee46d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:19.470548 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cf523-dc78-4010-98f0-9acdb48ee46d admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:19.579592 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1353/2708] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:09:19 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:09:19.583597 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452c526-0314-4768-9d0c-19331782780a admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:19.594887 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452c526-0314-4768-9d0c-19331782780a admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:19.599645 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b94df-e375-4b86-86b1-1d1531a06438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:19.600309 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b94df-e375-4b86-86b1-1d1531a06438 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:19.600593 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b94df-e375-4b86-86b1-1d1531a06438 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:19.600985 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b94df-e375-4b86-86b1-1d1531a06438 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:19.601730 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b94df-e375-4b86-86b1-1d1531a06438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:19.603364 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b94df-e375-4b86-86b1-1d1531a06438 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:19.614956 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1356/2709] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:09:19.618959 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cf523-dc78-4010-98f0-9acdb48ee46d admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:19.629168 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cf523-dc78-4010-98f0-9acdb48ee46d admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:19.633885 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b733ff-3f8c-41d4-aa21-0365f8858d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:19.634526 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b733ff-3f8c-41d4-aa21-0365f8858d1c admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:19.634808 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b733ff-3f8c-41d4-aa21-0365f8858d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:19.635112 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b733ff-3f8c-41d4-aa21-0365f8858d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:19.635843 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b733ff-3f8c-41d4-aa21-0365f8858d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:19.637824 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b733ff-3f8c-41d4-aa21-0365f8858d1c admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:19.649221 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1354/2710] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:09:19.652442 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b94df-e375-4b86-86b1-1d1531a06438 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:19.663889 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b94df-e375-4b86-86b1-1d1531a06438 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:19.669370 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab534b-0adc-416f-adb7-48d099f84248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:19.670274 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab534b-0adc-416f-adb7-48d099f84248 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:19.670558 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab534b-0adc-416f-adb7-48d099f84248 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:19.672503 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab534b-0adc-416f-adb7-48d099f84248 admin admin] PATH_INFO: `/v3/projects/3f8cd7a4a37c4abfb6a04a953cc69473/users/9b665253400a498cb99d84e4005db96b/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:19.686967 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab534b-0adc-416f-adb7-48d099f84248 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f8cd7a4a37c4abfb6a04a953cc69473, user_id=9b665253400a498cb99d84e4005db96b, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:19.689884 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab534b-0adc-416f-adb7-48d099f84248 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:19.757796 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1357/2711] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:09:19 2022] PUT /identity/v3/projects/3f8cd7a4a37c4abfb6a04a953cc69473/users/9b665253400a498cb99d84e4005db96b/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:09:19.762970 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219bc8c-c750-48eb-8359-1132085a2000 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:19.763432 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219bc8c-c750-48eb-8359-1132085a2000 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:19.763710 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9219bc8c-c750-48eb-8359-1132085a2000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:19.782056 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-9219bc8c-c750-48eb-8359-1132085a2000 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:09:19.783459 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-9219bc8c-c750-48eb-8359-1132085a2000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:19.842163 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1355/2712] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:09:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:09:19.851704 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab534b-0adc-416f-adb7-48d099f84248 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:19.853417 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-4bab534b-0adc-416f-adb7-48d099f84248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:19.908809 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab534b-0adc-416f-adb7-48d099f84248 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:19.913321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da88345-55f3-4a12-b482-e79077a1eb4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:19.913993 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da88345-55f3-4a12-b482-e79077a1eb4d service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:19.914272 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da88345-55f3-4a12-b482-e79077a1eb4d service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:19.914548 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da88345-55f3-4a12-b482-e79077a1eb4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:19.924870 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da88345-55f3-4a12-b482-e79077a1eb4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:19.926295 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da88345-55f3-4a12-b482-e79077a1eb4d service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:19.947382 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1358/2713] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:09:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:09:19.977350 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219bc8c-c750-48eb-8359-1132085a2000 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:19.978998 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-9219bc8c-c750-48eb-8359-1132085a2000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:20.053517 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9219bc8c-c750-48eb-8359-1132085a2000 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:20.059409 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ea53a-f89e-4522-901a-faa39ce8425f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:20.060104 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ea53a-f89e-4522-901a-faa39ce8425f service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:20.064849 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ea53a-f89e-4522-901a-faa39ce8425f service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:20.064849 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ea53a-f89e-4522-901a-faa39ce8425f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:20.064849 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-5f5ea53a-f89e-4522-901a-faa39ce8425f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:20.075519 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ea53a-f89e-4522-901a-faa39ce8425f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:20.077181 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ea53a-f89e-4522-901a-faa39ce8425f service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:20.088734 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1356/2714] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:09:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:09:25.133672 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab601d-22f4-48a6-954d-4b29ef57014e None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:25.134204 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab601d-22f4-48a6-954d-4b29ef57014e None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:25.134204 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab601d-22f4-48a6-954d-4b29ef57014e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:25.163224 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-4bab601d-22f4-48a6-954d-4b29ef57014e None None] MFA Rules not processed for user `9b665253400a498cb99d84e4005db96b`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:09:25.164639 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-4bab601d-22f4-48a6-954d-4b29ef57014e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:25.229991 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1359/2715] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:09:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:09:25.235137 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ea53a-f89e-4522-901a-faa39ce8425f service nova] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:25.246078 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ea53a-f89e-4522-901a-faa39ce8425f service nova] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:25.251428 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d779d6-998f-4e1b-8aea-802eb084a63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:25.252027 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d779d6-998f-4e1b-8aea-802eb084a63d admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:25.252302 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d779d6-998f-4e1b-8aea-802eb084a63d admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:25.252570 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d779d6-998f-4e1b-8aea-802eb084a63d admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:25.253264 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d779d6-998f-4e1b-8aea-802eb084a63d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:25.255237 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d779d6-998f-4e1b-8aea-802eb084a63d admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:25.382372 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1357/2716] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:09:25 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:09:25.386524 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab601d-22f4-48a6-954d-4b29ef57014e None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:25.397333 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab601d-22f4-48a6-954d-4b29ef57014e None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:25.455659 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819e6dc-5187-428d-bf8e-ff89620efc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:25.456321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819e6dc-5187-428d-bf8e-ff89620efc51 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:25.456601 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819e6dc-5187-428d-bf8e-ff89620efc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:25.456876 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a819e6dc-5187-428d-bf8e-ff89620efc51 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:25.457566 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819e6dc-5187-428d-bf8e-ff89620efc51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:25.459499 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a819e6dc-5187-428d-bf8e-ff89620efc51 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:25.562395 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1360/2717] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:09:25 2022] POST /identity/v3/users => generated 299 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:09:25.566362 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d779d6-998f-4e1b-8aea-802eb084a63d admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:25.576616 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d779d6-998f-4e1b-8aea-802eb084a63d admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:25.581182 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e2524-1e2f-42ff-b966-4de2ab5c1d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:25.581824 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e2524-1e2f-42ff-b966-4de2ab5c1d97 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:25.582098 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e2524-1e2f-42ff-b966-4de2ab5c1d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:25.582367 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e2524-1e2f-42ff-b966-4de2ab5c1d97 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:25.583157 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e2524-1e2f-42ff-b966-4de2ab5c1d97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:25.584743 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e2524-1e2f-42ff-b966-4de2ab5c1d97 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:25.595643 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1358/2718] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:09:25.599641 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819e6dc-5187-428d-bf8e-ff89620efc51 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:25.610001 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a819e6dc-5187-428d-bf8e-ff89620efc51 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:25.614810 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49af626-0f44-4603-800c-db85bb5721fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:25.615704 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49af626-0f44-4603-800c-db85bb5721fe admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:25.615984 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49af626-0f44-4603-800c-db85bb5721fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:25.616257 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49af626-0f44-4603-800c-db85bb5721fe admin admin] PATH_INFO: `/v3/projects/b1d6c75db931465b89912dc4dd415506/users/1987ed2d61014112859e64b4f58caca5/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:25.630464 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49af626-0f44-4603-800c-db85bb5721fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1d6c75db931465b89912dc4dd415506, user_id=1987ed2d61014112859e64b4f58caca5, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:25.633118 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49af626-0f44-4603-800c-db85bb5721fe admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:25.706189 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1361/2719] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:09:25 2022] PUT /identity/v3/projects/b1d6c75db931465b89912dc4dd415506/users/1987ed2d61014112859e64b4f58caca5/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:09:25.710173 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e2524-1e2f-42ff-b966-4de2ab5c1d97 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:25.720542 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e2524-1e2f-42ff-b966-4de2ab5c1d97 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:25.774428 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4660c48-38f7-4ee0-95f2-028269cf2782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:25.775164 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4660c48-38f7-4ee0-95f2-028269cf2782 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:25.775439 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4660c48-38f7-4ee0-95f2-028269cf2782 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:25.775712 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4660c48-38f7-4ee0-95f2-028269cf2782 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:25.776437 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4660c48-38f7-4ee0-95f2-028269cf2782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:25.778582 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4660c48-38f7-4ee0-95f2-028269cf2782 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:25.788145 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1359/2720] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:09:25.792310 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49af626-0f44-4603-800c-db85bb5721fe admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:25.802793 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49af626-0f44-4603-800c-db85bb5721fe admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:25.807324 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e6e8d-7cef-4439-8444-901c4763bd25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:25.808190 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e6e8d-7cef-4439-8444-901c4763bd25 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:25.808466 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e6e8d-7cef-4439-8444-901c4763bd25 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:25.808734 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e6e8d-7cef-4439-8444-901c4763bd25 admin admin] PATH_INFO: `/v3/projects/b1d6c75db931465b89912dc4dd415506/users/1987ed2d61014112859e64b4f58caca5/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:25.810653 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e6e8d-7cef-4439-8444-901c4763bd25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1d6c75db931465b89912dc4dd415506, user_id=1987ed2d61014112859e64b4f58caca5, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:25.813350 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e6e8d-7cef-4439-8444-901c4763bd25 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:25.823116 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1362/2721] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:09:25 2022] PUT /identity/v3/projects/b1d6c75db931465b89912dc4dd415506/users/1987ed2d61014112859e64b4f58caca5/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:09:29.516215 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4660c48-38f7-4ee0-95f2-028269cf2782 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:29.518726 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-b4660c48-38f7-4ee0-95f2-028269cf2782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:29.610635 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4660c48-38f7-4ee0-95f2-028269cf2782 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:29.717399 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f8f3d-8725-4d61-80c4-9764b278e7de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:29.720836 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8f3d-8725-4d61-80c4-9764b278e7de service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:29.721126 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8f3d-8725-4d61-80c4-9764b278e7de service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:29.721400 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070f8f3d-8725-4d61-80c4-9764b278e7de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:29.729155 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-070f8f3d-8725-4d61-80c4-9764b278e7de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:29.825080 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f8f3d-8725-4d61-80c4-9764b278e7de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:29.827003 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070f8f3d-8725-4d61-80c4-9764b278e7de service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:29.860317 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1360/2722] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:09:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:09:31.747016 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721ed9b-c35c-4b75-8062-ef6101126516 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:31.747596 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721ed9b-c35c-4b75-8062-ef6101126516 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:31.747596 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f721ed9b-c35c-4b75-8062-ef6101126516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:31.776346 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-f721ed9b-c35c-4b75-8062-ef6101126516 None None] MFA Rules not processed for user `1987ed2d61014112859e64b4f58caca5`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:09:31.778067 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-f721ed9b-c35c-4b75-8062-ef6101126516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:31.845512 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1363/2723] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:09:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:09:31.857793 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f8f3d-8725-4d61-80c4-9764b278e7de service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:31.859265 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-070f8f3d-8725-4d61-80c4-9764b278e7de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:31.915784 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070f8f3d-8725-4d61-80c4-9764b278e7de service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:31.919974 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e641b3e-37db-4350-83c3-a78065d2c9eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2ad9c7f930e426bb908237f72c04a2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:31.920649 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e641b3e-37db-4350-83c3-a78065d2c9eb service glance] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:31.920923 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e641b3e-37db-4350-83c3-a78065d2c9eb service glance] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:31.921191 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e641b3e-37db-4350-83c3-a78065d2c9eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:31.984786 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e641b3e-37db-4350-83c3-a78065d2c9eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:31.986234 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e641b3e-37db-4350-83c3-a78065d2c9eb service glance] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:31.998059 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1361/2724] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:09:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:09:32.238415 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e835e6-209a-4124-a775-8fdd1249822f None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:32.238699 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e835e6-209a-4124-a775-8fdd1249822f None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:32.239012 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e835e6-209a-4124-a775-8fdd1249822f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:32.258076 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-f6e835e6-209a-4124-a775-8fdd1249822f None None] MFA Rules not processed for user `5c7b25e0e29143d783553859a0583d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:09:32.259318 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-f6e835e6-209a-4124-a775-8fdd1249822f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:32.317049 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1364/2725] 10.222.0.24 () {58 vars in 1009 bytes} [Tue Apr 12 00:09:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:09:32.457980 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e641b3e-37db-4350-83c3-a78065d2c9eb service glance] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:32.459433 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-8e641b3e-37db-4350-83c3-a78065d2c9eb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:32.525385 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e641b3e-37db-4350-83c3-a78065d2c9eb service glance] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:32.530767 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40111368-639f-4938-9ceb-3b5575cfeaa5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d616b38304d91bf1c7aded81205e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:32.531428 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40111368-639f-4938-9ceb-3b5575cfeaa5 service swift] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:32.531703 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40111368-639f-4938-9ceb-3b5575cfeaa5 service swift] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:32.531972 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40111368-639f-4938-9ceb-3b5575cfeaa5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:32.540082 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40111368-639f-4938-9ceb-3b5575cfeaa5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:32.541639 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40111368-639f-4938-9ceb-3b5575cfeaa5 service swift] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:32.550304 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1362/2726] 10.222.0.24 () {60 vars in 1384 bytes} [Tue Apr 12 00:09:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:09:36.176951 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e835e6-209a-4124-a775-8fdd1249822f None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:36.179005 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-f6e835e6-209a-4124-a775-8fdd1249822f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:36.324193 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e835e6-209a-4124-a775-8fdd1249822f None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:36.344424 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0323e7-fdb4-4b63-ae2f-ba3cb32dadcc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47515442e0e84441bed4bfbb7a3b4ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:36.345306 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0323e7-fdb4-4b63-ae2f-ba3cb32dadcc service placement] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:36.345589 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0323e7-fdb4-4b63-ae2f-ba3cb32dadcc service placement] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:36.345864 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0323e7-fdb4-4b63-ae2f-ba3cb32dadcc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:36.349218 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-4d0323e7-fdb4-4b63-ae2f-ba3cb32dadcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:36.368102 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0323e7-fdb4-4b63-ae2f-ba3cb32dadcc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:36.371066 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0323e7-fdb4-4b63-ae2f-ba3cb32dadcc service placement] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:36.384441 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1365/2727] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:09:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:09:38.982736 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2ef62-9c13-43f0-a979-da041f51b5cc None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:38.983260 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2ef62-9c13-43f0-a979-da041f51b5cc None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:38.983384 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec2ef62-9c13-43f0-a979-da041f51b5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:39.000108 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-dec2ef62-9c13-43f0-a979-da041f51b5cc None None] MFA Rules not processed for user `666e5f4ec73d46c5834608b1f21a4447`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:09:39.001285 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-dec2ef62-9c13-43f0-a979-da041f51b5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:39.008038 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1363/2728] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:09:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 26 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:09:39.340417 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0323e7-fdb4-4b63-ae2f-ba3cb32dadcc service placement] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:39.342422 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-4d0323e7-fdb4-4b63-ae2f-ba3cb32dadcc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:39.412922 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0323e7-fdb4-4b63-ae2f-ba3cb32dadcc service placement] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:39.416539 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853ede5-b7d2-4acb-acc1-c927dd84fa7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:39.417209 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853ede5-b7d2-4acb-acc1-c927dd84fa7e service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:39.417484 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853ede5-b7d2-4acb-acc1-c927dd84fa7e service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:39.417751 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853ede5-b7d2-4acb-acc1-c927dd84fa7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:39.419564 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-4853ede5-b7d2-4acb-acc1-c927dd84fa7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:39.432268 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853ede5-b7d2-4acb-acc1-c927dd84fa7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:39.434401 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853ede5-b7d2-4acb-acc1-c927dd84fa7e service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:39.442863 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1366/2729] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:09:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:09:43.174645 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b25cb-0de0-4cd6-a9c0-d986a1e02ac9 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:43.175216 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b25cb-0de0-4cd6-a9c0-d986a1e02ac9 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:43.175216 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b25cb-0de0-4cd6-a9c0-d986a1e02ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:43.193728 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-822b25cb-0de0-4cd6-a9c0-d986a1e02ac9 None None] MFA Rules not processed for user `9b665253400a498cb99d84e4005db96b`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:09:43.195089 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-822b25cb-0de0-4cd6-a9c0-d986a1e02ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:43.203290 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1364/2730] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:09:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:09:46.836009 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350908b-c352-4acf-bccf-8c3556134b16 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:46.836467 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350908b-c352-4acf-bccf-8c3556134b16 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:46.836561 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350908b-c352-4acf-bccf-8c3556134b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:46.854051 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-f350908b-c352-4acf-bccf-8c3556134b16 None None] MFA Rules not processed for user `5c7b25e0e29143d783553859a0583d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:09:46.855268 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-f350908b-c352-4acf-bccf-8c3556134b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:09:46.862807 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1367/2731] 10.222.0.24 () {58 vars in 1009 bytes} [Tue Apr 12 00:09:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:09:46.875033 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b25cb-0de0-4cd6-a9c0-d986a1e02ac9 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:09:46.886533 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822b25cb-0de0-4cd6-a9c0-d986a1e02ac9 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:09:46.892055 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dbcb1-130b-4abb-9209-b869604c1860 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d616b38304d91bf1c7aded81205e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:09:46.892692 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dbcb1-130b-4abb-9209-b869604c1860 service swift] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:09:46.892970 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dbcb1-130b-4abb-9209-b869604c1860 service swift] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:09:46.893247 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dbcb1-130b-4abb-9209-b869604c1860 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:09:46.901931 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620dbcb1-130b-4abb-9209-b869604c1860 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:09:46.903602 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620dbcb1-130b-4abb-9209-b869604c1860 service swift] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:09:46.912069 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1365/2732] 10.222.0.24 () {60 vars in 1384 bytes} [Tue Apr 12 00:09:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:10:01.681913 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350908b-c352-4acf-bccf-8c3556134b16 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:10:01.691262 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350908b-c352-4acf-bccf-8c3556134b16 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:10:01.694860 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff7b0c-fc67-4126-8af4-c202a3a9fad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:10:01.695500 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff7b0c-fc67-4126-8af4-c202a3a9fad4 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:10:01.695784 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff7b0c-fc67-4126-8af4-c202a3a9fad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:10:01.696425 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff7b0c-fc67-4126-8af4-c202a3a9fad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:10:01.697957 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-7cff7b0c-fc67-4126-8af4-c202a3a9fad4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:10:01.764242 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff7b0c-fc67-4126-8af4-c202a3a9fad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:10:01.771001 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff7b0c-fc67-4126-8af4-c202a3a9fad4 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:10:01.776445 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1368/2733] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:10:01 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:10:16.039288 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db8c4c-568b-44e6-ad75-5886a8b6eb48 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:10:16.039822 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db8c4c-568b-44e6-ad75-5886a8b6eb48 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:10:16.039923 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db8c4c-568b-44e6-ad75-5886a8b6eb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:10:16.057641 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-42db8c4c-568b-44e6-ad75-5886a8b6eb48 None None] MFA Rules not processed for user `6fcf06e5e37b4ef9a103c81955190362`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:10:16.058865 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-42db8c4c-568b-44e6-ad75-5886a8b6eb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:10:16.112073 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1366/2734] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:10:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:10:21.330420 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff7b0c-fc67-4126-8af4-c202a3a9fad4 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:10:21.339602 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff7b0c-fc67-4126-8af4-c202a3a9fad4 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:10:21.344291 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde75bcb-94e1-4aa8-899d-b5c0a8e183d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:10:21.345277 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde75bcb-94e1-4aa8-899d-b5c0a8e183d9 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:10:21.345553 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde75bcb-94e1-4aa8-899d-b5c0a8e183d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:10:21.345823 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde75bcb-94e1-4aa8-899d-b5c0a8e183d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:10:21.355991 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde75bcb-94e1-4aa8-899d-b5c0a8e183d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:10:21.357435 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde75bcb-94e1-4aa8-899d-b5c0a8e183d9 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:10:21.369124 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1369/2735] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:10:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:11:21.693815 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a85cf-0afe-4151-8876-0abe29c7953a None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:21.694364 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a85cf-0afe-4151-8876-0abe29c7953a None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:21.694364 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a85cf-0afe-4151-8876-0abe29c7953a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:21.711794 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-9a0a85cf-0afe-4151-8876-0abe29c7953a None None] MFA Rules not processed for user `6fcf06e5e37b4ef9a103c81955190362`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:21.712970 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-9a0a85cf-0afe-4151-8876-0abe29c7953a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:21.719905 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1367/2736] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:11:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:11:39.594445 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da907b-3cb7-4293-975e-87c05658d0f4 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:39.594930 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da907b-3cb7-4293-975e-87c05658d0f4 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:39.595058 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da907b-3cb7-4293-975e-87c05658d0f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:39.611902 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-f8da907b-3cb7-4293-975e-87c05658d0f4 None None] MFA Rules not processed for user `5c7b25e0e29143d783553859a0583d6a`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:11:39.613081 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-f8da907b-3cb7-4293-975e-87c05658d0f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:39.620661 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1370/2737] 10.222.0.24 () {58 vars in 967 bytes} [Tue Apr 12 00:11:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:11:39.661580 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a85cf-0afe-4151-8876-0abe29c7953a None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:39.673473 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a85cf-0afe-4151-8876-0abe29c7953a None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:39.678395 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25feaf30-d431-4726-81de-a344890a7a38 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '189d616b38304d91bf1c7aded81205e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:39.679620 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25feaf30-d431-4726-81de-a344890a7a38 service swift] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:39.679620 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25feaf30-d431-4726-81de-a344890a7a38 service swift] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:39.679870 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25feaf30-d431-4726-81de-a344890a7a38 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:39.687594 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25feaf30-d431-4726-81de-a344890a7a38 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:39.689158 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25feaf30-d431-4726-81de-a344890a7a38 service swift] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:39.697537 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1368/2738] 10.222.0.24 () {60 vars in 1384 bytes} [Tue Apr 12 00:11:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Apr 12 00:11:48.344031 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da907b-3cb7-4293-975e-87c05658d0f4 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:48.401024 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da907b-3cb7-4293-975e-87c05658d0f4 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:48.405381 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bb926-67cb-467d-b181-f9d38c581241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:48.406230 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bb926-67cb-467d-b181-f9d38c581241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:48.406509 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bb926-67cb-467d-b181-f9d38c581241 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:48.406780 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176bb926-67cb-467d-b181-f9d38c581241 admin admin] PATH_INFO: `/v3/users/9b665253400a498cb99d84e4005db96b` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:48.407984 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176bb926-67cb-467d-b181-f9d38c581241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b665253400a498cb99d84e4005db96b)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:48.409868 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176bb926-67cb-467d-b181-f9d38c581241 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:48.579785 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-176bb926-67cb-467d-b181-f9d38c581241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b665253400a498cb99d84e4005db96b'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:11:48.635363 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-176bb926-67cb-467d-b181-f9d38c581241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b665253400a498cb99d84e4005db96b'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:11:48.635977 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-176bb926-67cb-467d-b181-f9d38c581241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b665253400a498cb99d84e4005db96b'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:11:48.643352 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-176bb926-67cb-467d-b181-f9d38c581241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b665253400a498cb99d84e4005db96b'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:11:48.659989 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-176bb926-67cb-467d-b181-f9d38c581241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b665253400a498cb99d84e4005db96b'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:11:48.661224 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1371/2739] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:11:48 2022] DELETE /identity/v3/users/9b665253400a498cb99d84e4005db96b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:11:48.888722 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25feaf30-d431-4726-81de-a344890a7a38 service swift] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:48.901548 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25feaf30-d431-4726-81de-a344890a7a38 service swift] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:48.960900 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95381c-ebfa-4a35-9fa7-a43bf58f2c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:48.961749 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95381c-ebfa-4a35-9fa7-a43bf58f2c0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:48.962087 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95381c-ebfa-4a35-9fa7-a43bf58f2c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:48.962410 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95381c-ebfa-4a35-9fa7-a43bf58f2c0d admin admin] PATH_INFO: `/v3/projects/3f8cd7a4a37c4abfb6a04a953cc69473` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:48.963707 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95381c-ebfa-4a35-9fa7-a43bf58f2c0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f8cd7a4a37c4abfb6a04a953cc69473)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:48.965869 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95381c-ebfa-4a35-9fa7-a43bf58f2c0d admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:49.071237 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-1c95381c-ebfa-4a35-9fa7-a43bf58f2c0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f8cd7a4a37c4abfb6a04a953cc69473', 'request_id': 'req-1c95381c-ebfa-4a35-9fa7-a43bf58f2c0d'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:11:49.076516 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-1c95381c-ebfa-4a35-9fa7-a43bf58f2c0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f8cd7a4a37c4abfb6a04a953cc69473', 'request_id': 'req-1c95381c-ebfa-4a35-9fa7-a43bf58f2c0d'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:11:49.155620 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-1c95381c-ebfa-4a35-9fa7-a43bf58f2c0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f8cd7a4a37c4abfb6a04a953cc69473', 'request_id': 'req-1c95381c-ebfa-4a35-9fa7-a43bf58f2c0d'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:11:49.167374 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-1c95381c-ebfa-4a35-9fa7-a43bf58f2c0d admin admin] The token cache is being invalidate because project 3f8cd7a4a37c4abfb6a04a953cc69473 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:11:49.167576 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-1c95381c-ebfa-4a35-9fa7-a43bf58f2c0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:11:49.168208 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-1c95381c-ebfa-4a35-9fa7-a43bf58f2c0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:11:49.169746 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1369/2740] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:11:48 2022] DELETE /identity/v3/projects/3f8cd7a4a37c4abfb6a04a953cc69473 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:11:49.173961 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bb926-67cb-467d-b181-f9d38c581241 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:49.175465 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-176bb926-67cb-467d-b181-f9d38c581241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:49.189357 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176bb926-67cb-467d-b181-f9d38c581241 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:49.255764 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3c29a-0428-4d4d-9fe8-b3a86be42f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:49.256639 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3c29a-0428-4d4d-9fe8-b3a86be42f4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:49.256918 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3c29a-0428-4d4d-9fe8-b3a86be42f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:49.257190 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3c29a-0428-4d4d-9fe8-b3a86be42f4b admin admin] PATH_INFO: `/v3/users/1987ed2d61014112859e64b4f58caca5` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:49.259004 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3c29a-0428-4d4d-9fe8-b3a86be42f4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1987ed2d61014112859e64b4f58caca5)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:49.264362 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3c29a-0428-4d4d-9fe8-b3a86be42f4b admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:49.442614 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ccf3c29a-0428-4d4d-9fe8-b3a86be42f4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1987ed2d61014112859e64b4f58caca5'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:11:49.514572 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ccf3c29a-0428-4d4d-9fe8-b3a86be42f4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1987ed2d61014112859e64b4f58caca5'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:11:49.515213 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ccf3c29a-0428-4d4d-9fe8-b3a86be42f4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1987ed2d61014112859e64b4f58caca5'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:11:49.522270 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ccf3c29a-0428-4d4d-9fe8-b3a86be42f4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1987ed2d61014112859e64b4f58caca5'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:11:49.533556 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-ccf3c29a-0428-4d4d-9fe8-b3a86be42f4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1987ed2d61014112859e64b4f58caca5'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:11:49.539866 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1372/2741] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:11:49 2022] DELETE /identity/v3/users/1987ed2d61014112859e64b4f58caca5 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:11:49.780379 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95381c-ebfa-4a35-9fa7-a43bf58f2c0d admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:49.782008 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-1c95381c-ebfa-4a35-9fa7-a43bf58f2c0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:49.796000 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95381c-ebfa-4a35-9fa7-a43bf58f2c0d admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:49.857557 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3190336-b54b-4630-ac4a-d72831e38abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:49.858719 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3190336-b54b-4630-ac4a-d72831e38abe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:49.859030 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3190336-b54b-4630-ac4a-d72831e38abe admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:49.859302 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3190336-b54b-4630-ac4a-d72831e38abe admin admin] PATH_INFO: `/v3/projects/b1d6c75db931465b89912dc4dd415506` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:49.860477 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3190336-b54b-4630-ac4a-d72831e38abe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1d6c75db931465b89912dc4dd415506)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:49.862347 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3190336-b54b-4630-ac4a-d72831e38abe admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:49.966048 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a3190336-b54b-4630-ac4a-d72831e38abe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1d6c75db931465b89912dc4dd415506', 'request_id': 'req-a3190336-b54b-4630-ac4a-d72831e38abe'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:11:49.971721 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a3190336-b54b-4630-ac4a-d72831e38abe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1d6c75db931465b89912dc4dd415506', 'request_id': 'req-a3190336-b54b-4630-ac4a-d72831e38abe'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:11:50.035297 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a3190336-b54b-4630-ac4a-d72831e38abe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1d6c75db931465b89912dc4dd415506', 'request_id': 'req-a3190336-b54b-4630-ac4a-d72831e38abe'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:11:50.047154 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a3190336-b54b-4630-ac4a-d72831e38abe admin admin] The token cache is being invalidate because project b1d6c75db931465b89912dc4dd415506 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:11:50.047548 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a3190336-b54b-4630-ac4a-d72831e38abe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:11:50.048108 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-a3190336-b54b-4630-ac4a-d72831e38abe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:11:50.049624 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1370/2742] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:11:49 2022] DELETE /identity/v3/projects/b1d6c75db931465b89912dc4dd415506 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:11:50.946925 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3c29a-0428-4d4d-9fe8-b3a86be42f4b admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:50.948590 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ccf3c29a-0428-4d4d-9fe8-b3a86be42f4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:51.011991 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3c29a-0428-4d4d-9fe8-b3a86be42f4b admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:51.073793 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582075f1-7a7f-4235-8c1f-7cdf177bba71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:51.074599 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582075f1-7a7f-4235-8c1f-7cdf177bba71 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:51.074907 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582075f1-7a7f-4235-8c1f-7cdf177bba71 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:51.075366 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582075f1-7a7f-4235-8c1f-7cdf177bba71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:51.077334 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-582075f1-7a7f-4235-8c1f-7cdf177bba71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:51.154082 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582075f1-7a7f-4235-8c1f-7cdf177bba71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:51.155540 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582075f1-7a7f-4235-8c1f-7cdf177bba71 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:51.170590 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1373/2743] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:11:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:11:52.352423 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3190336-b54b-4630-ac4a-d72831e38abe admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:52.353967 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a3190336-b54b-4630-ac4a-d72831e38abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:52.366428 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3190336-b54b-4630-ac4a-d72831e38abe admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:52.370564 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad5307-af24-4832-8e6c-3aaa8da0049e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:52.371223 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad5307-af24-4832-8e6c-3aaa8da0049e service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:52.384816 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad5307-af24-4832-8e6c-3aaa8da0049e service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:52.384816 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad5307-af24-4832-8e6c-3aaa8da0049e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:52.384816 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-72ad5307-af24-4832-8e6c-3aaa8da0049e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:52.386462 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad5307-af24-4832-8e6c-3aaa8da0049e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:52.387896 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad5307-af24-4832-8e6c-3aaa8da0049e service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:52.398622 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1371/2744] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:11:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:11:56.762640 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582075f1-7a7f-4235-8c1f-7cdf177bba71 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:11:56.764947 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-582075f1-7a7f-4235-8c1f-7cdf177bba71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:56.774697 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582075f1-7a7f-4235-8c1f-7cdf177bba71 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:11:56.779085 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a6570-336d-4720-acda-fc6c7a4f28ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:11:56.779704 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a6570-336d-4720-acda-fc6c7a4f28ff service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:11:56.779984 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a6570-336d-4720-acda-fc6c7a4f28ff service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:11:56.780256 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a6570-336d-4720-acda-fc6c7a4f28ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:11:56.782003 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-2b4a6570-336d-4720-acda-fc6c7a4f28ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:11:56.841992 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a6570-336d-4720-acda-fc6c7a4f28ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:11:56.843451 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a6570-336d-4720-acda-fc6c7a4f28ff service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:11:56.852770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1374/2745] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:12:03.984003 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad5307-af24-4832-8e6c-3aaa8da0049e service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:03.985419 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-72ad5307-af24-4832-8e6c-3aaa8da0049e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:03.999496 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad5307-af24-4832-8e6c-3aaa8da0049e service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:04.003937 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d3b7d-71c8-4ae2-b3cf-76bb09407189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:04.004799 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d3b7d-71c8-4ae2-b3cf-76bb09407189 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:04.005126 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d3b7d-71c8-4ae2-b3cf-76bb09407189 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:04.005396 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86d3b7d-71c8-4ae2-b3cf-76bb09407189 admin admin] PATH_INFO: `/v3/users/666e5f4ec73d46c5834608b1f21a4447` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:04.006558 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d3b7d-71c8-4ae2-b3cf-76bb09407189 admin admin] RBAC: Authorizing `identity:delete_user(user_id=666e5f4ec73d46c5834608b1f21a4447)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:04.008472 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86d3b7d-71c8-4ae2-b3cf-76bb09407189 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:04.196419 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-d86d3b7d-71c8-4ae2-b3cf-76bb09407189 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '666e5f4ec73d46c5834608b1f21a4447'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:12:04.203393 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-d86d3b7d-71c8-4ae2-b3cf-76bb09407189 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '666e5f4ec73d46c5834608b1f21a4447'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:12:04.268393 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-d86d3b7d-71c8-4ae2-b3cf-76bb09407189 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '666e5f4ec73d46c5834608b1f21a4447'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:12:04.268989 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-d86d3b7d-71c8-4ae2-b3cf-76bb09407189 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '666e5f4ec73d46c5834608b1f21a4447'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:12:04.280967 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-d86d3b7d-71c8-4ae2-b3cf-76bb09407189 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '666e5f4ec73d46c5834608b1f21a4447'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:12:04.286766 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1372/2746] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:12:03 2022] DELETE /identity/v3/users/666e5f4ec73d46c5834608b1f21a4447 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:12:04.534210 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a6570-336d-4720-acda-fc6c7a4f28ff service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:04.544532 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a6570-336d-4720-acda-fc6c7a4f28ff service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:04.599301 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a773d-ae7c-4b77-9340-ebfa7bc92a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:04.600170 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a773d-ae7c-4b77-9340-ebfa7bc92a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:04.600448 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a773d-ae7c-4b77-9340-ebfa7bc92a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:04.600715 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a773d-ae7c-4b77-9340-ebfa7bc92a2a admin admin] PATH_INFO: `/v3/projects/637e4085dc72453bbd93166c9c6bf935` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:04.601882 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a773d-ae7c-4b77-9340-ebfa7bc92a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=637e4085dc72453bbd93166c9c6bf935)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:04.603860 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a773d-ae7c-4b77-9340-ebfa7bc92a2a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:04.703664 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bd4a773d-ae7c-4b77-9340-ebfa7bc92a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '637e4085dc72453bbd93166c9c6bf935', 'request_id': 'req-bd4a773d-ae7c-4b77-9340-ebfa7bc92a2a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:12:04.760800 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bd4a773d-ae7c-4b77-9340-ebfa7bc92a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '637e4085dc72453bbd93166c9c6bf935', 'request_id': 'req-bd4a773d-ae7c-4b77-9340-ebfa7bc92a2a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:12:04.766500 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bd4a773d-ae7c-4b77-9340-ebfa7bc92a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '637e4085dc72453bbd93166c9c6bf935', 'request_id': 'req-bd4a773d-ae7c-4b77-9340-ebfa7bc92a2a'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:12:04.778269 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bd4a773d-ae7c-4b77-9340-ebfa7bc92a2a admin admin] The token cache is being invalidate because project 637e4085dc72453bbd93166c9c6bf935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:12:04.778672 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bd4a773d-ae7c-4b77-9340-ebfa7bc92a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:12:04.779488 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bd4a773d-ae7c-4b77-9340-ebfa7bc92a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:12:04.781156 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1375/2747] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:12:04 2022] DELETE /identity/v3/projects/637e4085dc72453bbd93166c9c6bf935 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:12:04.785259 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d3b7d-71c8-4ae2-b3cf-76bb09407189 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:04.786678 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-d86d3b7d-71c8-4ae2-b3cf-76bb09407189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:04.800305 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86d3b7d-71c8-4ae2-b3cf-76bb09407189 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:04.853361 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae3619-527e-44f3-953a-d6095e97886e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:04.854223 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae3619-527e-44f3-953a-d6095e97886e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:04.854499 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae3619-527e-44f3-953a-d6095e97886e admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:04.854770 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae3619-527e-44f3-953a-d6095e97886e admin admin] PATH_INFO: `/v3/users/723a1922133c4fb1b5bf90604d0866e7` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:04.856564 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae3619-527e-44f3-953a-d6095e97886e admin admin] RBAC: Authorizing `identity:delete_user(user_id=723a1922133c4fb1b5bf90604d0866e7)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:04.858453 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae3619-527e-44f3-953a-d6095e97886e admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:05.047559 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-f1ae3619-527e-44f3-953a-d6095e97886e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '723a1922133c4fb1b5bf90604d0866e7'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:12:05.054068 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-f1ae3619-527e-44f3-953a-d6095e97886e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '723a1922133c4fb1b5bf90604d0866e7'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:12:05.126403 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-f1ae3619-527e-44f3-953a-d6095e97886e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '723a1922133c4fb1b5bf90604d0866e7'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:12:05.127043 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-f1ae3619-527e-44f3-953a-d6095e97886e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '723a1922133c4fb1b5bf90604d0866e7'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:12:05.139676 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-f1ae3619-527e-44f3-953a-d6095e97886e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '723a1922133c4fb1b5bf90604d0866e7'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:12:05.145615 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1373/2748] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:12:04 2022] DELETE /identity/v3/users/723a1922133c4fb1b5bf90604d0866e7 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:12:05.377698 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a773d-ae7c-4b77-9340-ebfa7bc92a2a admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:05.377698 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-bd4a773d-ae7c-4b77-9340-ebfa7bc92a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:05.391241 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a773d-ae7c-4b77-9340-ebfa7bc92a2a admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:05.446183 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca70d0d-c1ff-488c-9653-21928cb1d422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:05.447066 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca70d0d-c1ff-488c-9653-21928cb1d422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:05.447343 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca70d0d-c1ff-488c-9653-21928cb1d422 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:05.447613 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca70d0d-c1ff-488c-9653-21928cb1d422 admin admin] PATH_INFO: `/v3/projects/4a307e216a4345eb8d909fa2bcbed0cc` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:05.448795 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca70d0d-c1ff-488c-9653-21928cb1d422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a307e216a4345eb8d909fa2bcbed0cc)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:05.452686 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca70d0d-c1ff-488c-9653-21928cb1d422 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:05.542664 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-0ca70d0d-c1ff-488c-9653-21928cb1d422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a307e216a4345eb8d909fa2bcbed0cc', 'request_id': 'req-0ca70d0d-c1ff-488c-9653-21928cb1d422'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:12:05.594024 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-0ca70d0d-c1ff-488c-9653-21928cb1d422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a307e216a4345eb8d909fa2bcbed0cc', 'request_id': 'req-0ca70d0d-c1ff-488c-9653-21928cb1d422'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:12:05.599435 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-0ca70d0d-c1ff-488c-9653-21928cb1d422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a307e216a4345eb8d909fa2bcbed0cc', 'request_id': 'req-0ca70d0d-c1ff-488c-9653-21928cb1d422'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:12:05.609980 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-0ca70d0d-c1ff-488c-9653-21928cb1d422 admin admin] The token cache is being invalidate because project 4a307e216a4345eb8d909fa2bcbed0cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:12:05.610261 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-0ca70d0d-c1ff-488c-9653-21928cb1d422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:12:05.610911 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-0ca70d0d-c1ff-488c-9653-21928cb1d422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:12:05.612433 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1376/2749] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:12:05 2022] DELETE /identity/v3/projects/4a307e216a4345eb8d909fa2bcbed0cc => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:12:26.252161 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae3619-527e-44f3-953a-d6095e97886e admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:26.253685 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-f1ae3619-527e-44f3-953a-d6095e97886e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:26.333192 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae3619-527e-44f3-953a-d6095e97886e admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:26.405787 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be9a71-995a-4282-a6e8-e7b06875d1f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:26.406513 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be9a71-995a-4282-a6e8-e7b06875d1f4 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:26.406809 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be9a71-995a-4282-a6e8-e7b06875d1f4 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:26.407285 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be9a71-995a-4282-a6e8-e7b06875d1f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:26.409757 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-06be9a71-995a-4282-a6e8-e7b06875d1f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:26.422667 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be9a71-995a-4282-a6e8-e7b06875d1f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:26.424382 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be9a71-995a-4282-a6e8-e7b06875d1f4 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:26.439196 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1374/2750] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:12:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:12:31.620230 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74d665-4d4f-4c47-b639-9d20c58e3039 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:31.620767 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74d665-4d4f-4c47-b639-9d20c58e3039 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:31.620767 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e74d665-4d4f-4c47-b639-9d20c58e3039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:31.638062 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-5e74d665-4d4f-4c47-b639-9d20c58e3039 None None] MFA Rules not processed for user `6fcf06e5e37b4ef9a103c81955190362`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:12:31.639359 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-5e74d665-4d4f-4c47-b639-9d20c58e3039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:31.697520 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1377/2751] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:12:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:12:32.374523 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be9a71-995a-4282-a6e8-e7b06875d1f4 service nova] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:32.376049 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-06be9a71-995a-4282-a6e8-e7b06875d1f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:32.444389 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be9a71-995a-4282-a6e8-e7b06875d1f4 service nova] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:32.449246 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f426d-e95c-46b7-8b8a-dc2a72ab3760 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47515442e0e84441bed4bfbb7a3b4ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:32.449881 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f426d-e95c-46b7-8b8a-dc2a72ab3760 service placement] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:32.450156 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f426d-e95c-46b7-8b8a-dc2a72ab3760 service placement] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:32.450426 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f426d-e95c-46b7-8b8a-dc2a72ab3760 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:32.452175 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-309f426d-e95c-46b7-8b8a-dc2a72ab3760 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:32.463640 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f426d-e95c-46b7-8b8a-dc2a72ab3760 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:32.465183 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f426d-e95c-46b7-8b8a-dc2a72ab3760 service placement] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:32.474754 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1375/2752] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:12:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:12:35.261188 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74d665-4d4f-4c47-b639-9d20c58e3039 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:35.262643 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-5e74d665-4d4f-4c47-b639-9d20c58e3039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:35.317327 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e74d665-4d4f-4c47-b639-9d20c58e3039 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:35.320862 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501661d1-ebab-4a8d-a702-c027d2f7b03f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:35.321557 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501661d1-ebab-4a8d-a702-c027d2f7b03f service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:35.321836 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501661d1-ebab-4a8d-a702-c027d2f7b03f service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:35.322106 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501661d1-ebab-4a8d-a702-c027d2f7b03f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:35.323876 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-501661d1-ebab-4a8d-a702-c027d2f7b03f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:35.333235 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501661d1-ebab-4a8d-a702-c027d2f7b03f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:35.334640 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501661d1-ebab-4a8d-a702-c027d2f7b03f service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:35.342598 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1378/2753] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:12:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:12:41.411895 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f426d-e95c-46b7-8b8a-dc2a72ab3760 service placement] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:12:41.413309 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-309f426d-e95c-46b7-8b8a-dc2a72ab3760 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:41.428017 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f426d-e95c-46b7-8b8a-dc2a72ab3760 service placement] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:12:41.433661 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b8d77-f882-45be-99c0-ac9fa1dc11cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:12:41.434242 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b8d77-f882-45be-99c0-ac9fa1dc11cc service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:12:41.434516 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b8d77-f882-45be-99c0-ac9fa1dc11cc service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:12:41.434782 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b8d77-f882-45be-99c0-ac9fa1dc11cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:12:41.436550 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-945b8d77-f882-45be-99c0-ac9fa1dc11cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:12:41.448931 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b8d77-f882-45be-99c0-ac9fa1dc11cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:12:41.450522 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b8d77-f882-45be-99c0-ac9fa1dc11cc service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:12:41.461652 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1376/2754] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:12:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:13:45.744448 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501661d1-ebab-4a8d-a702-c027d2f7b03f service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:45.747094 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-501661d1-ebab-4a8d-a702-c027d2f7b03f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:45.873129 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501661d1-ebab-4a8d-a702-c027d2f7b03f service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:45.877716 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d496b-0d47-482e-9636-56ba8b3607be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:45.878566 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d496b-0d47-482e-9636-56ba8b3607be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:45.878853 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d496b-0d47-482e-9636-56ba8b3607be admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:45.879145 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d496b-0d47-482e-9636-56ba8b3607be admin admin] PATH_INFO: `/v3/users/6fcf06e5e37b4ef9a103c81955190362` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:45.880326 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d496b-0d47-482e-9636-56ba8b3607be admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fcf06e5e37b4ef9a103c81955190362)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:45.882229 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d496b-0d47-482e-9636-56ba8b3607be admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:46.037595 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f19d496b-0d47-482e-9636-56ba8b3607be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fcf06e5e37b4ef9a103c81955190362'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:46.108434 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f19d496b-0d47-482e-9636-56ba8b3607be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fcf06e5e37b4ef9a103c81955190362'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:46.109054 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f19d496b-0d47-482e-9636-56ba8b3607be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fcf06e5e37b4ef9a103c81955190362'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:46.116874 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f19d496b-0d47-482e-9636-56ba8b3607be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fcf06e5e37b4ef9a103c81955190362'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:46.129110 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-f19d496b-0d47-482e-9636-56ba8b3607be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fcf06e5e37b4ef9a103c81955190362'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:46.135001 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1379/2755] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:13:45 2022] DELETE /identity/v3/users/6fcf06e5e37b4ef9a103c81955190362 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:13:46.390307 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b8d77-f882-45be-99c0-ac9fa1dc11cc service nova] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:46.424240 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b8d77-f882-45be-99c0-ac9fa1dc11cc service nova] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:46.479663 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312554c1-8821-4577-8b6c-8afba5574fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:46.480534 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312554c1-8821-4577-8b6c-8afba5574fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:46.480812 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312554c1-8821-4577-8b6c-8afba5574fff admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:46.481096 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312554c1-8821-4577-8b6c-8afba5574fff admin admin] PATH_INFO: `/v3/projects/dffec5ef81d44b04937250eaeeceeac4` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:46.482259 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312554c1-8821-4577-8b6c-8afba5574fff admin admin] RBAC: Authorizing `identity:delete_project(project_id=dffec5ef81d44b04937250eaeeceeac4)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:46.484180 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312554c1-8821-4577-8b6c-8afba5574fff admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:46.581724 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-312554c1-8821-4577-8b6c-8afba5574fff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dffec5ef81d44b04937250eaeeceeac4', 'request_id': 'req-312554c1-8821-4577-8b6c-8afba5574fff'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:46.586851 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-312554c1-8821-4577-8b6c-8afba5574fff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dffec5ef81d44b04937250eaeeceeac4', 'request_id': 'req-312554c1-8821-4577-8b6c-8afba5574fff'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:46.662649 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-312554c1-8821-4577-8b6c-8afba5574fff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dffec5ef81d44b04937250eaeeceeac4', 'request_id': 'req-312554c1-8821-4577-8b6c-8afba5574fff'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:46.673468 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-312554c1-8821-4577-8b6c-8afba5574fff admin admin] The token cache is being invalidate because project dffec5ef81d44b04937250eaeeceeac4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86501) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:13:46.678567 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-312554c1-8821-4577-8b6c-8afba5574fff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:46.678567 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-312554c1-8821-4577-8b6c-8afba5574fff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:46.678567 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1377/2756] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:13:46 2022] DELETE /identity/v3/projects/dffec5ef81d44b04937250eaeeceeac4 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:13:46.680826 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7b80b-96e6-4fa8-926f-9fd578dd2a00 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:46.681106 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7b80b-96e6-4fa8-926f-9fd578dd2a00 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:46.681376 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7b80b-96e6-4fa8-926f-9fd578dd2a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:46.716834 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-b5c7b80b-96e6-4fa8-926f-9fd578dd2a00 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:46.718034 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-b5c7b80b-96e6-4fa8-926f-9fd578dd2a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:46.773917 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1380/2757] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:13:46.781610 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73922678-f6af-463f-8e07-20de21340647 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:46.781897 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73922678-f6af-463f-8e07-20de21340647 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:46.782173 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73922678-f6af-463f-8e07-20de21340647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:46.799910 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-73922678-f6af-463f-8e07-20de21340647 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:46.801083 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-73922678-f6af-463f-8e07-20de21340647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:46.809280 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1378/2758] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:13:46.813247 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7b80b-96e6-4fa8-926f-9fd578dd2a00 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:46.822698 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7b80b-96e6-4fa8-926f-9fd578dd2a00 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:46.827961 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15bcd0-fb9d-4f48-b2b2-34417d0fc40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:46.828634 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15bcd0-fb9d-4f48-b2b2-34417d0fc40f admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:46.828915 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15bcd0-fb9d-4f48-b2b2-34417d0fc40f admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:46.829190 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15bcd0-fb9d-4f48-b2b2-34417d0fc40f admin admin] PATH_INFO: `/v3/domains` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:46.829913 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15bcd0-fb9d-4f48-b2b2-34417d0fc40f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86500) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:46.830218 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15bcd0-fb9d-4f48-b2b2-34417d0fc40f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:46.831831 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15bcd0-fb9d-4f48-b2b2-34417d0fc40f admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:46.843031 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1381/2759] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:13:46.848652 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73922678-f6af-463f-8e07-20de21340647 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:46.858257 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73922678-f6af-463f-8e07-20de21340647 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:46.862815 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4b811-fce6-4441-aeca-8a8405280c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:46.863481 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4b811-fce6-4441-aeca-8a8405280c66 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:46.863758 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4b811-fce6-4441-aeca-8a8405280c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:46.864024 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4b811-fce6-4441-aeca-8a8405280c66 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:46.864707 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4b811-fce6-4441-aeca-8a8405280c66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:46.866821 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4b811-fce6-4441-aeca-8a8405280c66 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:46.943624 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1379/2760] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:13:46 2022] POST /identity/v3/projects => generated 379 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:13:46.947527 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15bcd0-fb9d-4f48-b2b2-34417d0fc40f admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:46.957245 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15bcd0-fb9d-4f48-b2b2-34417d0fc40f admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:47.010539 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f64cc3-977a-4299-8f44-d3d24bfe4959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:47.011193 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f64cc3-977a-4299-8f44-d3d24bfe4959 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:47.011470 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f64cc3-977a-4299-8f44-d3d24bfe4959 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:47.011771 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f64cc3-977a-4299-8f44-d3d24bfe4959 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:47.012444 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f64cc3-977a-4299-8f44-d3d24bfe4959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:47.014317 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f64cc3-977a-4299-8f44-d3d24bfe4959 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:47.108900 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1382/2761] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:13:46 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:13:47.113155 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4b811-fce6-4441-aeca-8a8405280c66 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:47.124495 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4b811-fce6-4441-aeca-8a8405280c66 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:47.129089 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bb7ef-5272-4061-aa16-77a21aa42551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:47.129727 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bb7ef-5272-4061-aa16-77a21aa42551 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:47.130031 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bb7ef-5272-4061-aa16-77a21aa42551 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:47.130299 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5bb7ef-5272-4061-aa16-77a21aa42551 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:47.131067 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bb7ef-5272-4061-aa16-77a21aa42551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:47.132609 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5bb7ef-5272-4061-aa16-77a21aa42551 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:47.142782 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1380/2762] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:13:47.146512 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f64cc3-977a-4299-8f44-d3d24bfe4959 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:47.156245 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f64cc3-977a-4299-8f44-d3d24bfe4959 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:47.160803 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d2a2a-2cbe-4adb-8cbc-fe1ec87fb1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:47.161439 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d2a2a-2cbe-4adb-8cbc-fe1ec87fb1bf admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:47.161722 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d2a2a-2cbe-4adb-8cbc-fe1ec87fb1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:47.161997 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d2a2a-2cbe-4adb-8cbc-fe1ec87fb1bf admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:47.162745 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d2a2a-2cbe-4adb-8cbc-fe1ec87fb1bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:47.164362 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d2a2a-2cbe-4adb-8cbc-fe1ec87fb1bf admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:47.174397 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1383/2763] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:13:47.178170 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bb7ef-5272-4061-aa16-77a21aa42551 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:47.188623 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5bb7ef-5272-4061-aa16-77a21aa42551 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:47.193293 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33075da2-f84c-402c-b645-d7944acba3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:47.194205 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33075da2-f84c-402c-b645-d7944acba3d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:47.194433 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33075da2-f84c-402c-b645-d7944acba3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:47.194702 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33075da2-f84c-402c-b645-d7944acba3d8 admin admin] PATH_INFO: `/v3/projects/30b0c085d3494b9787249935deefe91a/users/d9dee635b7264b18ac54d06ee73991e2/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:47.208664 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33075da2-f84c-402c-b645-d7944acba3d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30b0c085d3494b9787249935deefe91a, user_id=d9dee635b7264b18ac54d06ee73991e2, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:47.211342 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33075da2-f84c-402c-b645-d7944acba3d8 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:47.280451 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1381/2764] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:13:47 2022] PUT /identity/v3/projects/30b0c085d3494b9787249935deefe91a/users/d9dee635b7264b18ac54d06ee73991e2/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:13:47.291416 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab239ef-f910-4c60-820f-5cedd8cbc6be None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:47.291708 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab239ef-f910-4c60-820f-5cedd8cbc6be None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:47.291988 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab239ef-f910-4c60-820f-5cedd8cbc6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:47.318136 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-fab239ef-f910-4c60-820f-5cedd8cbc6be None None] MFA Rules not processed for user `d9dee635b7264b18ac54d06ee73991e2`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:47.319375 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-fab239ef-f910-4c60-820f-5cedd8cbc6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:47.381351 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1384/2765] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:13:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:13:47.385797 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33075da2-f84c-402c-b645-d7944acba3d8 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:47.444793 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33075da2-f84c-402c-b645-d7944acba3d8 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:47.449616 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4079acf-f68f-46f7-af56-dc2f4f0752a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:47.450264 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4079acf-f68f-46f7-af56-dc2f4f0752a7 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:47.450539 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4079acf-f68f-46f7-af56-dc2f4f0752a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:47.450808 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4079acf-f68f-46f7-af56-dc2f4f0752a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:47.451523 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4079acf-f68f-46f7-af56-dc2f4f0752a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:47.453396 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4079acf-f68f-46f7-af56-dc2f4f0752a7 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:47.561467 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1382/2766] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:13:47 2022] POST /identity/v3/projects => generated 379 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:13:47.565491 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab239ef-f910-4c60-820f-5cedd8cbc6be None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:47.576365 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab239ef-f910-4c60-820f-5cedd8cbc6be None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:47.630963 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73801e5-09a1-4221-ba0c-c3ec617a0b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:47.631621 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73801e5-09a1-4221-ba0c-c3ec617a0b30 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:47.631905 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73801e5-09a1-4221-ba0c-c3ec617a0b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:47.632180 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73801e5-09a1-4221-ba0c-c3ec617a0b30 admin admin] PATH_INFO: `/v3/users` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:47.632866 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73801e5-09a1-4221-ba0c-c3ec617a0b30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:47.634768 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73801e5-09a1-4221-ba0c-c3ec617a0b30 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:47.720419 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1385/2767] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:13:47 2022] POST /identity/v3/users => generated 296 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:13:47.724354 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4079acf-f68f-46f7-af56-dc2f4f0752a7 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:47.734541 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4079acf-f68f-46f7-af56-dc2f4f0752a7 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:47.739215 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ea955-082d-4765-9fef-46171a907e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:47.739864 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ea955-082d-4765-9fef-46171a907e2b admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:47.740147 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ea955-082d-4765-9fef-46171a907e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:47.740420 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ea955-082d-4765-9fef-46171a907e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:47.741409 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ea955-082d-4765-9fef-46171a907e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:47.743013 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2ea955-082d-4765-9fef-46171a907e2b admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:47.753176 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1383/2768] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:13:47.757209 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73801e5-09a1-4221-ba0c-c3ec617a0b30 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:47.767557 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73801e5-09a1-4221-ba0c-c3ec617a0b30 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:47.772196 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843deed4-e263-4132-8634-e8776cb3b08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:47.773063 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843deed4-e263-4132-8634-e8776cb3b08f admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:47.773342 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843deed4-e263-4132-8634-e8776cb3b08f admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:47.773613 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843deed4-e263-4132-8634-e8776cb3b08f admin admin] PATH_INFO: `/v3/projects/6fdfc4dc397d41ac80af3d15e5763f4a/users/e76474bff4d54a1ea19d1841ead7f3c3/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:47.788439 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843deed4-e263-4132-8634-e8776cb3b08f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fdfc4dc397d41ac80af3d15e5763f4a, user_id=e76474bff4d54a1ea19d1841ead7f3c3, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:47.791091 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843deed4-e263-4132-8634-e8776cb3b08f admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:47.865787 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1386/2769] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:13:47 2022] PUT /identity/v3/projects/6fdfc4dc397d41ac80af3d15e5763f4a/users/e76474bff4d54a1ea19d1841ead7f3c3/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:13:47.869956 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ea955-082d-4765-9fef-46171a907e2b admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:47.880050 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2ea955-082d-4765-9fef-46171a907e2b admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:47.933367 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d4aca-0229-432a-af30-f4a52fff0d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:47.934042 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d4aca-0229-432a-af30-f4a52fff0d7f admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:47.934320 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d4aca-0229-432a-af30-f4a52fff0d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:47.934590 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d4aca-0229-432a-af30-f4a52fff0d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:47.935340 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d4aca-0229-432a-af30-f4a52fff0d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:47.936936 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d4aca-0229-432a-af30-f4a52fff0d7f admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:47.946272 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1384/2770] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:13:47 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:13:47.950907 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843deed4-e263-4132-8634-e8776cb3b08f admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:47.961062 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843deed4-e263-4132-8634-e8776cb3b08f admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:47.966370 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e6b82-317e-4b40-89a2-50316a745f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:47.967259 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e6b82-317e-4b40-89a2-50316a745f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:47.967539 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e6b82-317e-4b40-89a2-50316a745f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:47.967814 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e6b82-317e-4b40-89a2-50316a745f3b admin admin] PATH_INFO: `/v3/projects/6fdfc4dc397d41ac80af3d15e5763f4a/users/e76474bff4d54a1ea19d1841ead7f3c3/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:47.969785 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e6b82-317e-4b40-89a2-50316a745f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fdfc4dc397d41ac80af3d15e5763f4a, user_id=e76474bff4d54a1ea19d1841ead7f3c3, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:47.972492 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e6b82-317e-4b40-89a2-50316a745f3b admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:47.982409 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1387/2771] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:13:47 2022] PUT /identity/v3/projects/6fdfc4dc397d41ac80af3d15e5763f4a/users/e76474bff4d54a1ea19d1841ead7f3c3/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:13:47.997522 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cca16f-bfa0-49e3-88db-bf443cdc2c59 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:47.997809 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cca16f-bfa0-49e3-88db-bf443cdc2c59 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:47.998084 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cca16f-bfa0-49e3-88db-bf443cdc2c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:48.025203 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-b0cca16f-bfa0-49e3-88db-bf443cdc2c59 None None] MFA Rules not processed for user `e76474bff4d54a1ea19d1841ead7f3c3`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:48.026427 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-b0cca16f-bfa0-49e3-88db-bf443cdc2c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:48.091459 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1385/2772] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:13:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:13:48.101916 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e6b82-317e-4b40-89a2-50316a745f3b admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:48.107805 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-566e6b82-317e-4b40-89a2-50316a745f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:48.178008 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e6b82-317e-4b40-89a2-50316a745f3b admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:48.181731 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d5af2-5e7b-4ab9-836d-2ac9c0885e78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:48.182361 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d5af2-5e7b-4ab9-836d-2ac9c0885e78 service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:48.182644 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d5af2-5e7b-4ab9-836d-2ac9c0885e78 service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:48.182947 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d5af2-5e7b-4ab9-836d-2ac9c0885e78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:48.192258 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d5af2-5e7b-4ab9-836d-2ac9c0885e78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:48.193677 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d5af2-5e7b-4ab9-836d-2ac9c0885e78 service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:48.203637 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1388/2773] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:13:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:13:48.853887 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cca16f-bfa0-49e3-88db-bf443cdc2c59 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:48.914374 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cca16f-bfa0-49e3-88db-bf443cdc2c59 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:48.919470 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834f431-0dae-4911-a4dc-f3507fc9754f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:48.920325 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834f431-0dae-4911-a4dc-f3507fc9754f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:48.920602 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834f431-0dae-4911-a4dc-f3507fc9754f admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:48.920870 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7834f431-0dae-4911-a4dc-f3507fc9754f admin admin] PATH_INFO: `/v3/users/d9dee635b7264b18ac54d06ee73991e2` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:48.922040 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834f431-0dae-4911-a4dc-f3507fc9754f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9dee635b7264b18ac54d06ee73991e2)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:48.923970 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7834f431-0dae-4911-a4dc-f3507fc9754f admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:49.081291 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-7834f431-0dae-4911-a4dc-f3507fc9754f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9dee635b7264b18ac54d06ee73991e2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:49.087911 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-7834f431-0dae-4911-a4dc-f3507fc9754f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9dee635b7264b18ac54d06ee73991e2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:49.171577 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-7834f431-0dae-4911-a4dc-f3507fc9754f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9dee635b7264b18ac54d06ee73991e2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:49.172318 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-7834f431-0dae-4911-a4dc-f3507fc9754f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9dee635b7264b18ac54d06ee73991e2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:49.187915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-7834f431-0dae-4911-a4dc-f3507fc9754f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9dee635b7264b18ac54d06ee73991e2'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:49.193952 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1386/2774] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:13:48 2022] DELETE /identity/v3/users/d9dee635b7264b18ac54d06ee73991e2 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:13:49.198341 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55b14e-7ba2-4484-a398-ff0d623bddf6 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:49.198819 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55b14e-7ba2-4484-a398-ff0d623bddf6 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:49.198950 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55b14e-7ba2-4484-a398-ff0d623bddf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:49.216482 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-5c55b14e-7ba2-4484-a398-ff0d623bddf6 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:49.217698 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-5c55b14e-7ba2-4484-a398-ff0d623bddf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:49.273664 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1389/2775] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:13:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:13:49.283946 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834f431-0dae-4911-a4dc-f3507fc9754f admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:49.285531 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-7834f431-0dae-4911-a4dc-f3507fc9754f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:49.360417 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7834f431-0dae-4911-a4dc-f3507fc9754f admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:49.363979 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd52d2-e909-4870-b8a0-e73c0730983b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:49.364605 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd52d2-e909-4870-b8a0-e73c0730983b service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:49.364879 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd52d2-e909-4870-b8a0-e73c0730983b service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:49.365165 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd52d2-e909-4870-b8a0-e73c0730983b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:49.374111 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd52d2-e909-4870-b8a0-e73c0730983b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:49.375544 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd52d2-e909-4870-b8a0-e73c0730983b service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:49.384529 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1387/2776] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:13:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:13:49.788143 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55b14e-7ba2-4484-a398-ff0d623bddf6 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:49.789578 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-5c55b14e-7ba2-4484-a398-ff0d623bddf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:49.801416 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55b14e-7ba2-4484-a398-ff0d623bddf6 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:49.806120 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bb7cd-908a-41d2-ac95-2a6cdee770b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:49.806995 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bb7cd-908a-41d2-ac95-2a6cdee770b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:49.807272 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bb7cd-908a-41d2-ac95-2a6cdee770b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:49.807544 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bb7cd-908a-41d2-ac95-2a6cdee770b9 admin admin] PATH_INFO: `/v3/projects/30b0c085d3494b9787249935deefe91a` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:49.809242 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bb7cd-908a-41d2-ac95-2a6cdee770b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30b0c085d3494b9787249935deefe91a)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:49.811151 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3bb7cd-908a-41d2-ac95-2a6cdee770b9 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:49.911782 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bd3bb7cd-908a-41d2-ac95-2a6cdee770b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30b0c085d3494b9787249935deefe91a', 'request_id': 'req-bd3bb7cd-908a-41d2-ac95-2a6cdee770b9'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:49.982668 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bd3bb7cd-908a-41d2-ac95-2a6cdee770b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30b0c085d3494b9787249935deefe91a', 'request_id': 'req-bd3bb7cd-908a-41d2-ac95-2a6cdee770b9'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:49.988071 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bd3bb7cd-908a-41d2-ac95-2a6cdee770b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30b0c085d3494b9787249935deefe91a', 'request_id': 'req-bd3bb7cd-908a-41d2-ac95-2a6cdee770b9'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:49.999796 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bd3bb7cd-908a-41d2-ac95-2a6cdee770b9 admin admin] The token cache is being invalidate because project 30b0c085d3494b9787249935deefe91a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:13:50.000084 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bd3bb7cd-908a-41d2-ac95-2a6cdee770b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:50.000696 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bd3bb7cd-908a-41d2-ac95-2a6cdee770b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:50.002202 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1390/2777] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:13:49 2022] DELETE /identity/v3/projects/30b0c085d3494b9787249935deefe91a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:13:50.006400 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd52d2-e909-4870-b8a0-e73c0730983b service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:50.016027 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd52d2-e909-4870-b8a0-e73c0730983b service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:50.069407 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a028e-c317-4d19-9624-aba35a827452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:50.070255 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a028e-c317-4d19-9624-aba35a827452 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:50.070528 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a028e-c317-4d19-9624-aba35a827452 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:50.070793 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a028e-c317-4d19-9624-aba35a827452 admin admin] PATH_INFO: `/v3/users/e76474bff4d54a1ea19d1841ead7f3c3` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:50.072043 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a028e-c317-4d19-9624-aba35a827452 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e76474bff4d54a1ea19d1841ead7f3c3)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:50.073927 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a028e-c317-4d19-9624-aba35a827452 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:50.287658 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-976a028e-c317-4d19-9624-aba35a827452 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e76474bff4d54a1ea19d1841ead7f3c3'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:50.294747 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-976a028e-c317-4d19-9624-aba35a827452 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e76474bff4d54a1ea19d1841ead7f3c3'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:50.374857 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-976a028e-c317-4d19-9624-aba35a827452 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e76474bff4d54a1ea19d1841ead7f3c3'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:50.375468 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-976a028e-c317-4d19-9624-aba35a827452 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e76474bff4d54a1ea19d1841ead7f3c3'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:50.387719 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-976a028e-c317-4d19-9624-aba35a827452 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e76474bff4d54a1ea19d1841ead7f3c3'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:50.393561 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1388/2778] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:13:50 2022] DELETE /identity/v3/users/e76474bff4d54a1ea19d1841ead7f3c3 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:13:50.819297 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bb7cd-908a-41d2-ac95-2a6cdee770b9 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:50.820849 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-bd3bb7cd-908a-41d2-ac95-2a6cdee770b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:50.834229 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bb7cd-908a-41d2-ac95-2a6cdee770b9 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:50.892101 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497008c-993f-4c00-8e14-eaae81776446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:50.892945 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497008c-993f-4c00-8e14-eaae81776446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:50.893226 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497008c-993f-4c00-8e14-eaae81776446 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:50.893500 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497008c-993f-4c00-8e14-eaae81776446 admin admin] PATH_INFO: `/v3/projects/6fdfc4dc397d41ac80af3d15e5763f4a` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:50.894675 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497008c-993f-4c00-8e14-eaae81776446 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fdfc4dc397d41ac80af3d15e5763f4a)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:50.896594 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497008c-993f-4c00-8e14-eaae81776446 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:51.005354 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4497008c-993f-4c00-8e14-eaae81776446 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fdfc4dc397d41ac80af3d15e5763f4a', 'request_id': 'req-4497008c-993f-4c00-8e14-eaae81776446'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:51.068702 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4497008c-993f-4c00-8e14-eaae81776446 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fdfc4dc397d41ac80af3d15e5763f4a', 'request_id': 'req-4497008c-993f-4c00-8e14-eaae81776446'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:51.074726 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4497008c-993f-4c00-8e14-eaae81776446 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fdfc4dc397d41ac80af3d15e5763f4a', 'request_id': 'req-4497008c-993f-4c00-8e14-eaae81776446'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:51.085657 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4497008c-993f-4c00-8e14-eaae81776446 admin admin] The token cache is being invalidate because project 6fdfc4dc397d41ac80af3d15e5763f4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:13:51.085935 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4497008c-993f-4c00-8e14-eaae81776446 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:51.086552 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-4497008c-993f-4c00-8e14-eaae81776446 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:13:51.088071 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1391/2779] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:13:50 2022] DELETE /identity/v3/projects/6fdfc4dc397d41ac80af3d15e5763f4a => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:13:51.093373 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fded2c8-4d61-4c6d-9994-400c10970d88 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:51.093844 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fded2c8-4d61-4c6d-9994-400c10970d88 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:51.093940 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fded2c8-4d61-4c6d-9994-400c10970d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:51.132160 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-9fded2c8-4d61-4c6d-9994-400c10970d88 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:51.133351 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-9fded2c8-4d61-4c6d-9994-400c10970d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:51.189315 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1389/2780] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:13:51.197105 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859a439-ad28-440f-989e-123f9a5bc955 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:51.197388 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859a439-ad28-440f-989e-123f9a5bc955 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:51.197661 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859a439-ad28-440f-989e-123f9a5bc955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:51.216037 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-4859a439-ad28-440f-989e-123f9a5bc955 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:51.217244 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-4859a439-ad28-440f-989e-123f9a5bc955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:51.225404 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1392/2781] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:13:51.229669 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fded2c8-4d61-4c6d-9994-400c10970d88 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:51.240016 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fded2c8-4d61-4c6d-9994-400c10970d88 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:51.244966 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a94a61-d36d-4ce5-9843-8d38cc0e25f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:51.245621 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a94a61-d36d-4ce5-9843-8d38cc0e25f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:51.245982 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a94a61-d36d-4ce5-9843-8d38cc0e25f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:51.246451 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a94a61-d36d-4ce5-9843-8d38cc0e25f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:51.247662 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a94a61-d36d-4ce5-9843-8d38cc0e25f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:13:51.248105 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a94a61-d36d-4ce5-9843-8d38cc0e25f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:51.249834 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a94a61-d36d-4ce5-9843-8d38cc0e25f8 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:51.262230 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1390/2782] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Apr 12 00:13:51.266563 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859a439-ad28-440f-989e-123f9a5bc955 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:51.275995 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859a439-ad28-440f-989e-123f9a5bc955 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:51.281294 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24703d-239e-49d2-be87-b12ac09732fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:51.281930 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24703d-239e-49d2-be87-b12ac09732fe admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:51.282204 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24703d-239e-49d2-be87-b12ac09732fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:51.282471 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca24703d-239e-49d2-be87-b12ac09732fe admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:51.283199 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24703d-239e-49d2-be87-b12ac09732fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:51.285057 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca24703d-239e-49d2-be87-b12ac09732fe admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:51.372391 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1393/2783] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:13:51 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:13:51.376456 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a94a61-d36d-4ce5-9843-8d38cc0e25f8 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:51.386134 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a94a61-d36d-4ce5-9843-8d38cc0e25f8 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:51.439190 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76d340-3617-4618-9997-acd99885527b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:51.439854 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76d340-3617-4618-9997-acd99885527b admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:51.440132 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76d340-3617-4618-9997-acd99885527b admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:51.440402 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae76d340-3617-4618-9997-acd99885527b admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:51.441093 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76d340-3617-4618-9997-acd99885527b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:51.443054 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae76d340-3617-4618-9997-acd99885527b admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:51.552604 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1391/2784] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:13:51 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:13:51.556669 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24703d-239e-49d2-be87-b12ac09732fe admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:51.566783 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca24703d-239e-49d2-be87-b12ac09732fe admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:51.571427 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae620c-06c7-4421-97d8-cc1735adc91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:51.572066 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae620c-06c7-4421-97d8-cc1735adc91a admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:51.572340 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae620c-06c7-4421-97d8-cc1735adc91a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:51.572608 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ae620c-06c7-4421-97d8-cc1735adc91a admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:51.573573 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae620c-06c7-4421-97d8-cc1735adc91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:51.575704 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ae620c-06c7-4421-97d8-cc1735adc91a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:51.586188 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1394/2785] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:13:51.590458 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76d340-3617-4618-9997-acd99885527b admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:51.599967 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae76d340-3617-4618-9997-acd99885527b admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:51.604462 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ea3c4-4db0-4475-a42c-fafa3c815bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:51.605094 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ea3c4-4db0-4475-a42c-fafa3c815bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:51.605398 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ea3c4-4db0-4475-a42c-fafa3c815bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:51.605667 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ea3c4-4db0-4475-a42c-fafa3c815bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:51.606379 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ea3c4-4db0-4475-a42c-fafa3c815bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:51.607966 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ea3c4-4db0-4475-a42c-fafa3c815bf2 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:51.618971 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1392/2786] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:13:51.622957 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae620c-06c7-4421-97d8-cc1735adc91a admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:51.632784 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ae620c-06c7-4421-97d8-cc1735adc91a admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:51.637838 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77f029-bba4-47b6-b687-739ceb2d5755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:51.638698 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77f029-bba4-47b6-b687-739ceb2d5755 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:51.639006 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77f029-bba4-47b6-b687-739ceb2d5755 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:51.639278 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77f029-bba4-47b6-b687-739ceb2d5755 admin admin] PATH_INFO: `/v3/projects/bf2512481f46444290a4abff2462f35c/users/fbbe6ab8e7a047ec8b74bdbc5d95cffc/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:51.653940 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77f029-bba4-47b6-b687-739ceb2d5755 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf2512481f46444290a4abff2462f35c, user_id=fbbe6ab8e7a047ec8b74bdbc5d95cffc, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:51.656598 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77f029-bba4-47b6-b687-739ceb2d5755 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:51.731762 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1395/2787] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:13:51 2022] PUT /identity/v3/projects/bf2512481f46444290a4abff2462f35c/users/fbbe6ab8e7a047ec8b74bdbc5d95cffc/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:13:51.737084 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256038d-24e7-4518-b21d-0f3afb446094 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:51.737375 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256038d-24e7-4518-b21d-0f3afb446094 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:51.737651 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256038d-24e7-4518-b21d-0f3afb446094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:51.756730 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-c256038d-24e7-4518-b21d-0f3afb446094 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:51.757928 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-c256038d-24e7-4518-b21d-0f3afb446094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:51.819742 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1393/2788] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:13:51.830224 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77f029-bba4-47b6-b687-739ceb2d5755 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:51.831962 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ff77f029-bba4-47b6-b687-739ceb2d5755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:51.893026 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77f029-bba4-47b6-b687-739ceb2d5755 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:51.896529 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db4e47-1aaf-4202-b90b-039f979cd767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:51.897165 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db4e47-1aaf-4202-b90b-039f979cd767 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:51.897444 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db4e47-1aaf-4202-b90b-039f979cd767 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:51.897715 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db4e47-1aaf-4202-b90b-039f979cd767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:51.908568 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db4e47-1aaf-4202-b90b-039f979cd767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:51.909992 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79db4e47-1aaf-4202-b90b-039f979cd767 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:51.919602 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1396/2789] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:13:53.139747 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60efada-1ffa-4e96-8546-973ddf67ea6c None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:53.140313 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60efada-1ffa-4e96-8546-973ddf67ea6c None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:53.140313 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60efada-1ffa-4e96-8546-973ddf67ea6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:53.166179 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-e60efada-1ffa-4e96-8546-973ddf67ea6c None None] MFA Rules not processed for user `fbbe6ab8e7a047ec8b74bdbc5d95cffc`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:53.167408 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-e60efada-1ffa-4e96-8546-973ddf67ea6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:53.234384 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1394/2790] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:13:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Apr 12 00:13:53.235575 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db4e47-1aaf-4202-b90b-039f979cd767 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:53.245440 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db4e47-1aaf-4202-b90b-039f979cd767 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:53.250419 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95f61a-97ef-4a55-bec2-fb562812a4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:53.251091 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95f61a-97ef-4a55-bec2-fb562812a4bf admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:53.251367 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95f61a-97ef-4a55-bec2-fb562812a4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:53.251635 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95f61a-97ef-4a55-bec2-fb562812a4bf admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:53.252319 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b95f61a-97ef-4a55-bec2-fb562812a4bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:53.254177 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b95f61a-97ef-4a55-bec2-fb562812a4bf admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:53.339089 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1397/2791] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:13:53 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:13:53.343725 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60efada-1ffa-4e96-8546-973ddf67ea6c None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:53.354564 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60efada-1ffa-4e96-8546-973ddf67ea6c None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:53.408082 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b75be-2da8-4c85-9260-83024bf6074d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:53.408734 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b75be-2da8-4c85-9260-83024bf6074d admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:53.409008 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b75be-2da8-4c85-9260-83024bf6074d admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:53.409275 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b75be-2da8-4c85-9260-83024bf6074d admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:53.409954 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b75be-2da8-4c85-9260-83024bf6074d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:53.411862 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b75be-2da8-4c85-9260-83024bf6074d admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:53.486863 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1395/2792] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:13:53 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:13:53.491266 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95f61a-97ef-4a55-bec2-fb562812a4bf admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:53.501512 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95f61a-97ef-4a55-bec2-fb562812a4bf admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:53.506039 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e8eb8-4a5c-4753-b899-3508c49a5920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:53.506681 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e8eb8-4a5c-4753-b899-3508c49a5920 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:53.507010 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e8eb8-4a5c-4753-b899-3508c49a5920 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:53.507282 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e8eb8-4a5c-4753-b899-3508c49a5920 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:53.507998 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e8eb8-4a5c-4753-b899-3508c49a5920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:53.509674 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e8eb8-4a5c-4753-b899-3508c49a5920 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:53.519945 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1398/2793] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:13:53.523827 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b75be-2da8-4c85-9260-83024bf6074d admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:53.533900 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b75be-2da8-4c85-9260-83024bf6074d admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:53.538466 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c708f-8758-4c83-9892-512e35aea88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:53.539351 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c708f-8758-4c83-9892-512e35aea88c admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:53.539626 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c708f-8758-4c83-9892-512e35aea88c admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:53.539898 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c708f-8758-4c83-9892-512e35aea88c admin admin] PATH_INFO: `/v3/projects/2f9916cefc444500afc11488878938e7/users/c789e53a216445a28d027c09a04e6459/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:53.554469 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c708f-8758-4c83-9892-512e35aea88c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9916cefc444500afc11488878938e7, user_id=c789e53a216445a28d027c09a04e6459, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:53.557122 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c708f-8758-4c83-9892-512e35aea88c admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:53.666232 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1396/2794] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:13:53 2022] PUT /identity/v3/projects/2f9916cefc444500afc11488878938e7/users/c789e53a216445a28d027c09a04e6459/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:13:53.670264 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e8eb8-4a5c-4753-b899-3508c49a5920 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:53.680368 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e8eb8-4a5c-4753-b899-3508c49a5920 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:53.733054 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa79962-fc93-4d22-be93-c922c2e2d767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:53.733695 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa79962-fc93-4d22-be93-c922c2e2d767 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:53.733969 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa79962-fc93-4d22-be93-c922c2e2d767 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:53.734238 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa79962-fc93-4d22-be93-c922c2e2d767 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:53.734979 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa79962-fc93-4d22-be93-c922c2e2d767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:53.736544 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa79962-fc93-4d22-be93-c922c2e2d767 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:53.745920 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1399/2795] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:13:53 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:13:53.750088 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c708f-8758-4c83-9892-512e35aea88c admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:53.760539 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c708f-8758-4c83-9892-512e35aea88c admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:53.765757 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad5ce5-f3ba-4ff3-9b62-23247e7f5f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:53.766629 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad5ce5-f3ba-4ff3-9b62-23247e7f5f57 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:53.766928 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad5ce5-f3ba-4ff3-9b62-23247e7f5f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:53.767324 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad5ce5-f3ba-4ff3-9b62-23247e7f5f57 admin admin] PATH_INFO: `/v3/projects/2f9916cefc444500afc11488878938e7/users/c789e53a216445a28d027c09a04e6459/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:53.769282 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad5ce5-f3ba-4ff3-9b62-23247e7f5f57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f9916cefc444500afc11488878938e7, user_id=c789e53a216445a28d027c09a04e6459, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:53.771945 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ad5ce5-f3ba-4ff3-9b62-23247e7f5f57 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:53.782736 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1397/2796] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:13:53 2022] PUT /identity/v3/projects/2f9916cefc444500afc11488878938e7/users/c789e53a216445a28d027c09a04e6459/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:13:55.092266 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96013d21-7cb7-4863-b77b-5442dcc76ab5 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:55.092773 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96013d21-7cb7-4863-b77b-5442dcc76ab5 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:55.092868 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96013d21-7cb7-4863-b77b-5442dcc76ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:55.119746 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-96013d21-7cb7-4863-b77b-5442dcc76ab5 None None] MFA Rules not processed for user `c789e53a216445a28d027c09a04e6459`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:13:55.121009 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-96013d21-7cb7-4863-b77b-5442dcc76ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:55.199420 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1400/2797] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:13:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:13:55.210431 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad5ce5-f3ba-4ff3-9b62-23247e7f5f57 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:55.212160 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a8ad5ce5-f3ba-4ff3-9b62-23247e7f5f57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:55.268672 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad5ce5-f3ba-4ff3-9b62-23247e7f5f57 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:55.272160 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319634ac-2433-479e-af22-c232e27ddbc6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:55.272792 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319634ac-2433-479e-af22-c232e27ddbc6 service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:55.273070 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319634ac-2433-479e-af22-c232e27ddbc6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:55.273339 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319634ac-2433-479e-af22-c232e27ddbc6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:55.327297 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319634ac-2433-479e-af22-c232e27ddbc6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:55.328722 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319634ac-2433-479e-af22-c232e27ddbc6 service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:55.337566 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1398/2798] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:13:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:13:57.027795 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96013d21-7cb7-4863-b77b-5442dcc76ab5 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:13:57.029701 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-96013d21-7cb7-4863-b77b-5442dcc76ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:13:57.041584 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96013d21-7cb7-4863-b77b-5442dcc76ab5 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:13:57.045812 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5e6f5-f511-4192-b94a-7e99d43a7d15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:13:57.046478 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5e6f5-f511-4192-b94a-7e99d43a7d15 service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:13:57.046759 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5e6f5-f511-4192-b94a-7e99d43a7d15 service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:13:57.047065 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5e6f5-f511-4192-b94a-7e99d43a7d15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:13:57.056247 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5e6f5-f511-4192-b94a-7e99d43a7d15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:13:57.061663 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5e6f5-f511-4192-b94a-7e99d43a7d15 service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:13:57.067331 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1401/2799] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:13:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:14:12.246953 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319634ac-2433-479e-af22-c232e27ddbc6 service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:12.307096 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319634ac-2433-479e-af22-c232e27ddbc6 service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:12.311613 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7cb50-d495-44a0-9c8f-ffba55af60bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:12.312459 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7cb50-d495-44a0-9c8f-ffba55af60bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:12.312761 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7cb50-d495-44a0-9c8f-ffba55af60bb admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:12.313031 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7cb50-d495-44a0-9c8f-ffba55af60bb admin admin] PATH_INFO: `/v3/users/fbbe6ab8e7a047ec8b74bdbc5d95cffc` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:12.314187 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7cb50-d495-44a0-9c8f-ffba55af60bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbbe6ab8e7a047ec8b74bdbc5d95cffc)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:12.316172 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7cb50-d495-44a0-9c8f-ffba55af60bb admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:12.492634 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-28e7cb50-d495-44a0-9c8f-ffba55af60bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbbe6ab8e7a047ec8b74bdbc5d95cffc'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:12.499441 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-28e7cb50-d495-44a0-9c8f-ffba55af60bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbbe6ab8e7a047ec8b74bdbc5d95cffc'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:12.571374 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-28e7cb50-d495-44a0-9c8f-ffba55af60bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbbe6ab8e7a047ec8b74bdbc5d95cffc'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:12.571972 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-28e7cb50-d495-44a0-9c8f-ffba55af60bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbbe6ab8e7a047ec8b74bdbc5d95cffc'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:12.584191 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-28e7cb50-d495-44a0-9c8f-ffba55af60bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbbe6ab8e7a047ec8b74bdbc5d95cffc'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:12.590000 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1399/2800] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:14:12 2022] DELETE /identity/v3/users/fbbe6ab8e7a047ec8b74bdbc5d95cffc => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:14:12.807667 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5e6f5-f511-4192-b94a-7e99d43a7d15 service cinder] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:12.819368 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5e6f5-f511-4192-b94a-7e99d43a7d15 service cinder] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:12.873067 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f931a0-29d9-4382-b627-36cb62220274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:12.873916 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f931a0-29d9-4382-b627-36cb62220274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:12.874197 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f931a0-29d9-4382-b627-36cb62220274 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:12.874472 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f931a0-29d9-4382-b627-36cb62220274 admin admin] PATH_INFO: `/v3/projects/bf2512481f46444290a4abff2462f35c` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:12.876185 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f931a0-29d9-4382-b627-36cb62220274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf2512481f46444290a4abff2462f35c)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:12.878080 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f931a0-29d9-4382-b627-36cb62220274 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:12.979674 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-61f931a0-29d9-4382-b627-36cb62220274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf2512481f46444290a4abff2462f35c', 'request_id': 'req-61f931a0-29d9-4382-b627-36cb62220274'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:13.056925 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-61f931a0-29d9-4382-b627-36cb62220274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf2512481f46444290a4abff2462f35c', 'request_id': 'req-61f931a0-29d9-4382-b627-36cb62220274'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:13.062334 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-61f931a0-29d9-4382-b627-36cb62220274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf2512481f46444290a4abff2462f35c', 'request_id': 'req-61f931a0-29d9-4382-b627-36cb62220274'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:13.073925 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-61f931a0-29d9-4382-b627-36cb62220274 admin admin] The token cache is being invalidate because project bf2512481f46444290a4abff2462f35c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:14:13.074222 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-61f931a0-29d9-4382-b627-36cb62220274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:13.074858 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-61f931a0-29d9-4382-b627-36cb62220274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:13.076408 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1402/2801] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:14:12 2022] DELETE /identity/v3/projects/bf2512481f46444290a4abff2462f35c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:14:13.080622 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7cb50-d495-44a0-9c8f-ffba55af60bb admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:13.082006 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-28e7cb50-d495-44a0-9c8f-ffba55af60bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:13.094662 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7cb50-d495-44a0-9c8f-ffba55af60bb admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:13.148758 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798eb827-22a0-4851-a074-c28aa9dee4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:13.149614 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798eb827-22a0-4851-a074-c28aa9dee4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:13.149895 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798eb827-22a0-4851-a074-c28aa9dee4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:13.150170 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798eb827-22a0-4851-a074-c28aa9dee4e0 admin admin] PATH_INFO: `/v3/users/c789e53a216445a28d027c09a04e6459` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:13.151370 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798eb827-22a0-4851-a074-c28aa9dee4e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c789e53a216445a28d027c09a04e6459)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:13.153284 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798eb827-22a0-4851-a074-c28aa9dee4e0 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:13.372905 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-798eb827-22a0-4851-a074-c28aa9dee4e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c789e53a216445a28d027c09a04e6459'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:13.379453 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-798eb827-22a0-4851-a074-c28aa9dee4e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c789e53a216445a28d027c09a04e6459'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:13.456617 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-798eb827-22a0-4851-a074-c28aa9dee4e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c789e53a216445a28d027c09a04e6459'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:13.457232 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-798eb827-22a0-4851-a074-c28aa9dee4e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c789e53a216445a28d027c09a04e6459'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:13.468804 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-798eb827-22a0-4851-a074-c28aa9dee4e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c789e53a216445a28d027c09a04e6459'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:13.475193 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1400/2802] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:14:13 2022] DELETE /identity/v3/users/c789e53a216445a28d027c09a04e6459 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:14:13.728398 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f931a0-29d9-4382-b627-36cb62220274 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:13.728398 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-61f931a0-29d9-4382-b627-36cb62220274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:13.739359 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f931a0-29d9-4382-b627-36cb62220274 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:13.795876 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51919b-594b-4e15-9a72-c9900687a671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:13.796732 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51919b-594b-4e15-9a72-c9900687a671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:13.797016 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51919b-594b-4e15-9a72-c9900687a671 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:13.797292 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51919b-594b-4e15-9a72-c9900687a671 admin admin] PATH_INFO: `/v3/projects/2f9916cefc444500afc11488878938e7` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:13.798480 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51919b-594b-4e15-9a72-c9900687a671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f9916cefc444500afc11488878938e7)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:13.800443 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51919b-594b-4e15-9a72-c9900687a671 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:13.902266 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-fd51919b-594b-4e15-9a72-c9900687a671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f9916cefc444500afc11488878938e7', 'request_id': 'req-fd51919b-594b-4e15-9a72-c9900687a671'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:13.985915 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-fd51919b-594b-4e15-9a72-c9900687a671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f9916cefc444500afc11488878938e7', 'request_id': 'req-fd51919b-594b-4e15-9a72-c9900687a671'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:13.991971 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-fd51919b-594b-4e15-9a72-c9900687a671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f9916cefc444500afc11488878938e7', 'request_id': 'req-fd51919b-594b-4e15-9a72-c9900687a671'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:14.003855 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-fd51919b-594b-4e15-9a72-c9900687a671 admin admin] The token cache is being invalidate because project 2f9916cefc444500afc11488878938e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:14:14.008640 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-fd51919b-594b-4e15-9a72-c9900687a671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:14.008640 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-fd51919b-594b-4e15-9a72-c9900687a671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:14.008640 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1403/2803] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:14:13 2022] DELETE /identity/v3/projects/2f9916cefc444500afc11488878938e7 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:14:14.011456 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa61dbd-8f66-4314-bbef-030d125dc51d None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:14.011747 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa61dbd-8f66-4314-bbef-030d125dc51d None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:14.012025 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa61dbd-8f66-4314-bbef-030d125dc51d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:14.029128 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-caa61dbd-8f66-4314-bbef-030d125dc51d None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:14.034106 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-caa61dbd-8f66-4314-bbef-030d125dc51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:14.086896 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1401/2804] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:14:14.095532 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcda7c-32b0-4ee7-9eb1-2a09374f000a None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:14.096328 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcda7c-32b0-4ee7-9eb1-2a09374f000a None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:14.096607 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcda7c-32b0-4ee7-9eb1-2a09374f000a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:14.115554 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-4cfcda7c-32b0-4ee7-9eb1-2a09374f000a None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:14.117587 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-4cfcda7c-32b0-4ee7-9eb1-2a09374f000a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:14.125543 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1404/2805] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:14:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:14:14.129636 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa61dbd-8f66-4314-bbef-030d125dc51d None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:14.139110 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa61dbd-8f66-4314-bbef-030d125dc51d None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:14.143691 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e365a7-2bb4-4c73-a152-ce74a0dba29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:14.144331 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e365a7-2bb4-4c73-a152-ce74a0dba29d admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:14.144612 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e365a7-2bb4-4c73-a152-ce74a0dba29d admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:14.144886 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e365a7-2bb4-4c73-a152-ce74a0dba29d admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:14.145612 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e365a7-2bb4-4c73-a152-ce74a0dba29d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:14:14.145915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e365a7-2bb4-4c73-a152-ce74a0dba29d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:14.147526 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e365a7-2bb4-4c73-a152-ce74a0dba29d admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:14.159304 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1402/2806] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:14.163337 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcda7c-32b0-4ee7-9eb1-2a09374f000a None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:14.172318 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcda7c-32b0-4ee7-9eb1-2a09374f000a None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:14.177505 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f711578-cb36-41d4-a043-a6fe7503ad95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:14.178140 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f711578-cb36-41d4-a043-a6fe7503ad95 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:14.178421 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f711578-cb36-41d4-a043-a6fe7503ad95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:14.178696 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f711578-cb36-41d4-a043-a6fe7503ad95 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:14.179431 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f711578-cb36-41d4-a043-a6fe7503ad95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:14.181306 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f711578-cb36-41d4-a043-a6fe7503ad95 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:14.272386 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1405/2807] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:14:14 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:14:14.276562 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e365a7-2bb4-4c73-a152-ce74a0dba29d admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:14.286996 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e365a7-2bb4-4c73-a152-ce74a0dba29d admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:14.340237 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6764db-1555-4637-9b75-9dbda8e83b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:14.340889 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6764db-1555-4637-9b75-9dbda8e83b86 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:14.341166 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6764db-1555-4637-9b75-9dbda8e83b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:14.341436 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6764db-1555-4637-9b75-9dbda8e83b86 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:14.342120 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6764db-1555-4637-9b75-9dbda8e83b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:14.344037 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6764db-1555-4637-9b75-9dbda8e83b86 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:14.419947 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1403/2808] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:14:14 2022] POST /identity/v3/users => generated 286 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:14:14.423946 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f711578-cb36-41d4-a043-a6fe7503ad95 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:14.434784 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f711578-cb36-41d4-a043-a6fe7503ad95 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:14.439468 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77531e8-f55f-4444-99f7-033dea5da71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:14.440108 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77531e8-f55f-4444-99f7-033dea5da71c admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:14.440387 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77531e8-f55f-4444-99f7-033dea5da71c admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:14.440668 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77531e8-f55f-4444-99f7-033dea5da71c admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:14.441394 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77531e8-f55f-4444-99f7-033dea5da71c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:14.443009 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77531e8-f55f-4444-99f7-033dea5da71c admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:14.453090 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1406/2809] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:14:14.457364 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6764db-1555-4637-9b75-9dbda8e83b86 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:14.467045 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6764db-1555-4637-9b75-9dbda8e83b86 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:14.472128 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0cf885-223c-4324-a454-2a689014cfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:14.472761 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cf885-223c-4324-a454-2a689014cfe1 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:14.473037 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cf885-223c-4324-a454-2a689014cfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:14.473309 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0cf885-223c-4324-a454-2a689014cfe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:14.474015 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0cf885-223c-4324-a454-2a689014cfe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:14.475607 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0cf885-223c-4324-a454-2a689014cfe1 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:14.485028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1404/2810] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:14:14.488822 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77531e8-f55f-4444-99f7-033dea5da71c admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:14.498688 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77531e8-f55f-4444-99f7-033dea5da71c admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:14.503239 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f921cc0-f254-446b-9338-e9a6bff6090e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:14.504091 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f921cc0-f254-446b-9338-e9a6bff6090e admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:14.504370 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f921cc0-f254-446b-9338-e9a6bff6090e admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:14.504643 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f921cc0-f254-446b-9338-e9a6bff6090e admin admin] PATH_INFO: `/v3/projects/e31e407feebd441aad0a8b7b9e2de243/users/d0302195136745179d0a03a900a27bd9/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:14.518947 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f921cc0-f254-446b-9338-e9a6bff6090e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e31e407feebd441aad0a8b7b9e2de243, user_id=d0302195136745179d0a03a900a27bd9, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:14.521556 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f921cc0-f254-446b-9338-e9a6bff6090e admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:14.592144 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1407/2811] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:14:14 2022] PUT /identity/v3/projects/e31e407feebd441aad0a8b7b9e2de243/users/d0302195136745179d0a03a900a27bd9/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:14:14.602971 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341991d5-c555-427d-9f64-c25f7106ab97 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:14.603261 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341991d5-c555-427d-9f64-c25f7106ab97 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:14.603811 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341991d5-c555-427d-9f64-c25f7106ab97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:14.630915 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-341991d5-c555-427d-9f64-c25f7106ab97 None None] MFA Rules not processed for user `d0302195136745179d0a03a900a27bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:14.632112 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-341991d5-c555-427d-9f64-c25f7106ab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:14.692605 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1405/2812] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:14:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:14:14.703640 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f921cc0-f254-446b-9338-e9a6bff6090e admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:14.705811 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-6f921cc0-f254-446b-9338-e9a6bff6090e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:14.761275 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f921cc0-f254-446b-9338-e9a6bff6090e admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:14.764884 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d43f4c-c192-4768-a7a5-34ed69e691ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:14.765529 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d43f4c-c192-4768-a7a5-34ed69e691ad service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:14.765808 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d43f4c-c192-4768-a7a5-34ed69e691ad service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:14.766079 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d43f4c-c192-4768-a7a5-34ed69e691ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:14.775419 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d43f4c-c192-4768-a7a5-34ed69e691ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:14.776838 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d43f4c-c192-4768-a7a5-34ed69e691ad service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:14.786097 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1408/2813] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:14:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:14:14.805104 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341991d5-c555-427d-9f64-c25f7106ab97 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:14.868889 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341991d5-c555-427d-9f64-c25f7106ab97 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:14.873405 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe645b2-78ab-402f-84be-9098929a0b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:14.874263 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe645b2-78ab-402f-84be-9098929a0b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:14.874537 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe645b2-78ab-402f-84be-9098929a0b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:14.874805 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe645b2-78ab-402f-84be-9098929a0b72 admin admin] PATH_INFO: `/v3/users/d0302195136745179d0a03a900a27bd9` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:14.876014 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe645b2-78ab-402f-84be-9098929a0b72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0302195136745179d0a03a900a27bd9)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:14.878467 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe645b2-78ab-402f-84be-9098929a0b72 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:15.098374 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-9fe645b2-78ab-402f-84be-9098929a0b72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0302195136745179d0a03a900a27bd9'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:15.104945 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-9fe645b2-78ab-402f-84be-9098929a0b72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0302195136745179d0a03a900a27bd9'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:15.188267 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-9fe645b2-78ab-402f-84be-9098929a0b72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0302195136745179d0a03a900a27bd9'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:15.188854 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-9fe645b2-78ab-402f-84be-9098929a0b72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0302195136745179d0a03a900a27bd9'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:15.205905 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-9fe645b2-78ab-402f-84be-9098929a0b72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0302195136745179d0a03a900a27bd9'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:15.212957 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1406/2814] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:14:14 2022] DELETE /identity/v3/users/d0302195136745179d0a03a900a27bd9 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:14:15.218716 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb00c74-1312-45fa-a84e-72bfd414826c None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:15.219238 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb00c74-1312-45fa-a84e-72bfd414826c None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:15.219355 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb00c74-1312-45fa-a84e-72bfd414826c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:15.238717 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-ecb00c74-1312-45fa-a84e-72bfd414826c None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:15.239955 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ecb00c74-1312-45fa-a84e-72bfd414826c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:15.295768 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1409/2815] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:14:15.305651 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe645b2-78ab-402f-84be-9098929a0b72 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:15.307056 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-9fe645b2-78ab-402f-84be-9098929a0b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:15.363940 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe645b2-78ab-402f-84be-9098929a0b72 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:15.367876 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5825d110-4257-4d44-8896-2130b91ba117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:15.368545 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825d110-4257-4d44-8896-2130b91ba117 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:15.368826 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825d110-4257-4d44-8896-2130b91ba117 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:15.369102 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5825d110-4257-4d44-8896-2130b91ba117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:15.378700 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825d110-4257-4d44-8896-2130b91ba117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:15.382657 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5825d110-4257-4d44-8896-2130b91ba117 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:15.390108 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1407/2816] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:14:16.011683 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb00c74-1312-45fa-a84e-72bfd414826c None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:16.013221 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ecb00c74-1312-45fa-a84e-72bfd414826c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:16.025389 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb00c74-1312-45fa-a84e-72bfd414826c None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:16.030268 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8d445-3e93-4195-a4bc-10787ba2078b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:16.031085 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8d445-3e93-4195-a4bc-10787ba2078b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:16.031425 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8d445-3e93-4195-a4bc-10787ba2078b admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:16.031607 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8d445-3e93-4195-a4bc-10787ba2078b admin admin] PATH_INFO: `/v3/projects/e31e407feebd441aad0a8b7b9e2de243` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:16.032803 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8d445-3e93-4195-a4bc-10787ba2078b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e31e407feebd441aad0a8b7b9e2de243)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:16.034728 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8d445-3e93-4195-a4bc-10787ba2078b admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:16.163104 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bfa8d445-3e93-4195-a4bc-10787ba2078b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e31e407feebd441aad0a8b7b9e2de243', 'request_id': 'req-bfa8d445-3e93-4195-a4bc-10787ba2078b'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:16.232069 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bfa8d445-3e93-4195-a4bc-10787ba2078b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e31e407feebd441aad0a8b7b9e2de243', 'request_id': 'req-bfa8d445-3e93-4195-a4bc-10787ba2078b'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:16.238372 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bfa8d445-3e93-4195-a4bc-10787ba2078b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e31e407feebd441aad0a8b7b9e2de243', 'request_id': 'req-bfa8d445-3e93-4195-a4bc-10787ba2078b'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:16.249381 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bfa8d445-3e93-4195-a4bc-10787ba2078b admin admin] The token cache is being invalidate because project e31e407feebd441aad0a8b7b9e2de243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:14:16.249663 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bfa8d445-3e93-4195-a4bc-10787ba2078b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:16.250286 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-bfa8d445-3e93-4195-a4bc-10787ba2078b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:16.251850 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1410/2817] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:14:16 2022] DELETE /identity/v3/projects/e31e407feebd441aad0a8b7b9e2de243 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:14:16.257168 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2dc00-8fe6-4955-be12-e5419861345a None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:16.257605 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2dc00-8fe6-4955-be12-e5419861345a None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:16.257699 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2dc00-8fe6-4955-be12-e5419861345a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:16.274792 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-21f2dc00-8fe6-4955-be12-e5419861345a None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:16.276072 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-21f2dc00-8fe6-4955-be12-e5419861345a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:16.332577 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1408/2818] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:14:16.340598 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140110f-9f49-4ac4-befd-db2e6087fc99 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:16.340897 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140110f-9f49-4ac4-befd-db2e6087fc99 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:16.341172 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d140110f-9f49-4ac4-befd-db2e6087fc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:16.359382 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-d140110f-9f49-4ac4-befd-db2e6087fc99 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:16.360553 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d140110f-9f49-4ac4-befd-db2e6087fc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:16.369039 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1411/2819] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:14:16.373207 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2dc00-8fe6-4955-be12-e5419861345a None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:16.382710 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2dc00-8fe6-4955-be12-e5419861345a None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:16.387278 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3b64b-1316-4e70-a4f5-360d8f5959d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:16.387918 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3b64b-1316-4e70-a4f5-360d8f5959d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:16.388197 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3b64b-1316-4e70-a4f5-360d8f5959d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:16.388470 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3b64b-1316-4e70-a4f5-360d8f5959d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:16.389187 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3b64b-1316-4e70-a4f5-360d8f5959d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:14:16.389495 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3b64b-1316-4e70-a4f5-360d8f5959d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:16.391100 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3b64b-1316-4e70-a4f5-360d8f5959d8 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:16.402103 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1409/2820] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:16.406210 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140110f-9f49-4ac4-befd-db2e6087fc99 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:16.415672 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d140110f-9f49-4ac4-befd-db2e6087fc99 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:16.420210 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0bb33-0e5e-4113-9086-0604998d6772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:16.420845 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0bb33-0e5e-4113-9086-0604998d6772 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:16.421121 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0bb33-0e5e-4113-9086-0604998d6772 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:16.421394 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b0bb33-0e5e-4113-9086-0604998d6772 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:16.422074 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0bb33-0e5e-4113-9086-0604998d6772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:16.424111 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b0bb33-0e5e-4113-9086-0604998d6772 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:16.538242 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1412/2821] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:14:16 2022] POST /identity/v3/projects => generated 381 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:14:16.542453 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3b64b-1316-4e70-a4f5-360d8f5959d8 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:16.552951 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3b64b-1316-4e70-a4f5-360d8f5959d8 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:16.606638 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92c160-c5cb-4b9d-a4bd-45ea4072b061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:16.607332 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92c160-c5cb-4b9d-a4bd-45ea4072b061 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:16.607612 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92c160-c5cb-4b9d-a4bd-45ea4072b061 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:16.607886 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92c160-c5cb-4b9d-a4bd-45ea4072b061 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:16.608572 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92c160-c5cb-4b9d-a4bd-45ea4072b061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:16.610458 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92c160-c5cb-4b9d-a4bd-45ea4072b061 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:16.680458 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1410/2822] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:14:16 2022] POST /identity/v3/users => generated 291 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:14:16.684549 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0bb33-0e5e-4113-9086-0604998d6772 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:16.694993 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b0bb33-0e5e-4113-9086-0604998d6772 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:16.699546 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff787a-9c6a-46ac-bd61-b038de436f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:16.700186 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff787a-9c6a-46ac-bd61-b038de436f96 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:16.700463 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff787a-9c6a-46ac-bd61-b038de436f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:16.700741 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff787a-9c6a-46ac-bd61-b038de436f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:16.701519 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff787a-9c6a-46ac-bd61-b038de436f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:16.703168 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ff787a-9c6a-46ac-bd61-b038de436f96 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:16.713715 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1413/2823] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:14:16.717560 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92c160-c5cb-4b9d-a4bd-45ea4072b061 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:16.728081 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92c160-c5cb-4b9d-a4bd-45ea4072b061 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:16.732683 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8e7a1-bad6-4748-8a1e-bdf8059351ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:16.733322 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e7a1-bad6-4748-8a1e-bdf8059351ae admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:16.733600 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e7a1-bad6-4748-8a1e-bdf8059351ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:16.733873 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e7a1-bad6-4748-8a1e-bdf8059351ae admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:16.734622 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8e7a1-bad6-4748-8a1e-bdf8059351ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:16.736263 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8e7a1-bad6-4748-8a1e-bdf8059351ae admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:16.746346 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1411/2824] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Apr 12 00:14:16.750166 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff787a-9c6a-46ac-bd61-b038de436f96 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:16.759856 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ff787a-9c6a-46ac-bd61-b038de436f96 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:16.764380 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5832f4-c472-4dca-b6de-d6796609761a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:16.765267 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5832f4-c472-4dca-b6de-d6796609761a admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:16.765541 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5832f4-c472-4dca-b6de-d6796609761a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:16.765808 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5832f4-c472-4dca-b6de-d6796609761a admin admin] PATH_INFO: `/v3/projects/818c7f89d2634a368401e384f70f8a2b/users/996a0812bb7e4d37a7c4b4f8c59ee9e3/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:16.780227 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5832f4-c472-4dca-b6de-d6796609761a admin admin] RBAC: Authorizing `identity:create_grant(project_id=818c7f89d2634a368401e384f70f8a2b, user_id=996a0812bb7e4d37a7c4b4f8c59ee9e3, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:16.782813 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5832f4-c472-4dca-b6de-d6796609761a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:16.856127 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1414/2825] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:14:16 2022] PUT /identity/v3/projects/818c7f89d2634a368401e384f70f8a2b/users/996a0812bb7e4d37a7c4b4f8c59ee9e3/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:14:16.867231 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e30d8b-92e7-4cba-8985-cc2c780c8abf None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:16.867521 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e30d8b-92e7-4cba-8985-cc2c780c8abf None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:16.867792 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e30d8b-92e7-4cba-8985-cc2c780c8abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:16.893629 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-a9e30d8b-92e7-4cba-8985-cc2c780c8abf None None] MFA Rules not processed for user `996a0812bb7e4d37a7c4b4f8c59ee9e3`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:16.894814 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a9e30d8b-92e7-4cba-8985-cc2c780c8abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:16.954216 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1412/2826] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:14:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:14:16.965076 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5832f4-c472-4dca-b6de-d6796609761a admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:16.966719 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-ff5832f4-c472-4dca-b6de-d6796609761a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:17.040566 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5832f4-c472-4dca-b6de-d6796609761a admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:17.044202 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b95df-adc3-4898-a9da-6a107ba479e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:17.044829 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b95df-adc3-4898-a9da-6a107ba479e3 service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:17.045103 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b95df-adc3-4898-a9da-6a107ba479e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:17.045372 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b95df-adc3-4898-a9da-6a107ba479e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:17.054039 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b95df-adc3-4898-a9da-6a107ba479e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:17.055503 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b95df-adc3-4898-a9da-6a107ba479e3 service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:17.064043 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1415/2827] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:14:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:14:26.894346 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e30d8b-92e7-4cba-8985-cc2c780c8abf None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:26.952785 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e30d8b-92e7-4cba-8985-cc2c780c8abf None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:26.957786 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7ffc6-2ca0-4454-9d89-db769c9b8cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:26.958645 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7ffc6-2ca0-4454-9d89-db769c9b8cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:26.958946 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7ffc6-2ca0-4454-9d89-db769c9b8cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:26.959215 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7ffc6-2ca0-4454-9d89-db769c9b8cc7 admin admin] PATH_INFO: `/v3/users/996a0812bb7e4d37a7c4b4f8c59ee9e3` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:26.960390 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7ffc6-2ca0-4454-9d89-db769c9b8cc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=996a0812bb7e4d37a7c4b4f8c59ee9e3)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:26.962278 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7ffc6-2ca0-4454-9d89-db769c9b8cc7 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:27.166126 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-06d7ffc6-2ca0-4454-9d89-db769c9b8cc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '996a0812bb7e4d37a7c4b4f8c59ee9e3'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:27.172559 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-06d7ffc6-2ca0-4454-9d89-db769c9b8cc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '996a0812bb7e4d37a7c4b4f8c59ee9e3'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:27.271740 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-06d7ffc6-2ca0-4454-9d89-db769c9b8cc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '996a0812bb7e4d37a7c4b4f8c59ee9e3'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:27.272345 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-06d7ffc6-2ca0-4454-9d89-db769c9b8cc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '996a0812bb7e4d37a7c4b4f8c59ee9e3'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:27.284451 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-06d7ffc6-2ca0-4454-9d89-db769c9b8cc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '996a0812bb7e4d37a7c4b4f8c59ee9e3'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:27.290365 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1413/2828] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:14:26 2022] DELETE /identity/v3/users/996a0812bb7e4d37a7c4b4f8c59ee9e3 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:14:27.294885 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cc279-c02d-40dc-a2a1-f4dc723a5341 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:27.295373 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cc279-c02d-40dc-a2a1-f4dc723a5341 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:27.295488 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cc279-c02d-40dc-a2a1-f4dc723a5341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:27.312388 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-af9cc279-c02d-40dc-a2a1-f4dc723a5341 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:27.313579 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-af9cc279-c02d-40dc-a2a1-f4dc723a5341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:27.370083 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1416/2829] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:14:27.379424 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7ffc6-2ca0-4454-9d89-db769c9b8cc7 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:27.380806 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-06d7ffc6-2ca0-4454-9d89-db769c9b8cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:27.434607 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7ffc6-2ca0-4454-9d89-db769c9b8cc7 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:27.438118 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87776974-cca1-4499-8f1f-403b3e4afcf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:27.438751 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87776974-cca1-4499-8f1f-403b3e4afcf1 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:27.439058 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87776974-cca1-4499-8f1f-403b3e4afcf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:27.439328 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87776974-cca1-4499-8f1f-403b3e4afcf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:27.448329 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87776974-cca1-4499-8f1f-403b3e4afcf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:27.449744 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87776974-cca1-4499-8f1f-403b3e4afcf1 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:27.459459 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1414/2830] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:14:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:14:27.827524 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cc279-c02d-40dc-a2a1-f4dc723a5341 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:27.828931 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-af9cc279-c02d-40dc-a2a1-f4dc723a5341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:27.841435 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cc279-c02d-40dc-a2a1-f4dc723a5341 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:27.846631 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095f6d2e-7463-48bf-a103-b0281c8ac5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:27.847537 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f6d2e-7463-48bf-a103-b0281c8ac5b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:27.847819 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f6d2e-7463-48bf-a103-b0281c8ac5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:27.848094 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f6d2e-7463-48bf-a103-b0281c8ac5b7 admin admin] PATH_INFO: `/v3/projects/818c7f89d2634a368401e384f70f8a2b` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:27.849290 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f6d2e-7463-48bf-a103-b0281c8ac5b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=818c7f89d2634a368401e384f70f8a2b)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:27.851280 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095f6d2e-7463-48bf-a103-b0281c8ac5b7 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:27.958296 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-095f6d2e-7463-48bf-a103-b0281c8ac5b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818c7f89d2634a368401e384f70f8a2b', 'request_id': 'req-095f6d2e-7463-48bf-a103-b0281c8ac5b7'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:28.043098 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-095f6d2e-7463-48bf-a103-b0281c8ac5b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818c7f89d2634a368401e384f70f8a2b', 'request_id': 'req-095f6d2e-7463-48bf-a103-b0281c8ac5b7'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:28.048524 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-095f6d2e-7463-48bf-a103-b0281c8ac5b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818c7f89d2634a368401e384f70f8a2b', 'request_id': 'req-095f6d2e-7463-48bf-a103-b0281c8ac5b7'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:28.059918 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-095f6d2e-7463-48bf-a103-b0281c8ac5b7 admin admin] The token cache is being invalidate because project 818c7f89d2634a368401e384f70f8a2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:14:28.060215 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-095f6d2e-7463-48bf-a103-b0281c8ac5b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:28.060843 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-095f6d2e-7463-48bf-a103-b0281c8ac5b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:28.062364 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1417/2831] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:14:27 2022] DELETE /identity/v3/projects/818c7f89d2634a368401e384f70f8a2b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:14:28.067984 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bf0d3-7fc2-46ad-8b4b-6c476499dc36 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:28.074902 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bf0d3-7fc2-46ad-8b4b-6c476499dc36 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:28.074902 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bf0d3-7fc2-46ad-8b4b-6c476499dc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:28.085971 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-f04bf0d3-7fc2-46ad-8b4b-6c476499dc36 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:28.087233 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-f04bf0d3-7fc2-46ad-8b4b-6c476499dc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:28.145362 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1415/2832] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:14:28.153087 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a423516-22fd-47c6-bca9-7b25e08b9116 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:28.153375 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a423516-22fd-47c6-bca9-7b25e08b9116 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:28.153654 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a423516-22fd-47c6-bca9-7b25e08b9116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:28.171570 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-0a423516-22fd-47c6-bca9-7b25e08b9116 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:28.172770 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-0a423516-22fd-47c6-bca9-7b25e08b9116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:28.181166 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1418/2833] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:14:28.185361 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bf0d3-7fc2-46ad-8b4b-6c476499dc36 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:28.195789 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bf0d3-7fc2-46ad-8b4b-6c476499dc36 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:28.200424 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7302463-0452-44c0-8232-ec0a9a149d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:28.201071 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7302463-0452-44c0-8232-ec0a9a149d2d admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:28.201355 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7302463-0452-44c0-8232-ec0a9a149d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:28.201637 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7302463-0452-44c0-8232-ec0a9a149d2d admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:28.202426 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7302463-0452-44c0-8232-ec0a9a149d2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:14:28.202734 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7302463-0452-44c0-8232-ec0a9a149d2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:28.204351 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7302463-0452-44c0-8232-ec0a9a149d2d admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:28.215922 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1416/2834] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:28.220018 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a423516-22fd-47c6-bca9-7b25e08b9116 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:28.229326 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a423516-22fd-47c6-bca9-7b25e08b9116 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:28.234033 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59a728-c4a5-431d-aff9-4c7ebac836e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:28.234677 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59a728-c4a5-431d-aff9-4c7ebac836e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:28.234990 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59a728-c4a5-431d-aff9-4c7ebac836e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:28.235267 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59a728-c4a5-431d-aff9-4c7ebac836e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:28.235967 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59a728-c4a5-431d-aff9-4c7ebac836e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:28.238357 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59a728-c4a5-431d-aff9-4c7ebac836e1 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:28.326666 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1419/2835] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:14:28 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:14:28.330806 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7302463-0452-44c0-8232-ec0a9a149d2d admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:28.340938 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7302463-0452-44c0-8232-ec0a9a149d2d admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:28.395571 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbbd81-c9e0-4886-aaeb-5a2f6bf3dff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:28.396223 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbbd81-c9e0-4886-aaeb-5a2f6bf3dff8 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:28.396504 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbbd81-c9e0-4886-aaeb-5a2f6bf3dff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:28.396778 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbbd81-c9e0-4886-aaeb-5a2f6bf3dff8 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:28.397456 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbbd81-c9e0-4886-aaeb-5a2f6bf3dff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:28.399373 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbbd81-c9e0-4886-aaeb-5a2f6bf3dff8 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:28.485527 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1417/2836] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:14:28 2022] POST /identity/v3/users => generated 288 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:14:28.490222 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59a728-c4a5-431d-aff9-4c7ebac836e1 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:28.500963 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59a728-c4a5-431d-aff9-4c7ebac836e1 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:28.505632 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726e3e3-69dc-433d-bf49-5fc6a4f4415e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:28.506270 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726e3e3-69dc-433d-bf49-5fc6a4f4415e admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:28.506543 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726e3e3-69dc-433d-bf49-5fc6a4f4415e admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:28.506825 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726e3e3-69dc-433d-bf49-5fc6a4f4415e admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:28.507567 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726e3e3-69dc-433d-bf49-5fc6a4f4415e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:28.509143 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726e3e3-69dc-433d-bf49-5fc6a4f4415e admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:28.519277 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1420/2837] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:14:28.523032 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbbd81-c9e0-4886-aaeb-5a2f6bf3dff8 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:28.532683 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbbd81-c9e0-4886-aaeb-5a2f6bf3dff8 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:28.537676 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c7c7b-8304-471e-8891-513c3c7a6f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:28.538333 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c7c7b-8304-471e-8891-513c3c7a6f0b admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:28.538612 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c7c7b-8304-471e-8891-513c3c7a6f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:28.538908 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c7c7b-8304-471e-8891-513c3c7a6f0b admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:28.539629 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c7c7b-8304-471e-8891-513c3c7a6f0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:28.541191 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c7c7b-8304-471e-8891-513c3c7a6f0b admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:28.551294 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1418/2838] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:14:28.555146 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726e3e3-69dc-433d-bf49-5fc6a4f4415e admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:28.564789 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726e3e3-69dc-433d-bf49-5fc6a4f4415e admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:28.569558 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845df3e3-2311-46e4-b18f-9cd30f91ff37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:28.570422 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845df3e3-2311-46e4-b18f-9cd30f91ff37 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:28.570690 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845df3e3-2311-46e4-b18f-9cd30f91ff37 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:28.570997 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845df3e3-2311-46e4-b18f-9cd30f91ff37 admin admin] PATH_INFO: `/v3/projects/b028cc304b8f4121bbf531b62187bb37/users/1ce03602c9974475b7de4d4e1d38fbb0/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:28.584896 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845df3e3-2311-46e4-b18f-9cd30f91ff37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b028cc304b8f4121bbf531b62187bb37, user_id=1ce03602c9974475b7de4d4e1d38fbb0, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:28.587551 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845df3e3-2311-46e4-b18f-9cd30f91ff37 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:28.651932 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1421/2839] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:14:28 2022] PUT /identity/v3/projects/b028cc304b8f4121bbf531b62187bb37/users/1ce03602c9974475b7de4d4e1d38fbb0/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:14:28.662707 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e48981-c624-4025-aa52-e14c5715bbaa None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:28.663027 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e48981-c624-4025-aa52-e14c5715bbaa None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:28.663306 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e48981-c624-4025-aa52-e14c5715bbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:28.689405 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-51e48981-c624-4025-aa52-e14c5715bbaa None None] MFA Rules not processed for user `1ce03602c9974475b7de4d4e1d38fbb0`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:28.690594 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-51e48981-c624-4025-aa52-e14c5715bbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:28.751001 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1419/2840] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:14:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:14:28.755339 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845df3e3-2311-46e4-b18f-9cd30f91ff37 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:28.815680 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845df3e3-2311-46e4-b18f-9cd30f91ff37 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:28.820412 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e80f6-1128-4eb2-ba59-28816e641c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:28.821053 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e80f6-1128-4eb2-ba59-28816e641c06 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:28.821328 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e80f6-1128-4eb2-ba59-28816e641c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:28.821597 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e80f6-1128-4eb2-ba59-28816e641c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:28.822299 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e80f6-1128-4eb2-ba59-28816e641c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:28.824181 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e80f6-1128-4eb2-ba59-28816e641c06 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:28.901481 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1422/2841] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:14:28 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:14:28.905385 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e48981-c624-4025-aa52-e14c5715bbaa None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:28.916302 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e48981-c624-4025-aa52-e14c5715bbaa None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:28.970694 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aba334-db18-42b1-a82d-cdaa8273a7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:28.971388 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aba334-db18-42b1-a82d-cdaa8273a7f5 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:28.972270 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aba334-db18-42b1-a82d-cdaa8273a7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:28.972542 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aba334-db18-42b1-a82d-cdaa8273a7f5 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:28.973224 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aba334-db18-42b1-a82d-cdaa8273a7f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:28.975196 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aba334-db18-42b1-a82d-cdaa8273a7f5 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:29.048148 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1420/2842] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:14:28 2022] POST /identity/v3/users => generated 289 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:14:29.052164 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e80f6-1128-4eb2-ba59-28816e641c06 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:29.062276 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e80f6-1128-4eb2-ba59-28816e641c06 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:29.067336 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d267092-3533-404c-8abb-cc8ece4e4532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:29.071753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d267092-3533-404c-8abb-cc8ece4e4532 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:29.071753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d267092-3533-404c-8abb-cc8ece4e4532 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:29.071753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d267092-3533-404c-8abb-cc8ece4e4532 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:29.071753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d267092-3533-404c-8abb-cc8ece4e4532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:29.071753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d267092-3533-404c-8abb-cc8ece4e4532 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:29.080734 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1423/2843] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:14:29.085224 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aba334-db18-42b1-a82d-cdaa8273a7f5 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:29.095035 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aba334-db18-42b1-a82d-cdaa8273a7f5 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:29.099644 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8862d72-f224-40a9-a658-5a7b3d76ae32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:29.100283 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8862d72-f224-40a9-a658-5a7b3d76ae32 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:29.100561 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8862d72-f224-40a9-a658-5a7b3d76ae32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:29.100832 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8862d72-f224-40a9-a658-5a7b3d76ae32 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:29.101549 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8862d72-f224-40a9-a658-5a7b3d76ae32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:29.103150 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8862d72-f224-40a9-a658-5a7b3d76ae32 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:29.112783 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1421/2844] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:14:29.116952 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d267092-3533-404c-8abb-cc8ece4e4532 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:29.126603 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d267092-3533-404c-8abb-cc8ece4e4532 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:29.131838 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928503a-7f34-46b1-b28e-ddb01c393a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:29.132697 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928503a-7f34-46b1-b28e-ddb01c393a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:29.132971 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928503a-7f34-46b1-b28e-ddb01c393a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:29.133241 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928503a-7f34-46b1-b28e-ddb01c393a36 admin admin] PATH_INFO: `/v3/projects/df62cdaf6885435eb7707780707a9ebe/users/482f721eb2b24e49835b2f76b35422cb/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:29.148014 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928503a-7f34-46b1-b28e-ddb01c393a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df62cdaf6885435eb7707780707a9ebe, user_id=482f721eb2b24e49835b2f76b35422cb, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:29.150626 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928503a-7f34-46b1-b28e-ddb01c393a36 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:29.216783 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1424/2845] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:14:29 2022] PUT /identity/v3/projects/df62cdaf6885435eb7707780707a9ebe/users/482f721eb2b24e49835b2f76b35422cb/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:14:29.277089 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe910f0f-502f-419a-bb24-b32cbe3455c7 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:29.277376 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe910f0f-502f-419a-bb24-b32cbe3455c7 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:29.277649 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe910f0f-502f-419a-bb24-b32cbe3455c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:29.303289 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-fe910f0f-502f-419a-bb24-b32cbe3455c7 None None] MFA Rules not processed for user `482f721eb2b24e49835b2f76b35422cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:29.304402 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-fe910f0f-502f-419a-bb24-b32cbe3455c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:29.364078 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1422/2846] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:14:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:14:29.368707 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928503a-7f34-46b1-b28e-ddb01c393a36 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:29.427191 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928503a-7f34-46b1-b28e-ddb01c393a36 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:29.431694 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37048619-d057-41cf-aeca-6f9a4a038b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:29.432332 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37048619-d057-41cf-aeca-6f9a4a038b27 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:29.432609 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37048619-d057-41cf-aeca-6f9a4a038b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:29.432879 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37048619-d057-41cf-aeca-6f9a4a038b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:29.433561 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37048619-d057-41cf-aeca-6f9a4a038b27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:29.435455 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37048619-d057-41cf-aeca-6f9a4a038b27 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:29.514635 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1425/2847] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:14:29 2022] POST /identity/v3/projects => generated 375 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:14:29.518865 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe910f0f-502f-419a-bb24-b32cbe3455c7 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:29.529168 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe910f0f-502f-419a-bb24-b32cbe3455c7 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:29.591086 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92e4c2-a7be-417a-824e-36ed0f67f9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:29.591671 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92e4c2-a7be-417a-824e-36ed0f67f9f0 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:29.591949 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92e4c2-a7be-417a-824e-36ed0f67f9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:29.592245 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc92e4c2-a7be-417a-824e-36ed0f67f9f0 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:29.592981 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92e4c2-a7be-417a-824e-36ed0f67f9f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:29.594896 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc92e4c2-a7be-417a-824e-36ed0f67f9f0 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:29.680858 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1423/2848] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:14:29 2022] POST /identity/v3/users => generated 294 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Apr 12 00:14:29.685959 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37048619-d057-41cf-aeca-6f9a4a038b27 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:29.697223 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37048619-d057-41cf-aeca-6f9a4a038b27 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:29.701898 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392610a0-6fad-49b8-8b29-b1cde599b0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:29.707208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392610a0-6fad-49b8-8b29-b1cde599b0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:29.707208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392610a0-6fad-49b8-8b29-b1cde599b0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:29.707208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392610a0-6fad-49b8-8b29-b1cde599b0b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:29.707208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392610a0-6fad-49b8-8b29-b1cde599b0b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:29.707208 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392610a0-6fad-49b8-8b29-b1cde599b0b8 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:29.720525 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1426/2849] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:14:29.721626 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92e4c2-a7be-417a-824e-36ed0f67f9f0 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:29.731599 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc92e4c2-a7be-417a-824e-36ed0f67f9f0 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:29.736217 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1b28-2968-4e0e-944b-570e39efd63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:29.737584 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1b28-2968-4e0e-944b-570e39efd63b admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:29.737864 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1b28-2968-4e0e-944b-570e39efd63b admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:29.738139 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b1b28-2968-4e0e-944b-570e39efd63b admin admin] PATH_INFO: `/v3/projects/777d586dcc7144468c23bf028ffdf23c/users/0c6bf765d54940d8b1fb680e83d8c4a1/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:29.754065 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b1b28-2968-4e0e-944b-570e39efd63b admin admin] RBAC: Authorizing `identity:create_grant(project_id=777d586dcc7144468c23bf028ffdf23c, user_id=0c6bf765d54940d8b1fb680e83d8c4a1, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:29.756757 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830b1b28-2968-4e0e-944b-570e39efd63b admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:29.846902 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1424/2850] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:14:29 2022] PUT /identity/v3/projects/777d586dcc7144468c23bf028ffdf23c/users/0c6bf765d54940d8b1fb680e83d8c4a1/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:14:29.850772 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392610a0-6fad-49b8-8b29-b1cde599b0b8 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:29.860743 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392610a0-6fad-49b8-8b29-b1cde599b0b8 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:29.915475 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91fb31-4d33-43ee-8d66-c004c5ac2cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:29.916129 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91fb31-4d33-43ee-8d66-c004c5ac2cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:29.916409 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91fb31-4d33-43ee-8d66-c004c5ac2cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:29.916684 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91fb31-4d33-43ee-8d66-c004c5ac2cf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:29.917412 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91fb31-4d33-43ee-8d66-c004c5ac2cf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:29.919017 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91fb31-4d33-43ee-8d66-c004c5ac2cf1 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:29.933552 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1427/2851] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:14:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:14:29.937894 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1b28-2968-4e0e-944b-570e39efd63b admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:29.948606 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b1b28-2968-4e0e-944b-570e39efd63b admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:29.953520 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c28c2d-a478-45a7-b16c-d10dced7d3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:29.958136 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c28c2d-a478-45a7-b16c-d10dced7d3cb admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:29.958136 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c28c2d-a478-45a7-b16c-d10dced7d3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:29.958136 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c28c2d-a478-45a7-b16c-d10dced7d3cb admin admin] PATH_INFO: `/v3/projects/777d586dcc7144468c23bf028ffdf23c/users/0c6bf765d54940d8b1fb680e83d8c4a1/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:29.958136 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c28c2d-a478-45a7-b16c-d10dced7d3cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=777d586dcc7144468c23bf028ffdf23c, user_id=0c6bf765d54940d8b1fb680e83d8c4a1, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:29.960283 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c28c2d-a478-45a7-b16c-d10dced7d3cb admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:29.970781 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1425/2852] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:14:29 2022] PUT /identity/v3/projects/777d586dcc7144468c23bf028ffdf23c/users/0c6bf765d54940d8b1fb680e83d8c4a1/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:14:29.980547 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a22fa-d69a-4c54-bcdf-c5a19de58122 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:29.980831 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a22fa-d69a-4c54-bcdf-c5a19de58122 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:29.981104 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a22fa-d69a-4c54-bcdf-c5a19de58122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:30.007043 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-eb5a22fa-d69a-4c54-bcdf-c5a19de58122 None None] MFA Rules not processed for user `0c6bf765d54940d8b1fb680e83d8c4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:30.008231 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-eb5a22fa-d69a-4c54-bcdf-c5a19de58122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:30.072574 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1428/2853] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:14:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:14:30.084708 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c28c2d-a478-45a7-b16c-d10dced7d3cb admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:30.086367 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-53c28c2d-a478-45a7-b16c-d10dced7d3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:30.141115 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c28c2d-a478-45a7-b16c-d10dced7d3cb admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:30.145344 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058887e-9a59-4c16-897c-3481f7ad371d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:30.145977 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058887e-9a59-4c16-897c-3481f7ad371d service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:30.146259 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058887e-9a59-4c16-897c-3481f7ad371d service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:30.146537 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058887e-9a59-4c16-897c-3481f7ad371d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:30.199485 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058887e-9a59-4c16-897c-3481f7ad371d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:30.200909 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058887e-9a59-4c16-897c-3481f7ad371d service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:30.209654 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1426/2854] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:14:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:14:32.220347 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a22fa-d69a-4c54-bcdf-c5a19de58122 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:32.222291 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-eb5a22fa-d69a-4c54-bcdf-c5a19de58122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:32.234090 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a22fa-d69a-4c54-bcdf-c5a19de58122 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:32.239303 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7f16d-0073-4617-a209-8447af2af07b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:32.239928 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7f16d-0073-4617-a209-8447af2af07b service cinder] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:32.240209 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7f16d-0073-4617-a209-8447af2af07b service cinder] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:32.240475 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f7f16d-0073-4617-a209-8447af2af07b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:32.295198 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7f16d-0073-4617-a209-8447af2af07b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:32.296623 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f7f16d-0073-4617-a209-8447af2af07b service cinder] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:32.306022 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1429/2855] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:14:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:14:33.616261 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058887e-9a59-4c16-897c-3481f7ad371d service cinder] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:33.624858 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058887e-9a59-4c16-897c-3481f7ad371d service cinder] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:33.628898 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da114125-141c-4c41-8360-155d9c384a3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a09a31262e54eec84580c7259902df1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:33.629517 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da114125-141c-4c41-8360-155d9c384a3e service cinder] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:33.629788 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da114125-141c-4c41-8360-155d9c384a3e service cinder] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:33.630052 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da114125-141c-4c41-8360-155d9c384a3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:33.638582 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da114125-141c-4c41-8360-155d9c384a3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:33.640009 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da114125-141c-4c41-8360-155d9c384a3e service cinder] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:33.649684 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1427/2856] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:14:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:14:38.253874 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7f16d-0073-4617-a209-8447af2af07b service cinder] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:38.312460 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f7f16d-0073-4617-a209-8447af2af07b service cinder] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:38.317008 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02a25b-0e96-4d32-86d3-5a34b355bf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:38.317859 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02a25b-0e96-4d32-86d3-5a34b355bf22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:38.318135 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02a25b-0e96-4d32-86d3-5a34b355bf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:38.318404 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02a25b-0e96-4d32-86d3-5a34b355bf22 admin admin] PATH_INFO: `/v3/users/1ce03602c9974475b7de4d4e1d38fbb0` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:38.319605 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02a25b-0e96-4d32-86d3-5a34b355bf22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ce03602c9974475b7de4d4e1d38fbb0)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:38.321493 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02a25b-0e96-4d32-86d3-5a34b355bf22 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:38.538765 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-7d02a25b-0e96-4d32-86d3-5a34b355bf22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ce03602c9974475b7de4d4e1d38fbb0'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:38.610851 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-7d02a25b-0e96-4d32-86d3-5a34b355bf22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ce03602c9974475b7de4d4e1d38fbb0'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:38.611481 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-7d02a25b-0e96-4d32-86d3-5a34b355bf22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ce03602c9974475b7de4d4e1d38fbb0'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:38.618540 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-7d02a25b-0e96-4d32-86d3-5a34b355bf22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ce03602c9974475b7de4d4e1d38fbb0'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:38.629777 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-7d02a25b-0e96-4d32-86d3-5a34b355bf22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ce03602c9974475b7de4d4e1d38fbb0'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:38.635530 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1430/2857] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:14:38 2022] DELETE /identity/v3/users/1ce03602c9974475b7de4d4e1d38fbb0 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:14:38.640061 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcae67-6e5e-4a73-a1e7-419343dbd186 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:38.640556 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcae67-6e5e-4a73-a1e7-419343dbd186 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:38.640674 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcae67-6e5e-4a73-a1e7-419343dbd186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:38.663116 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-4ddcae67-6e5e-4a73-a1e7-419343dbd186 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:38.666818 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-4ddcae67-6e5e-4a73-a1e7-419343dbd186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:38.720736 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1428/2858] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:14:38.730945 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02a25b-0e96-4d32-86d3-5a34b355bf22 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:38.732352 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-7d02a25b-0e96-4d32-86d3-5a34b355bf22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:38.787237 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02a25b-0e96-4d32-86d3-5a34b355bf22 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:38.790884 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc892dec-3bf9-442a-9d7f-74de91c29c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:38.791493 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc892dec-3bf9-442a-9d7f-74de91c29c11 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:38.791768 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc892dec-3bf9-442a-9d7f-74de91c29c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:38.792038 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc892dec-3bf9-442a-9d7f-74de91c29c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:38.801003 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc892dec-3bf9-442a-9d7f-74de91c29c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:38.802440 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc892dec-3bf9-442a-9d7f-74de91c29c11 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:38.811657 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1431/2859] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:14:39.164301 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcae67-6e5e-4a73-a1e7-419343dbd186 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:39.166186 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-4ddcae67-6e5e-4a73-a1e7-419343dbd186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:39.167759 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc892dec-3bf9-442a-9d7f-74de91c29c11 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:39.172291 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-fc892dec-3bf9-442a-9d7f-74de91c29c11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:39.183848 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc892dec-3bf9-442a-9d7f-74de91c29c11 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:39.189139 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513113b-b28d-4a86-8a38-cb12e0680f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:39.190005 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513113b-b28d-4a86-8a38-cb12e0680f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:39.190282 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513113b-b28d-4a86-8a38-cb12e0680f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:39.190560 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513113b-b28d-4a86-8a38-cb12e0680f58 admin admin] PATH_INFO: `/v3/projects/b028cc304b8f4121bbf531b62187bb37` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:39.192439 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513113b-b28d-4a86-8a38-cb12e0680f58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b028cc304b8f4121bbf531b62187bb37)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:39.194351 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d513113b-b28d-4a86-8a38-cb12e0680f58 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:39.260124 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcae67-6e5e-4a73-a1e7-419343dbd186 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:39.265238 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a015a-fdbd-4f46-93cf-e6f910b8efe3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47515442e0e84441bed4bfbb7a3b4ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:39.267286 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a015a-fdbd-4f46-93cf-e6f910b8efe3 service placement] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:39.267286 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a015a-fdbd-4f46-93cf-e6f910b8efe3 service placement] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:39.267286 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a015a-fdbd-4f46-93cf-e6f910b8efe3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:39.268263 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-314a015a-fdbd-4f46-93cf-e6f910b8efe3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:39.279662 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a015a-fdbd-4f46-93cf-e6f910b8efe3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:39.281221 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a015a-fdbd-4f46-93cf-e6f910b8efe3 service placement] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:39.291318 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1429/2860] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:14:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:14:39.299866 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d513113b-b28d-4a86-8a38-cb12e0680f58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b028cc304b8f4121bbf531b62187bb37', 'request_id': 'req-d513113b-b28d-4a86-8a38-cb12e0680f58'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:39.363038 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d513113b-b28d-4a86-8a38-cb12e0680f58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b028cc304b8f4121bbf531b62187bb37', 'request_id': 'req-d513113b-b28d-4a86-8a38-cb12e0680f58'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:39.369604 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d513113b-b28d-4a86-8a38-cb12e0680f58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b028cc304b8f4121bbf531b62187bb37', 'request_id': 'req-d513113b-b28d-4a86-8a38-cb12e0680f58'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:39.381183 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d513113b-b28d-4a86-8a38-cb12e0680f58 admin admin] The token cache is being invalidate because project b028cc304b8f4121bbf531b62187bb37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:14:39.381466 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d513113b-b28d-4a86-8a38-cb12e0680f58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:39.382084 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-d513113b-b28d-4a86-8a38-cb12e0680f58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:39.383657 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1432/2861] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:14:39 2022] DELETE /identity/v3/projects/b028cc304b8f4121bbf531b62187bb37 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:14:39.387682 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a015a-fdbd-4f46-93cf-e6f910b8efe3 service placement] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:39.398131 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a015a-fdbd-4f46-93cf-e6f910b8efe3 service placement] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:39.452410 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e633e-11dd-4604-b4f9-01d96272d34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:39.453274 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e633e-11dd-4604-b4f9-01d96272d34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:39.453552 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e633e-11dd-4604-b4f9-01d96272d34a admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:39.453824 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e633e-11dd-4604-b4f9-01d96272d34a admin admin] PATH_INFO: `/v3/users/482f721eb2b24e49835b2f76b35422cb` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:39.455044 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e633e-11dd-4604-b4f9-01d96272d34a admin admin] RBAC: Authorizing `identity:delete_user(user_id=482f721eb2b24e49835b2f76b35422cb)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:39.457004 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e633e-11dd-4604-b4f9-01d96272d34a admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:39.631320 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ae9e633e-11dd-4604-b4f9-01d96272d34a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '482f721eb2b24e49835b2f76b35422cb'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:39.638043 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ae9e633e-11dd-4604-b4f9-01d96272d34a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '482f721eb2b24e49835b2f76b35422cb'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:39.711276 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ae9e633e-11dd-4604-b4f9-01d96272d34a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '482f721eb2b24e49835b2f76b35422cb'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:39.711969 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ae9e633e-11dd-4604-b4f9-01d96272d34a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '482f721eb2b24e49835b2f76b35422cb'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:39.724283 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-ae9e633e-11dd-4604-b4f9-01d96272d34a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '482f721eb2b24e49835b2f76b35422cb'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:39.730170 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1430/2862] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:14:39 2022] DELETE /identity/v3/users/482f721eb2b24e49835b2f76b35422cb => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:14:40.153461 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513113b-b28d-4a86-8a38-cb12e0680f58 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:40.154931 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-d513113b-b28d-4a86-8a38-cb12e0680f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:40.168711 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513113b-b28d-4a86-8a38-cb12e0680f58 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:40.225160 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810760c7-8665-4b93-9850-f7f307832996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:40.226010 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810760c7-8665-4b93-9850-f7f307832996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:40.226289 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810760c7-8665-4b93-9850-f7f307832996 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:40.226560 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810760c7-8665-4b93-9850-f7f307832996 admin admin] PATH_INFO: `/v3/projects/df62cdaf6885435eb7707780707a9ebe` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:40.227769 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810760c7-8665-4b93-9850-f7f307832996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df62cdaf6885435eb7707780707a9ebe)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:40.229656 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810760c7-8665-4b93-9850-f7f307832996 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:40.324670 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-810760c7-8665-4b93-9850-f7f307832996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df62cdaf6885435eb7707780707a9ebe', 'request_id': 'req-810760c7-8665-4b93-9850-f7f307832996'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:40.391570 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-810760c7-8665-4b93-9850-f7f307832996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df62cdaf6885435eb7707780707a9ebe', 'request_id': 'req-810760c7-8665-4b93-9850-f7f307832996'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:40.397506 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-810760c7-8665-4b93-9850-f7f307832996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df62cdaf6885435eb7707780707a9ebe', 'request_id': 'req-810760c7-8665-4b93-9850-f7f307832996'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:40.408206 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-810760c7-8665-4b93-9850-f7f307832996 admin admin] The token cache is being invalidate because project df62cdaf6885435eb7707780707a9ebe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:14:40.408491 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-810760c7-8665-4b93-9850-f7f307832996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:40.409101 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-810760c7-8665-4b93-9850-f7f307832996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:40.410662 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1433/2863] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:14:40 2022] DELETE /identity/v3/projects/df62cdaf6885435eb7707780707a9ebe => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:14:40.414949 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e633e-11dd-4604-b4f9-01d96272d34a admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:40.416342 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-ae9e633e-11dd-4604-b4f9-01d96272d34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:40.429005 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e633e-11dd-4604-b4f9-01d96272d34a admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:40.484876 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb97306-84db-45cf-bbd2-029071004952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:40.485734 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb97306-84db-45cf-bbd2-029071004952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:40.486017 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb97306-84db-45cf-bbd2-029071004952 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:40.486290 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb97306-84db-45cf-bbd2-029071004952 admin admin] PATH_INFO: `/v3/users/0c6bf765d54940d8b1fb680e83d8c4a1` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:40.487518 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb97306-84db-45cf-bbd2-029071004952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c6bf765d54940d8b1fb680e83d8c4a1)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:40.489434 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb97306-84db-45cf-bbd2-029071004952 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:40.672707 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-0bb97306-84db-45cf-bbd2-029071004952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c6bf765d54940d8b1fb680e83d8c4a1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:40.679941 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-0bb97306-84db-45cf-bbd2-029071004952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c6bf765d54940d8b1fb680e83d8c4a1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:40.740094 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-0bb97306-84db-45cf-bbd2-029071004952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c6bf765d54940d8b1fb680e83d8c4a1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:40.740738 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-0bb97306-84db-45cf-bbd2-029071004952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c6bf765d54940d8b1fb680e83d8c4a1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:40.752601 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-0bb97306-84db-45cf-bbd2-029071004952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c6bf765d54940d8b1fb680e83d8c4a1'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:40.759321 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1431/2864] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:14:40 2022] DELETE /identity/v3/users/0c6bf765d54940d8b1fb680e83d8c4a1 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:14:41.141694 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810760c7-8665-4b93-9850-f7f307832996 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:41.143258 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-810760c7-8665-4b93-9850-f7f307832996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:41.156921 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810760c7-8665-4b93-9850-f7f307832996 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:41.212211 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a6ce2-8aad-4103-b626-1bdd9d6919c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:41.212983 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a6ce2-8aad-4103-b626-1bdd9d6919c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:41.213257 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a6ce2-8aad-4103-b626-1bdd9d6919c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:41.213540 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a6ce2-8aad-4103-b626-1bdd9d6919c5 admin admin] PATH_INFO: `/v3/projects/777d586dcc7144468c23bf028ffdf23c` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:41.214691 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a6ce2-8aad-4103-b626-1bdd9d6919c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=777d586dcc7144468c23bf028ffdf23c)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:41.216661 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a6ce2-8aad-4103-b626-1bdd9d6919c5 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:41.310929 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-012a6ce2-8aad-4103-b626-1bdd9d6919c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '777d586dcc7144468c23bf028ffdf23c', 'request_id': 'req-012a6ce2-8aad-4103-b626-1bdd9d6919c5'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:41.371444 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-012a6ce2-8aad-4103-b626-1bdd9d6919c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '777d586dcc7144468c23bf028ffdf23c', 'request_id': 'req-012a6ce2-8aad-4103-b626-1bdd9d6919c5'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:41.377269 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-012a6ce2-8aad-4103-b626-1bdd9d6919c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '777d586dcc7144468c23bf028ffdf23c', 'request_id': 'req-012a6ce2-8aad-4103-b626-1bdd9d6919c5'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:41.388628 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-012a6ce2-8aad-4103-b626-1bdd9d6919c5 admin admin] The token cache is being invalidate because project 777d586dcc7144468c23bf028ffdf23c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:14:41.388912 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-012a6ce2-8aad-4103-b626-1bdd9d6919c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:41.389566 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-012a6ce2-8aad-4103-b626-1bdd9d6919c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:14:41.391160 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1434/2865] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:14:41 2022] DELETE /identity/v3/projects/777d586dcc7144468c23bf028ffdf23c => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:14:41.396533 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ceeba-6fdc-452d-af46-6338e7fffedf None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:41.396820 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ceeba-6fdc-452d-af46-6338e7fffedf None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:41.397247 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ceeba-6fdc-452d-af46-6338e7fffedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:41.414926 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-c38ceeba-6fdc-452d-af46-6338e7fffedf None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:41.416110 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-c38ceeba-6fdc-452d-af46-6338e7fffedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:41.471260 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1432/2866] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:14:41.480741 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99447ba6-d170-47bd-919f-021bc51ec740 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:41.481130 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99447ba6-d170-47bd-919f-021bc51ec740 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:41.481312 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99447ba6-d170-47bd-919f-021bc51ec740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:41.499518 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-99447ba6-d170-47bd-919f-021bc51ec740 None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:41.500709 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-99447ba6-d170-47bd-919f-021bc51ec740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:41.508510 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1435/2867] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:14:41.512525 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ceeba-6fdc-452d-af46-6338e7fffedf None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:41.522414 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ceeba-6fdc-452d-af46-6338e7fffedf None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:41.526939 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be6beb-b651-4c79-84fe-c59ad2c5d456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:41.527577 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be6beb-b651-4c79-84fe-c59ad2c5d456 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:41.527871 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be6beb-b651-4c79-84fe-c59ad2c5d456 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:41.528129 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be6beb-b651-4c79-84fe-c59ad2c5d456 admin admin] PATH_INFO: `/v3/domains` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:41.528848 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be6beb-b651-4c79-84fe-c59ad2c5d456 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86501) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Apr 12 00:14:41.529150 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be6beb-b651-4c79-84fe-c59ad2c5d456 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:41.530718 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25be6beb-b651-4c79-84fe-c59ad2c5d456 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:41.542277 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1433/2868] 10.222.0.24 () {58 vars in 1152 bytes} [Tue Apr 12 00:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Apr 12 00:14:41.546331 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99447ba6-d170-47bd-919f-021bc51ec740 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:41.555434 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99447ba6-d170-47bd-919f-021bc51ec740 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:41.560063 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac720318-0a2f-46eb-9d80-d20d93b25f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:41.560695 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac720318-0a2f-46eb-9d80-d20d93b25f4a admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:41.560976 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac720318-0a2f-46eb-9d80-d20d93b25f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:41.561248 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac720318-0a2f-46eb-9d80-d20d93b25f4a admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:41.561935 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac720318-0a2f-46eb-9d80-d20d93b25f4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:41.563836 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac720318-0a2f-46eb-9d80-d20d93b25f4a admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:41.645034 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1436/2869] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:14:41 2022] POST /identity/v3/projects => generated 371 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:14:41.648918 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be6beb-b651-4c79-84fe-c59ad2c5d456 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:41.658975 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be6beb-b651-4c79-84fe-c59ad2c5d456 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:41.713825 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fd414-c889-4506-9ded-b554fac564ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:41.714486 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fd414-c889-4506-9ded-b554fac564ce admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:41.714760 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fd414-c889-4506-9ded-b554fac564ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:41.715057 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fd414-c889-4506-9ded-b554fac564ce admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:41.715752 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fd414-c889-4506-9ded-b554fac564ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:41.717635 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2fd414-c889-4506-9ded-b554fac564ce admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:41.797316 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1434/2870] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:14:41 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:14:41.801334 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac720318-0a2f-46eb-9d80-d20d93b25f4a admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:41.811532 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac720318-0a2f-46eb-9d80-d20d93b25f4a admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:41.816006 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49880ff8-7e1c-4900-9a5b-6befc86a0697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:41.817181 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49880ff8-7e1c-4900-9a5b-6befc86a0697 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:41.817455 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49880ff8-7e1c-4900-9a5b-6befc86a0697 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:41.817722 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49880ff8-7e1c-4900-9a5b-6befc86a0697 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:41.818439 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49880ff8-7e1c-4900-9a5b-6befc86a0697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:41.820050 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49880ff8-7e1c-4900-9a5b-6befc86a0697 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:41.830109 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1437/2871] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:14:41.834354 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fd414-c889-4506-9ded-b554fac564ce admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:41.844261 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fd414-c889-4506-9ded-b554fac564ce admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:41.848930 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15dfa82-8d53-4894-8e3f-86aef9399182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:41.849566 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dfa82-8d53-4894-8e3f-86aef9399182 admin admin] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:41.849844 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dfa82-8d53-4894-8e3f-86aef9399182 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:41.850116 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15dfa82-8d53-4894-8e3f-86aef9399182 admin admin] PATH_INFO: `/v3/roles` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:41.850862 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15dfa82-8d53-4894-8e3f-86aef9399182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:41.852415 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15dfa82-8d53-4894-8e3f-86aef9399182 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:41.862073 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1435/2872] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:14:41.865940 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49880ff8-7e1c-4900-9a5b-6befc86a0697 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:41.875798 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49880ff8-7e1c-4900-9a5b-6befc86a0697 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:41.880900 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a1f45-8e2c-4414-87d0-2b3b2a455123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:41.881758 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a1f45-8e2c-4414-87d0-2b3b2a455123 admin admin] REQUEST_METHOD: `PUT` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:41.882037 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a1f45-8e2c-4414-87d0-2b3b2a455123 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:41.882309 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7a1f45-8e2c-4414-87d0-2b3b2a455123 admin admin] PATH_INFO: `/v3/projects/7f50ab8a19e8481daa24f0cb870c8e7d/users/efa212d5107a41ceb0902b9a2d8380d0/roles/d0f74491c28e4d1094a60391d71c2246` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:41.896647 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a1f45-8e2c-4414-87d0-2b3b2a455123 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f50ab8a19e8481daa24f0cb870c8e7d, user_id=efa212d5107a41ceb0902b9a2d8380d0, role_id=d0f74491c28e4d1094a60391d71c2246)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:41.899297 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7a1f45-8e2c-4414-87d0-2b3b2a455123 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:41.962907 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1438/2873] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:14:41 2022] PUT /identity/v3/projects/7f50ab8a19e8481daa24f0cb870c8e7d/users/efa212d5107a41ceb0902b9a2d8380d0/roles/d0f74491c28e4d1094a60391d71c2246 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:14:41.967770 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36d7c0-8ca5-4bdb-a008-93374563ed3f None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:41.968060 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36d7c0-8ca5-4bdb-a008-93374563ed3f None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:41.968342 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f36d7c0-8ca5-4bdb-a008-93374563ed3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:41.987114 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-7f36d7c0-8ca5-4bdb-a008-93374563ed3f None None] MFA Rules not processed for user `abec147e21ba4a90ada48328d76ea483`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:41.988365 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-7f36d7c0-8ca5-4bdb-a008-93374563ed3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:42.045805 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1436/2874] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:14:42.055535 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a1f45-8e2c-4414-87d0-2b3b2a455123 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:42.060502 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-8f7a1f45-8e2c-4414-87d0-2b3b2a455123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:42.111541 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7a1f45-8e2c-4414-87d0-2b3b2a455123 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:42.115146 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd1440-9150-4045-9458-c7b74956ea04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:42.115815 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd1440-9150-4045-9458-c7b74956ea04 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:42.116093 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd1440-9150-4045-9458-c7b74956ea04 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:42.116364 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd1440-9150-4045-9458-c7b74956ea04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:42.125547 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd1440-9150-4045-9458-c7b74956ea04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:42.126984 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd1440-9150-4045-9458-c7b74956ea04 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:42.136934 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1439/2875] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:14:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:14:47.190931 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8307d98-a5ae-41e9-9008-e60bbcfcf425 None None] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:47.191588 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8307d98-a5ae-41e9-9008-e60bbcfcf425 None None] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:47.191588 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8307d98-a5ae-41e9-9008-e60bbcfcf425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:47.218426 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.auth.core [None req-a8307d98-a5ae-41e9-9008-e60bbcfcf425 None None] MFA Rules not processed for user `efa212d5107a41ceb0902b9a2d8380d0`. Rule list: `[]` (Enabled: `True`). {{(pid=86501) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:47.219668 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-a8307d98-a5ae-41e9-9008-e60bbcfcf425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:47.284440 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1437/2876] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:14:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:14:47.289416 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd1440-9150-4045-9458-c7b74956ea04 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:47.299321 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd1440-9150-4045-9458-c7b74956ea04 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:47.304689 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e220b8a-3b5f-416d-8a48-aa55cfbbfe51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:47.305355 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e220b8a-3b5f-416d-8a48-aa55cfbbfe51 admin admin] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:47.305634 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e220b8a-3b5f-416d-8a48-aa55cfbbfe51 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:47.305905 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e220b8a-3b5f-416d-8a48-aa55cfbbfe51 admin admin] PATH_INFO: `/v3/projects` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:47.306652 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e220b8a-3b5f-416d-8a48-aa55cfbbfe51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:47.308749 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e220b8a-3b5f-416d-8a48-aa55cfbbfe51 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:47.393492 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1440/2877] 10.222.0.24 () {60 vars in 1152 bytes} [Tue Apr 12 00:14:47 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:14:47.397847 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8307d98-a5ae-41e9-9008-e60bbcfcf425 None None] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:47.408678 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8307d98-a5ae-41e9-9008-e60bbcfcf425 None None] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:47.465886 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0c6c2-8c8a-462d-8619-ecd7715a4f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:47.466576 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0c6c2-8c8a-462d-8619-ecd7715a4f91 admin admin] REQUEST_METHOD: `POST` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:47.466940 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0c6c2-8c8a-462d-8619-ecd7715a4f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:47.467217 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0c6c2-8c8a-462d-8619-ecd7715a4f91 admin admin] PATH_INFO: `/v3/users` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:47.467940 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0c6c2-8c8a-462d-8619-ecd7715a4f91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:47.469906 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0c6c2-8c8a-462d-8619-ecd7715a4f91 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:47.560138 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1438/2878] 10.222.0.24 () {60 vars in 1143 bytes} [Tue Apr 12 00:14:47 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Apr 12 00:14:47.563869 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e220b8a-3b5f-416d-8a48-aa55cfbbfe51 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:47.574087 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e220b8a-3b5f-416d-8a48-aa55cfbbfe51 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:47.578686 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600b547-2bc0-424d-9f37-b16af09b81dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:47.579370 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600b547-2bc0-424d-9f37-b16af09b81dc admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:47.579651 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600b547-2bc0-424d-9f37-b16af09b81dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:47.579926 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e600b547-2bc0-424d-9f37-b16af09b81dc admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:47.580708 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600b547-2bc0-424d-9f37-b16af09b81dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:47.582802 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e600b547-2bc0-424d-9f37-b16af09b81dc admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:47.593176 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1441/2879] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:14:47.598190 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0c6c2-8c8a-462d-8619-ecd7715a4f91 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:47.607862 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0c6c2-8c8a-462d-8619-ecd7715a4f91 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:47.612615 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a93c4-b8f2-4678-bd83-d19ae9ea2202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:47.613485 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a93c4-b8f2-4678-bd83-d19ae9ea2202 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:47.613764 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a93c4-b8f2-4678-bd83-d19ae9ea2202 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:47.614037 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a93c4-b8f2-4678-bd83-d19ae9ea2202 admin admin] PATH_INFO: `/v3/projects/051cdc8c266f4ccc8f5748e3c86bcb2e/users/5cc8b0c8d6ab40a884d34ade242ff8ac/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:47.629693 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a93c4-b8f2-4678-bd83-d19ae9ea2202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=051cdc8c266f4ccc8f5748e3c86bcb2e, user_id=5cc8b0c8d6ab40a884d34ade242ff8ac, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:47.632341 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a93c4-b8f2-4678-bd83-d19ae9ea2202 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:47.697242 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1439/2880] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:14:47 2022] PUT /identity/v3/projects/051cdc8c266f4ccc8f5748e3c86bcb2e/users/5cc8b0c8d6ab40a884d34ade242ff8ac/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:14:47.701387 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600b547-2bc0-424d-9f37-b16af09b81dc admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:47.712605 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e600b547-2bc0-424d-9f37-b16af09b81dc admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:47.766734 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cb2b0-3d0f-4f15-9985-f0bb24501ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:47.767422 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cb2b0-3d0f-4f15-9985-f0bb24501ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:47.767701 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cb2b0-3d0f-4f15-9985-f0bb24501ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:47.767974 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cb2b0-3d0f-4f15-9985-f0bb24501ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:47.768697 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cb2b0-3d0f-4f15-9985-f0bb24501ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:47.770816 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cb2b0-3d0f-4f15-9985-f0bb24501ba6 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:47.780548 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1442/2881] 10.222.0.24 () {58 vars in 1121 bytes} [Tue Apr 12 00:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Apr 12 00:14:47.784681 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a93c4-b8f2-4678-bd83-d19ae9ea2202 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:47.795362 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a93c4-b8f2-4678-bd83-d19ae9ea2202 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:47.799847 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d65cc-1d4a-4559-b15f-a28a623e0139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:47.800709 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d65cc-1d4a-4559-b15f-a28a623e0139 admin admin] REQUEST_METHOD: `PUT` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:47.800986 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d65cc-1d4a-4559-b15f-a28a623e0139 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:47.801257 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d65cc-1d4a-4559-b15f-a28a623e0139 admin admin] PATH_INFO: `/v3/projects/051cdc8c266f4ccc8f5748e3c86bcb2e/users/5cc8b0c8d6ab40a884d34ade242ff8ac/roles/c8affbefb4c5462a921650b24b13c80f` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:47.803239 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d65cc-1d4a-4559-b15f-a28a623e0139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=051cdc8c266f4ccc8f5748e3c86bcb2e, user_id=5cc8b0c8d6ab40a884d34ade242ff8ac, role_id=c8affbefb4c5462a921650b24b13c80f)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:47.805832 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d65cc-1d4a-4559-b15f-a28a623e0139 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:47.815798 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1440/2882] 10.222.0.24 () {60 vars in 1482 bytes} [Tue Apr 12 00:14:47 2022] PUT /identity/v3/projects/051cdc8c266f4ccc8f5748e3c86bcb2e/users/5cc8b0c8d6ab40a884d34ade242ff8ac/roles/c8affbefb4c5462a921650b24b13c80f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Apr 12 00:14:53.212162 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e27cc-ec2f-42a4-879c-891afb999829 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:53.212639 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e27cc-ec2f-42a4-879c-891afb999829 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:53.212753 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e27cc-ec2f-42a4-879c-891afb999829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:53.244438 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-f40e27cc-ec2f-42a4-879c-891afb999829 None None] MFA Rules not processed for user `5cc8b0c8d6ab40a884d34ade242ff8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:53.245632 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-f40e27cc-ec2f-42a4-879c-891afb999829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:53.315684 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1443/2883] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:14:53 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:14:53.327276 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d65cc-1d4a-4559-b15f-a28a623e0139 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:14:53.329227 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-067d65cc-1d4a-4559-b15f-a28a623e0139 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:53.434053 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d65cc-1d4a-4559-b15f-a28a623e0139 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:14:53.439615 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7c399-bff3-4ad9-b40a-1122bfa2df5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:14:53.440268 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7c399-bff3-4ad9-b40a-1122bfa2df5b service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:53.440569 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7c399-bff3-4ad9-b40a-1122bfa2df5b service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:53.440843 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7c399-bff3-4ad9-b40a-1122bfa2df5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:53.497257 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7c399-bff3-4ad9-b40a-1122bfa2df5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:14:53.498860 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7c399-bff3-4ad9-b40a-1122bfa2df5b service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:14:53.508028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1441/2884] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:14:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:14:56.968763 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e5281-64f1-4c94-8a3f-5793d3876386 None None] REQUEST_METHOD: `POST` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:14:56.969324 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e5281-64f1-4c94-8a3f-5793d3876386 None None] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:14:56.969458 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4e5281-64f1-4c94-8a3f-5793d3876386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:14:56.991622 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.auth.core [None req-fa4e5281-64f1-4c94-8a3f-5793d3876386 None None] MFA Rules not processed for user `efa212d5107a41ceb0902b9a2d8380d0`. Rule list: `[]` (Enabled: `True`). {{(pid=86500) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Apr 12 00:14:56.993148 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-fa4e5281-64f1-4c94-8a3f-5793d3876386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:14:57.000273 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1444/2885] 10.222.0.24 () {58 vars in 957 bytes} [Tue Apr 12 00:14:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Apr 12 00:15:15.086208 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7c399-bff3-4ad9-b40a-1122bfa2df5b service nova] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:15.139114 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7c399-bff3-4ad9-b40a-1122bfa2df5b service nova] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:15.142599 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23954100-db2b-41b2-8686-12815e67d56e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:15.143257 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23954100-db2b-41b2-8686-12815e67d56e service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:15.143548 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23954100-db2b-41b2-8686-12815e67d56e service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:15.143800 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23954100-db2b-41b2-8686-12815e67d56e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:15.146093 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-23954100-db2b-41b2-8686-12815e67d56e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:15:15.157028 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23954100-db2b-41b2-8686-12815e67d56e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:15.158467 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23954100-db2b-41b2-8686-12815e67d56e service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:15.168434 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1442/2886] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:15:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:15:33.413601 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e5281-64f1-4c94-8a3f-5793d3876386 None None] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:33.422970 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4e5281-64f1-4c94-8a3f-5793d3876386 None None] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:33.426405 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54e756-8cc1-42a6-b5e6-30afcaa343f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:33.427066 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54e756-8cc1-42a6-b5e6-30afcaa343f8 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:33.427343 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54e756-8cc1-42a6-b5e6-30afcaa343f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:33.428147 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54e756-8cc1-42a6-b5e6-30afcaa343f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:33.440267 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54e756-8cc1-42a6-b5e6-30afcaa343f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:33.441669 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54e756-8cc1-42a6-b5e6-30afcaa343f8 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:33.451396 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1445/2887] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:15:33 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:15:35.584598 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23954100-db2b-41b2-8686-12815e67d56e service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:15:35.585997 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-23954100-db2b-41b2-8686-12815e67d56e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:15:35.601625 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23954100-db2b-41b2-8686-12815e67d56e service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:15:35.607115 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75f870-ea4d-4f80-93b3-1cfa44d5c046 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:15:35.607784 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75f870-ea4d-4f80-93b3-1cfa44d5c046 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:15:35.608065 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75f870-ea4d-4f80-93b3-1cfa44d5c046 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:15:35.608338 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75f870-ea4d-4f80-93b3-1cfa44d5c046 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:15:35.610088 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-2e75f870-ea4d-4f80-93b3-1cfa44d5c046 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:15:35.623071 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75f870-ea4d-4f80-93b3-1cfa44d5c046 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:15:35.624659 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e75f870-ea4d-4f80-93b3-1cfa44d5c046 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:15:35.636797 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1443/2888] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:15:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:17:32.214032 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54e756-8cc1-42a6-b5e6-30afcaa343f8 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:17:32.222727 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54e756-8cc1-42a6-b5e6-30afcaa343f8 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:17:32.226337 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe99f3-1e10-4968-a808-924824cc1394 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:17:32.227003 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe99f3-1e10-4968-a808-924824cc1394 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:32.227282 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe99f3-1e10-4968-a808-924824cc1394 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:32.227553 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe99f3-1e10-4968-a808-924824cc1394 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:32.229295 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-2cbe99f3-1e10-4968-a808-924824cc1394 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:32.243422 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe99f3-1e10-4968-a808-924824cc1394 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:17:32.245100 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbe99f3-1e10-4968-a808-924824cc1394 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:17:32.257070 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1446/2889] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:17:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:17:33.442628 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75f870-ea4d-4f80-93b3-1cfa44d5c046 service nova] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:17:33.451681 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75f870-ea4d-4f80-93b3-1cfa44d5c046 service nova] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:17:33.455215 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73734b09-dcb8-4c6c-b888-098fab28251e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:17:33.456351 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73734b09-dcb8-4c6c-b888-098fab28251e service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:33.456629 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73734b09-dcb8-4c6c-b888-098fab28251e service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:33.456905 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73734b09-dcb8-4c6c-b888-098fab28251e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:33.458636 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-73734b09-dcb8-4c6c-b888-098fab28251e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:33.472497 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73734b09-dcb8-4c6c-b888-098fab28251e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:17:33.473947 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73734b09-dcb8-4c6c-b888-098fab28251e service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:17:33.484692 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1444/2890] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:17:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:17:40.899070 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe99f3-1e10-4968-a808-924824cc1394 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:17:40.900503 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-2cbe99f3-1e10-4968-a808-924824cc1394 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:40.911090 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe99f3-1e10-4968-a808-924824cc1394 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:17:40.914607 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506677f-af91-4af7-8593-70aad404ff11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:17:40.915267 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506677f-af91-4af7-8593-70aad404ff11 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:40.915547 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506677f-af91-4af7-8593-70aad404ff11 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:40.915846 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506677f-af91-4af7-8593-70aad404ff11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:40.917519 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-8506677f-af91-4af7-8593-70aad404ff11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:40.927033 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506677f-af91-4af7-8593-70aad404ff11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:17:40.928434 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506677f-af91-4af7-8593-70aad404ff11 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:17:40.936409 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1447/2891] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:17:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:17:46.511216 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73734b09-dcb8-4c6c-b888-098fab28251e service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:17:46.520171 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73734b09-dcb8-4c6c-b888-098fab28251e service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:17:46.524029 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2416e6b-da70-44d1-a3f9-c91463540632 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:17:46.524693 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2416e6b-da70-44d1-a3f9-c91463540632 service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:46.524969 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2416e6b-da70-44d1-a3f9-c91463540632 service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:46.525241 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2416e6b-da70-44d1-a3f9-c91463540632 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:46.527051 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-c2416e6b-da70-44d1-a3f9-c91463540632 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:46.537015 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2416e6b-da70-44d1-a3f9-c91463540632 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:17:46.538445 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2416e6b-da70-44d1-a3f9-c91463540632 service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:17:46.546226 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1445/2892] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:17:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:17:46.834357 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506677f-af91-4af7-8593-70aad404ff11 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:17:46.842945 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506677f-af91-4af7-8593-70aad404ff11 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:17:46.847259 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91065d92-9a0e-4aed-8547-b600ffd25517 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:17:46.847892 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91065d92-9a0e-4aed-8547-b600ffd25517 service neutron] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:46.848169 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91065d92-9a0e-4aed-8547-b600ffd25517 service neutron] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:46.848438 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91065d92-9a0e-4aed-8547-b600ffd25517 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:46.850219 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-91065d92-9a0e-4aed-8547-b600ffd25517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:46.860153 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91065d92-9a0e-4aed-8547-b600ffd25517 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:17:46.861665 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91065d92-9a0e-4aed-8547-b600ffd25517 service neutron] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:17:46.870311 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1448/2893] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:17:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Apr 12 00:17:46.969617 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2416e6b-da70-44d1-a3f9-c91463540632 service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:17:46.978646 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2416e6b-da70-44d1-a3f9-c91463540632 service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:17:46.982202 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bb4da-ce35-4874-b7e7-e4f8f57b46dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6936272118b49a9baa19f3bd5066f9d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:17:46.982864 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bb4da-ce35-4874-b7e7-e4f8f57b46dc service neutron] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:46.983138 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bb4da-ce35-4874-b7e7-e4f8f57b46dc service neutron] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:46.983413 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bb4da-ce35-4874-b7e7-e4f8f57b46dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:46.985165 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-647bb4da-ce35-4874-b7e7-e4f8f57b46dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:46.998288 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647bb4da-ce35-4874-b7e7-e4f8f57b46dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:17:46.999674 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647bb4da-ce35-4874-b7e7-e4f8f57b46dc service neutron] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:17:47.010662 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1446/2894] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:17:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:17:47.071663 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91065d92-9a0e-4aed-8547-b600ffd25517 service neutron] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:17:47.073064 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-91065d92-9a0e-4aed-8547-b600ffd25517 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:47.137748 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91065d92-9a0e-4aed-8547-b600ffd25517 service neutron] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:17:47.142611 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e08e6-8583-4642-8ff6-a7bfaa88a5ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47515442e0e84441bed4bfbb7a3b4ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:17:47.143820 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e08e6-8583-4642-8ff6-a7bfaa88a5ae service placement] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:47.144092 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e08e6-8583-4642-8ff6-a7bfaa88a5ae service placement] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:47.144358 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198e08e6-8583-4642-8ff6-a7bfaa88a5ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:47.146065 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-198e08e6-8583-4642-8ff6-a7bfaa88a5ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:47.156965 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e08e6-8583-4642-8ff6-a7bfaa88a5ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:17:47.158522 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198e08e6-8583-4642-8ff6-a7bfaa88a5ae service placement] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:17:47.168029 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1449/2895] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:17:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:17:48.629430 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bb4da-ce35-4874-b7e7-e4f8f57b46dc service neutron] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:17:48.640683 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bb4da-ce35-4874-b7e7-e4f8f57b46dc service neutron] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:17:48.646338 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08c959-857f-4de7-a363-2f0ab97c18a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:17:48.647001 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08c959-857f-4de7-a363-2f0ab97c18a3 service nova] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:17:48.647281 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08c959-857f-4de7-a363-2f0ab97c18a3 service nova] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:17:48.647553 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f08c959-857f-4de7-a363-2f0ab97c18a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:17:48.649306 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-8f08c959-857f-4de7-a363-2f0ab97c18a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:17:48.661606 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08c959-857f-4de7-a363-2f0ab97c18a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:17:48.663207 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f08c959-857f-4de7-a363-2f0ab97c18a3 service nova] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:17:48.673529 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1447/2896] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:17:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:18.387989 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e08e6-8583-4642-8ff6-a7bfaa88a5ae service placement] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:18.400540 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198e08e6-8583-4642-8ff6-a7bfaa88a5ae service placement] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:18.405957 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470e6b4-abbe-4c84-9afc-60db6aba6e6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a9519f49f897415a894c1121278dda9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:18.406610 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470e6b4-abbe-4c84-9afc-60db6aba6e6c service nova] REQUEST_METHOD: `GET` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:18.406915 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470e6b4-abbe-4c84-9afc-60db6aba6e6c service nova] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:18.407187 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470e6b4-abbe-4c84-9afc-60db6aba6e6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:18.408980 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-c470e6b4-abbe-4c84-9afc-60db6aba6e6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:18.421460 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470e6b4-abbe-4c84-9afc-60db6aba6e6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:18.423065 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470e6b4-abbe-4c84-9afc-60db6aba6e6c service nova] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:18.434256 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1450/2897] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:19:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Apr 12 00:19:27.919251 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08c959-857f-4de7-a363-2f0ab97c18a3 service nova] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:27.979352 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f08c959-857f-4de7-a363-2f0ab97c18a3 service nova] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:27.983789 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f1cfd-f9a9-4b3a-9b49-7763a2ac1cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:27.984640 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f1cfd-f9a9-4b3a-9b49-7763a2ac1cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:27.984914 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f1cfd-f9a9-4b3a-9b49-7763a2ac1cef admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:27.985182 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f1cfd-f9a9-4b3a-9b49-7763a2ac1cef admin admin] PATH_INFO: `/v3/users/efa212d5107a41ceb0902b9a2d8380d0` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:27.986334 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f1cfd-f9a9-4b3a-9b49-7763a2ac1cef admin admin] RBAC: Authorizing `identity:delete_user(user_id=efa212d5107a41ceb0902b9a2d8380d0)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:27.988253 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f1cfd-f9a9-4b3a-9b49-7763a2ac1cef admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:28.142029 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c39f1cfd-f9a9-4b3a-9b49-7763a2ac1cef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efa212d5107a41ceb0902b9a2d8380d0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:19:28.148795 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c39f1cfd-f9a9-4b3a-9b49-7763a2ac1cef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efa212d5107a41ceb0902b9a2d8380d0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:19:28.209414 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c39f1cfd-f9a9-4b3a-9b49-7763a2ac1cef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efa212d5107a41ceb0902b9a2d8380d0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:19:28.209989 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c39f1cfd-f9a9-4b3a-9b49-7763a2ac1cef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efa212d5107a41ceb0902b9a2d8380d0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:19:28.222529 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-c39f1cfd-f9a9-4b3a-9b49-7763a2ac1cef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efa212d5107a41ceb0902b9a2d8380d0'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:19:28.228504 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1448/2898] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:19:27 2022] DELETE /identity/v3/users/efa212d5107a41ceb0902b9a2d8380d0 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:19:28.468266 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470e6b4-abbe-4c84-9afc-60db6aba6e6c service nova] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:28.479519 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470e6b4-abbe-4c84-9afc-60db6aba6e6c service nova] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:28.535433 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5cfbc-bb74-4a9f-95a8-4dbcaa67c342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:28.536283 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5cfbc-bb74-4a9f-95a8-4dbcaa67c342 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:28.536565 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5cfbc-bb74-4a9f-95a8-4dbcaa67c342 admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:28.536841 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5cfbc-bb74-4a9f-95a8-4dbcaa67c342 admin admin] PATH_INFO: `/v3/projects/7f50ab8a19e8481daa24f0cb870c8e7d` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:28.538032 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5cfbc-bb74-4a9f-95a8-4dbcaa67c342 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f50ab8a19e8481daa24f0cb870c8e7d)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:28.539962 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5cfbc-bb74-4a9f-95a8-4dbcaa67c342 admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:28.637503 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3bb5cfbc-bb74-4a9f-95a8-4dbcaa67c342 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f50ab8a19e8481daa24f0cb870c8e7d', 'request_id': 'req-3bb5cfbc-bb74-4a9f-95a8-4dbcaa67c342'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:19:28.700861 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3bb5cfbc-bb74-4a9f-95a8-4dbcaa67c342 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f50ab8a19e8481daa24f0cb870c8e7d', 'request_id': 'req-3bb5cfbc-bb74-4a9f-95a8-4dbcaa67c342'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:19:28.706453 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3bb5cfbc-bb74-4a9f-95a8-4dbcaa67c342 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f50ab8a19e8481daa24f0cb870c8e7d', 'request_id': 'req-3bb5cfbc-bb74-4a9f-95a8-4dbcaa67c342'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:19:28.717833 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3bb5cfbc-bb74-4a9f-95a8-4dbcaa67c342 admin admin] The token cache is being invalidate because project 7f50ab8a19e8481daa24f0cb870c8e7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:19:28.718055 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3bb5cfbc-bb74-4a9f-95a8-4dbcaa67c342 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:19:28.718672 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-3bb5cfbc-bb74-4a9f-95a8-4dbcaa67c342 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:19:28.720235 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1451/2899] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:19:28 2022] DELETE /identity/v3/projects/7f50ab8a19e8481daa24f0cb870c8e7d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:19:28.724169 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f1cfd-f9a9-4b3a-9b49-7763a2ac1cef admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:28.725538 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-c39f1cfd-f9a9-4b3a-9b49-7763a2ac1cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:28.738909 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f1cfd-f9a9-4b3a-9b49-7763a2ac1cef admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:28.795030 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b4b45-a996-4dbb-b64f-acde24ebbe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:28.795898 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b4b45-a996-4dbb-b64f-acde24ebbe04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:28.796178 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b4b45-a996-4dbb-b64f-acde24ebbe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:28.796450 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b4b45-a996-4dbb-b64f-acde24ebbe04 admin admin] PATH_INFO: `/v3/users/5cc8b0c8d6ab40a884d34ade242ff8ac` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:28.797627 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b4b45-a996-4dbb-b64f-acde24ebbe04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cc8b0c8d6ab40a884d34ade242ff8ac)` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:28.799561 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b4b45-a996-4dbb-b64f-acde24ebbe04 admin admin] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:28.964396 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-416b4b45-a996-4dbb-b64f-acde24ebbe04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cc8b0c8d6ab40a884d34ade242ff8ac'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:19:28.971071 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-416b4b45-a996-4dbb-b64f-acde24ebbe04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cc8b0c8d6ab40a884d34ade242ff8ac'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:19:29.032710 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-416b4b45-a996-4dbb-b64f-acde24ebbe04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cc8b0c8d6ab40a884d34ade242ff8ac'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:19:29.033336 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-416b4b45-a996-4dbb-b64f-acde24ebbe04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cc8b0c8d6ab40a884d34ade242ff8ac'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:19:29.045965 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.notifications [None req-416b4b45-a996-4dbb-b64f-acde24ebbe04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cc8b0c8d6ab40a884d34ade242ff8ac'} {{(pid=86501) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:19:29.051805 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1449/2900] 10.222.0.24 () {58 vars in 1223 bytes} [Tue Apr 12 00:19:28 2022] DELETE /identity/v3/users/5cc8b0c8d6ab40a884d34ade242ff8ac => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:19:29.268242 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5cfbc-bb74-4a9f-95a8-4dbcaa67c342 admin admin] Authenticating user token {{(pid=86500) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:29.269672 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.fernet_utils [None req-3bb5cfbc-bb74-4a9f-95a8-4dbcaa67c342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86500) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:29.282039 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5cfbc-bb74-4a9f-95a8-4dbcaa67c342 admin admin] Validating token access rules against request {{(pid=86500) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:29.336272 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f8fcc2-93f3-4370-baa1-f947a53eec3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'abec147e21ba4a90ada48328d76ea483', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1da535e2d1e54da3b958d1c813082f2d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86500) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:29.337123 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8fcc2-93f3-4370-baa1-f947a53eec3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:29.337401 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8fcc2-93f3-4370-baa1-f947a53eec3c admin admin] SCRIPT_NAME: `/identity` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:29.337700 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f8fcc2-93f3-4370-baa1-f947a53eec3c admin admin] PATH_INFO: `/v3/projects/051cdc8c266f4ccc8f5748e3c86bcb2e` {{(pid=86500) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:29.338895 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8fcc2-93f3-4370-baa1-f947a53eec3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=051cdc8c266f4ccc8f5748e3c86bcb2e)` {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:29.340841 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f8fcc2-93f3-4370-baa1-f947a53eec3c admin admin] RBAC: Authorization granted {{(pid=86500) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:29.449826 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-87f8fcc2-93f3-4370-baa1-f947a53eec3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '051cdc8c266f4ccc8f5748e3c86bcb2e', 'request_id': 'req-87f8fcc2-93f3-4370-baa1-f947a53eec3c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:19:29.489133 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-87f8fcc2-93f3-4370-baa1-f947a53eec3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '051cdc8c266f4ccc8f5748e3c86bcb2e', 'request_id': 'req-87f8fcc2-93f3-4370-baa1-f947a53eec3c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:19:29.495107 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-87f8fcc2-93f3-4370-baa1-f947a53eec3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '051cdc8c266f4ccc8f5748e3c86bcb2e', 'request_id': 'req-87f8fcc2-93f3-4370-baa1-f947a53eec3c'} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:19:29.506286 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-87f8fcc2-93f3-4370-baa1-f947a53eec3c admin admin] The token cache is being invalidate because project 051cdc8c266f4ccc8f5748e3c86bcb2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86500) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Apr 12 00:19:29.506574 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-87f8fcc2-93f3-4370-baa1-f947a53eec3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:19:29.507200 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: DEBUG keystone.notifications [None req-87f8fcc2-93f3-4370-baa1-f947a53eec3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86500) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Apr 12 00:19:29.508717 dv-cinder-837432-2-iscsi devstack@keystone.service[86500]: [pid: 86500|app: 0|req: 1452/2901] 10.222.0.24 () {58 vars in 1232 bytes} [Tue Apr 12 00:19:29 2022] DELETE /identity/v3/projects/051cdc8c266f4ccc8f5748e3c86bcb2e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Apr 12 00:19:46.143107 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b4b45-a996-4dbb-b64f-acde24ebbe04 admin admin] Authenticating user token {{(pid=86501) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Apr 12 00:19:46.144501 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-416b4b45-a996-4dbb-b64f-acde24ebbe04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:46.210202 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b4b45-a996-4dbb-b64f-acde24ebbe04 admin admin] Validating token access rules against request {{(pid=86501) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Apr 12 00:19:46.266280 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36832dd6-011c-4df4-8b85-af854d15cb1c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47515442e0e84441bed4bfbb7a3b4ff9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3563c87e56124c688a8029b4088cb198', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86501) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Apr 12 00:19:46.266953 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36832dd6-011c-4df4-8b85-af854d15cb1c service placement] REQUEST_METHOD: `GET` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Apr 12 00:19:46.267238 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36832dd6-011c-4df4-8b85-af854d15cb1c service placement] SCRIPT_NAME: `/identity` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Apr 12 00:19:46.267514 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36832dd6-011c-4df4-8b85-af854d15cb1c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86501) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Apr 12 00:19:46.269283 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.fernet_utils [None req-36832dd6-011c-4df4-8b85-af854d15cb1c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86501) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Apr 12 00:19:46.280701 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36832dd6-011c-4df4-8b85-af854d15cb1c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Apr 12 00:19:46.282252 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36832dd6-011c-4df4-8b85-af854d15cb1c service placement] RBAC: Authorization granted {{(pid=86501) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Apr 12 00:19:46.292139 dv-cinder-837432-2-iscsi devstack@keystone.service[86501]: [pid: 86501|app: 0|req: 1450/2902] 10.222.0.24 () {60 vars in 1365 bytes} [Tue Apr 12 00:19:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)